2026-02-24T07:10:56.165 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T07:10:56.180 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:10:56.257 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67570 branch: main description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rados_api_tests} email: null first_in_suite: false flavor: debug job_id: '67570' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd objectstore: seastore osd shutdown pgref assert: true seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: ff63f3d997e38f69382fd23ac0206f07f7b05017 workunit: branch: wip-shraddhaag-enable-cephadm-tests env: CRIMSON_COMPAT: '1' sha1: a78040ddef3ba5a489697ca2fe95df59a7d8bd08 owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com priority: 49 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - client.0 - node-exporter.a - - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 5980 sha1: ff63f3d997e38f69382fd23ac0206f07f7b05017 sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-shraddhaag-enable-cephadm-tests suite_path: /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa suite_relpath: qa suite_repo: https://github.com/shraddhaag/ceph.git suite_sha1: a78040ddef3ba5a489697ca2fe95df59a7d8bd08 targets: trial022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5dKpb6jUTS7yBkwavbVsqBTxRTzkReqW2Wx7Pe9R73ay9X2Z8peAt12eC7nQxTNxWwmJuY0WYUwE43Tp5WgY0= trial195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCNnHbMuFC8GYnfA2j9GjVTiY56CxKRefRh8X2PEeLP/lZBUZS+dUL7ZqRN4D0tuRG4Mm7SsLlBsw9q8/BqNqjM= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 debug osd: 10 osd_type: crimson - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-24_06:51:01 tube: trial user: shraddhaag verbose: false verify_ceph_hash: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T07:10:56.258 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa; will attempt to use it 2026-02-24T07:10:56.258 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_shraddhaag_ceph_a78040ddef3ba5a489697ca2fe95df59a7d8bd08/qa/tasks 2026-02-24T07:10:56.258 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T07:10:56.260 INFO:teuthology.task.internal:Saving configuration 2026-02-24T07:10:56.266 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T07:10:56.278 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T07:10:56.357 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial022.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67570', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 07:07:27.408262', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5dKpb6jUTS7yBkwavbVsqBTxRTzkReqW2Wx7Pe9R73ay9X2Z8peAt12eC7nQxTNxWwmJuY0WYUwE43Tp5WgY0='} 2026-02-24T07:10:56.413 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial195.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67570', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 07:07:27.407646', 'locked_by': 'scheduled_shraddhaag@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCNnHbMuFC8GYnfA2j9GjVTiY56CxKRefRh8X2PEeLP/lZBUZS+dUL7ZqRN4D0tuRG4Mm7SsLlBsw9q8/BqNqjM='} 2026-02-24T07:10:56.414 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T07:10:56.428 INFO:teuthology.task.internal:roles: ubuntu@trial022.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-24T07:10:56.428 INFO:teuthology.task.internal:roles: ubuntu@trial195.front.sepia.ceph.com - ['osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-24T07:10:56.428 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T07:10:56.564 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x799b23335bc0>, signals=[15]) 2026-02-24T07:10:56.564 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T07:10:56.575 INFO:teuthology.task.internal:Opening connections... 2026-02-24T07:10:56.575 DEBUG:teuthology.task.internal:connecting to ubuntu@trial022.front.sepia.ceph.com 2026-02-24T07:10:56.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:10:56.639 DEBUG:teuthology.task.internal:connecting to ubuntu@trial195.front.sepia.ceph.com 2026-02-24T07:10:56.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:10:56.702 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T07:10:56.714 DEBUG:teuthology.orchestra.run.trial022:> uname -m 2026-02-24T07:10:56.730 INFO:teuthology.orchestra.run.trial022.stdout:x86_64 2026-02-24T07:10:56.730 DEBUG:teuthology.orchestra.run.trial022:> cat /etc/os-release 2026-02-24T07:10:56.786 INFO:teuthology.orchestra.run.trial022.stdout:NAME="CentOS Stream" 2026-02-24T07:10:56.786 INFO:teuthology.orchestra.run.trial022.stdout:VERSION="9" 2026-02-24T07:10:56.786 INFO:teuthology.orchestra.run.trial022.stdout:ID="centos" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:ID_LIKE="rhel fedora" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:VERSION_ID="9" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:PLATFORM_ID="platform:el9" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:ANSI_COLOR="0;31" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:LOGO="fedora-logo-icon" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:HOME_URL="https://centos.org/" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T07:10:56.787 INFO:teuthology.orchestra.run.trial022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T07:10:56.787 INFO:teuthology.lock.ops:Updating trial022.front.sepia.ceph.com on lock server 2026-02-24T07:10:56.858 DEBUG:teuthology.orchestra.run.trial195:> uname -m 2026-02-24T07:10:56.873 INFO:teuthology.orchestra.run.trial195.stdout:x86_64 2026-02-24T07:10:56.873 DEBUG:teuthology.orchestra.run.trial195:> cat /etc/os-release 2026-02-24T07:10:56.929 INFO:teuthology.orchestra.run.trial195.stdout:NAME="CentOS Stream" 2026-02-24T07:10:56.929 INFO:teuthology.orchestra.run.trial195.stdout:VERSION="9" 2026-02-24T07:10:56.929 INFO:teuthology.orchestra.run.trial195.stdout:ID="centos" 2026-02-24T07:10:56.929 INFO:teuthology.orchestra.run.trial195.stdout:ID_LIKE="rhel fedora" 2026-02-24T07:10:56.930 INFO:teuthology.orchestra.run.trial195.stdout:VERSION_ID="9" 2026-02-24T07:10:56.930 INFO:teuthology.orchestra.run.trial195.stdout:PLATFORM_ID="platform:el9" 2026-02-24T07:10:56.930 INFO:teuthology.orchestra.run.trial195.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T07:10:56.930 INFO:teuthology.orchestra.run.trial195.stdout:ANSI_COLOR="0;31" 2026-02-24T07:10:56.930 INFO:teuthology.orchestra.run.trial195.stdout:LOGO="fedora-logo-icon" 2026-02-24T07:10:56.930 INFO:teuthology.orchestra.run.trial195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T07:10:56.930 INFO:teuthology.orchestra.run.trial195.stdout:HOME_URL="https://centos.org/" 2026-02-24T07:10:56.930 INFO:teuthology.orchestra.run.trial195.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T07:10:56.930 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T07:10:56.930 INFO:teuthology.orchestra.run.trial195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T07:10:56.930 INFO:teuthology.lock.ops:Updating trial195.front.sepia.ceph.com on lock server 2026-02-24T07:10:57.017 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T07:10:57.029 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T07:10:57.039 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T07:10:57.039 DEBUG:teuthology.orchestra.run.trial022:> test '!' -e /home/ubuntu/cephtest 2026-02-24T07:10:57.040 DEBUG:teuthology.orchestra.run.trial195:> test '!' -e /home/ubuntu/cephtest 2026-02-24T07:10:57.055 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T07:10:57.065 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T07:10:57.065 DEBUG:teuthology.orchestra.run.trial022:> test -z $(ls -A /var/lib/ceph) 2026-02-24T07:10:57.096 DEBUG:teuthology.orchestra.run.trial195:> test -z $(ls -A /var/lib/ceph) 2026-02-24T07:10:57.112 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T07:10:57.258 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T07:10:57.275 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-24T07:10:57.276 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'osd.2': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-24T07:10:57.276 DEBUG:teuthology.orchestra.run.trial022:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T07:10:57.276 DEBUG:teuthology.orchestra.run.trial195:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T07:10:57.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:10:57.291 DEBUG:teuthology.orchestra.run.trial022:> uname -r 2026-02-24T07:10:57.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:10:57.291 DEBUG:teuthology.orchestra.run.trial195:> uname -r 2026-02-24T07:10:57.346 INFO:teuthology.orchestra.run.trial195.stdout:5.14.0-681.el9.x86_64 2026-02-24T07:10:57.347 INFO:teuthology.task.kernel:Running kernel on trial195: 5.14.0-681.el9.x86_64 2026-02-24T07:10:57.347 DEBUG:teuthology.orchestra.run.trial195:> sudo yum install -y kernel 2026-02-24T07:10:57.347 INFO:teuthology.orchestra.run.trial022.stdout:5.14.0-681.el9.x86_64 2026-02-24T07:10:57.347 INFO:teuthology.task.kernel:Running kernel on trial022: 5.14.0-681.el9.x86_64 2026-02-24T07:10:57.347 DEBUG:teuthology.orchestra.run.trial022:> sudo yum install -y kernel 2026-02-24T07:10:58.240 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.9 MB 00:00 2026-02-24T07:10:59.093 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - AppStream 82 MB/s | 27 MB 00:00 2026-02-24T07:10:59.349 INFO:teuthology.orchestra.run.trial022.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.9 MB 00:01 2026-02-24T07:11:02.429 INFO:teuthology.orchestra.run.trial022.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-24T07:11:02.581 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 8.0 MB 00:01 2026-02-24T07:11:04.323 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-24T07:11:05.183 INFO:teuthology.orchestra.run.trial195.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2026-02-24T07:11:06.464 INFO:teuthology.orchestra.run.trial022.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 8.0 MB 00:01 2026-02-24T07:11:07.997 INFO:teuthology.orchestra.run.trial022.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-24T07:11:08.327 INFO:teuthology.orchestra.run.trial022.stdout:Extra Packages for Enterprise Linux 76 MB/s | 20 MB 00:00 2026-02-24T07:11:08.397 INFO:teuthology.orchestra.run.trial195.stdout:lab-extras 2.0 MB/s | 50 kB 00:00 2026-02-24T07:11:09.410 INFO:teuthology.orchestra.run.trial195.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T07:11:09.411 INFO:teuthology.orchestra.run.trial195.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T07:11:09.430 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:11:09.431 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:11:09.432 INFO:teuthology.orchestra.run.trial195.stdout: Package Architecture Version Repository Size 2026-02-24T07:11:09.432 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:11:09.432 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:11:09.432 INFO:teuthology.orchestra.run.trial195.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T07:11:09.432 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T07:11:09.432 INFO:teuthology.orchestra.run.trial195.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T07:11:09.432 INFO:teuthology.orchestra.run.trial195.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T07:11:09.432 INFO:teuthology.orchestra.run.trial195.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T07:11:09.433 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:11:09.433 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:11:09.433 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:11:09.433 INFO:teuthology.orchestra.run.trial195.stdout:Install 4 Packages 2026-02-24T07:11:09.433 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:11:09.433 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 89 M 2026-02-24T07:11:09.433 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 135 M 2026-02-24T07:11:09.433 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:11:10.159 INFO:teuthology.orchestra.run.trial195.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 1.4 MB/s | 901 kB 00:00 2026-02-24T07:11:10.727 INFO:teuthology.orchestra.run.trial195.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-24T07:11:11.200 INFO:teuthology.orchestra.run.trial195.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 30 MB/s | 31 MB 00:01 2026-02-24T07:11:11.376 INFO:teuthology.orchestra.run.trial195.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-24T07:11:11.377 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:11:11.377 INFO:teuthology.orchestra.run.trial195.stdout:Total 46 MB/s | 89 MB 00:01 2026-02-24T07:11:11.499 INFO:teuthology.orchestra.run.trial022.stdout:lab-extras 2.2 MB/s | 50 kB 00:00 2026-02-24T07:11:11.569 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:11:11.776 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:11:11.776 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:11:12.161 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:11:12.162 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:11:12.512 INFO:teuthology.orchestra.run.trial022.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T07:11:12.512 INFO:teuthology.orchestra.run.trial022.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T07:11:12.532 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:11:12.533 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:11:12.533 INFO:teuthology.orchestra.run.trial022.stdout: Package Architecture Version Repository Size 2026-02-24T07:11:12.533 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:11:12.533 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:11:12.533 INFO:teuthology.orchestra.run.trial022.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout:Installing dependencies: 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout:Install 4 Packages 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 89 M 2026-02-24T07:11:12.534 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 135 M 2026-02-24T07:11:12.535 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:11:13.286 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:11:13.483 INFO:teuthology.orchestra.run.trial022.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 1.4 MB/s | 901 kB 00:00 2026-02-24T07:11:13.579 INFO:teuthology.orchestra.run.trial195.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T07:11:13.601 INFO:teuthology.orchestra.run.trial195.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:11:14.028 INFO:teuthology.orchestra.run.trial022.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-24T07:11:14.560 INFO:teuthology.orchestra.run.trial022.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-24T07:11:14.716 INFO:teuthology.orchestra.run.trial022.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-24T07:11:14.716 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:11:14.716 INFO:teuthology.orchestra.run.trial022.stdout:Total 41 MB/s | 89 MB 00:02 2026-02-24T07:11:14.906 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:11:15.108 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:11:15.109 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:11:15.492 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:11:15.492 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:11:16.184 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:11:16.217 INFO:teuthology.orchestra.run.trial195.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:11:16.602 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:11:16.892 INFO:teuthology.orchestra.run.trial022.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T07:11:16.913 INFO:teuthology.orchestra.run.trial022.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:11:19.257 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:11:19.264 INFO:teuthology.orchestra.run.trial195.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:19.498 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:11:19.532 INFO:teuthology.orchestra.run.trial022.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:11:22.314 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:22.739 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:11:22.745 INFO:teuthology.orchestra.run.trial022.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:25.857 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:39.873 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:39.897 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:40.083 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:40.083 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T07:11:40.083 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:11:40.083 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:11:40.139 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:40.139 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:11:40.140 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:11:40.140 INFO:teuthology.orchestra.run.trial195.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T07:11:40.140 INFO:teuthology.orchestra.run.trial195.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T07:11:40.140 INFO:teuthology.orchestra.run.trial195.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T07:11:40.140 INFO:teuthology.orchestra.run.trial195.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T07:11:40.140 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:11:40.140 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:11:40.202 DEBUG:teuthology.orchestra.run.trial195:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T07:11:40.232 INFO:teuthology.orchestra.run.trial195.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T07:11:40.232 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T07:11:40.233 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T07:11:40.233 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T07:11:40.233 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T07:11:40.233 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2026-02-24T07:11:40.233 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial195.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T07:11:40.233 DEBUG:teuthology.orchestra.run.trial195:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T07:11:40.297 INFO:teuthology.orchestra.run.trial195.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T07:11:40.298 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T07:11:40.299 DEBUG:teuthology.orchestra.run.trial195:> sudo rpm -qi grub2-tools 2026-02-24T07:11:40.366 INFO:teuthology.orchestra.run.trial195.stdout:Name : grub2-tools 2026-02-24T07:11:40.367 INFO:teuthology.orchestra.run.trial195.stdout:Epoch : 1 2026-02-24T07:11:40.367 INFO:teuthology.orchestra.run.trial195.stdout:Version : 2.06 2026-02-24T07:11:40.367 INFO:teuthology.orchestra.run.trial195.stdout:Release : 120.el9 2026-02-24T07:11:40.367 INFO:teuthology.orchestra.run.trial195.stdout:Architecture: x86_64 2026-02-24T07:11:40.367 INFO:teuthology.orchestra.run.trial195.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T07:11:40.367 INFO:teuthology.orchestra.run.trial195.stdout:Group : Unspecified 2026-02-24T07:11:40.367 INFO:teuthology.orchestra.run.trial195.stdout:Size : 9108611 2026-02-24T07:11:40.367 INFO:teuthology.orchestra.run.trial195.stdout:License : GPLv3+ 2026-02-24T07:11:40.367 INFO:teuthology.orchestra.run.trial195.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T07:11:40.367 INFO:teuthology.orchestra.run.trial195.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:Packager : builder@centos.org 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:Vendor : CentOS 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:Summary : Support tools for GRUB. 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:Description : 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout:hardware devices. 2026-02-24T07:11:40.368 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:11:40.369 INFO:teuthology.orchestra.run.trial195.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T07:11:40.370 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T07:11:40.370 INFO:teuthology.task.kernel:Updating grub on trial195 to boot 5.14.0-686.el9.x86_64 2026-02-24T07:11:40.370 DEBUG:teuthology.orchestra.run.trial195:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T07:11:40.434 INFO:teuthology.orchestra.run.trial195.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T07:11:40.435 DEBUG:teuthology.orchestra.run.trial195:> sudo command -v grubby && echo yes || echo no 2026-02-24T07:11:40.497 INFO:teuthology.orchestra.run.trial195.stdout:/sbin/grubby 2026-02-24T07:11:40.498 INFO:teuthology.orchestra.run.trial195.stdout:yes 2026-02-24T07:11:40.499 DEBUG:teuthology.orchestra.run.trial195:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T07:11:40.562 INFO:teuthology.orchestra.run.trial195.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T07:11:40.563 DEBUG:teuthology.orchestra.run.trial195:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T07:11:40.635 DEBUG:teuthology.orchestra.run.trial195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T07:11:40.843 INFO:teuthology.orchestra.run.trial195.stderr:Generating grub configuration file ... 2026-02-24T07:11:40.910 INFO:teuthology.orchestra.run.trial195.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T07:11:40.917 INFO:teuthology.orchestra.run.trial195.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T07:11:41.169 INFO:teuthology.orchestra.run.trial195.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T07:11:41.175 INFO:teuthology.orchestra.run.trial195.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T07:11:41.210 INFO:teuthology.orchestra.run.trial195.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T07:11:41.216 INFO:teuthology.orchestra.run.trial195.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T07:11:41.247 INFO:teuthology.orchestra.run.trial195.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T07:11:41.254 INFO:teuthology.orchestra.run.trial195.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T07:11:41.277 INFO:teuthology.orchestra.run.trial195.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T07:11:41.284 INFO:teuthology.orchestra.run.trial195.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T07:11:41.371 INFO:teuthology.orchestra.run.trial195.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T07:11:41.379 INFO:teuthology.orchestra.run.trial195.stderr:done 2026-02-24T07:11:41.381 DEBUG:teuthology.orchestra.run.trial195:> test -d /sys/firmware/efi 2026-02-24T07:11:41.398 DEBUG:teuthology.orchestra.run.trial195:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T07:11:41.463 INFO:teuthology.orchestra.run.trial195.stdout:/boot/efi/EFI/BOOT 2026-02-24T07:11:41.464 INFO:teuthology.orchestra.run.trial195.stdout:/boot/efi/EFI/centos 2026-02-24T07:11:41.465 DEBUG:teuthology.orchestra.run.trial195:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T07:11:41.532 INFO:teuthology.orchestra.run.trial195.stdout:no 2026-02-24T07:11:41.532 DEBUG:teuthology.orchestra.run.trial195:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T07:11:41.597 INFO:teuthology.orchestra.run.trial195.stdout:yes 2026-02-24T07:11:41.597 DEBUG:teuthology.orchestra.run.trial195:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T07:11:41.661 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial195 2026-02-24T07:11:41.662 DEBUG:teuthology.orchestra.run.trial195:> sudo bash -c ' 2026-02-24T07:11:41.662 DEBUG:teuthology.orchestra.run.trial195:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T07:11:41.662 DEBUG:teuthology.orchestra.run.trial195:> ' 2026-02-24T07:11:43.365 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:43.387 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:43.573 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:43.574 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T07:11:43.574 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T07:11:43.574 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T07:11:43.631 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T07:11:43.632 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:11:43.632 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:11:43.632 INFO:teuthology.orchestra.run.trial022.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T07:11:43.632 INFO:teuthology.orchestra.run.trial022.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T07:11:43.632 INFO:teuthology.orchestra.run.trial022.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T07:11:43.632 INFO:teuthology.orchestra.run.trial022.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T07:11:43.632 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:11:43.632 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:11:43.693 DEBUG:teuthology.orchestra.run.trial022:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T07:11:43.721 INFO:teuthology.orchestra.run.trial022.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T07:11:43.722 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T07:11:43.722 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T07:11:43.723 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T07:11:43.723 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T07:11:43.723 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-24T07:11:43.723 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial022.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T07:11:43.723 DEBUG:teuthology.orchestra.run.trial022:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T07:11:43.788 INFO:teuthology.orchestra.run.trial022.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T07:11:43.789 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T07:11:43.790 DEBUG:teuthology.orchestra.run.trial022:> sudo rpm -qi grub2-tools 2026-02-24T07:11:43.860 INFO:teuthology.orchestra.run.trial022.stdout:Name : grub2-tools 2026-02-24T07:11:43.860 INFO:teuthology.orchestra.run.trial022.stdout:Epoch : 1 2026-02-24T07:11:43.860 INFO:teuthology.orchestra.run.trial022.stdout:Version : 2.06 2026-02-24T07:11:43.860 INFO:teuthology.orchestra.run.trial022.stdout:Release : 120.el9 2026-02-24T07:11:43.860 INFO:teuthology.orchestra.run.trial022.stdout:Architecture: x86_64 2026-02-24T07:11:43.860 INFO:teuthology.orchestra.run.trial022.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T07:11:43.860 INFO:teuthology.orchestra.run.trial022.stdout:Group : Unspecified 2026-02-24T07:11:43.860 INFO:teuthology.orchestra.run.trial022.stdout:Size : 9108611 2026-02-24T07:11:43.860 INFO:teuthology.orchestra.run.trial022.stdout:License : GPLv3+ 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:Packager : builder@centos.org 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:Vendor : CentOS 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:Summary : Support tools for GRUB. 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:Description : 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T07:11:43.861 INFO:teuthology.orchestra.run.trial022.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T07:11:43.862 INFO:teuthology.orchestra.run.trial022.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T07:11:43.862 INFO:teuthology.orchestra.run.trial022.stdout:hardware devices. 2026-02-24T07:11:43.862 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:11:43.862 INFO:teuthology.orchestra.run.trial022.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T07:11:43.863 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T07:11:43.863 INFO:teuthology.task.kernel:Updating grub on trial022 to boot 5.14.0-686.el9.x86_64 2026-02-24T07:11:43.863 DEBUG:teuthology.orchestra.run.trial022:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T07:11:43.926 INFO:teuthology.orchestra.run.trial022.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T07:11:43.927 DEBUG:teuthology.orchestra.run.trial022:> sudo command -v grubby && echo yes || echo no 2026-02-24T07:11:43.993 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/grubby 2026-02-24T07:11:43.995 INFO:teuthology.orchestra.run.trial022.stdout:yes 2026-02-24T07:11:43.995 DEBUG:teuthology.orchestra.run.trial022:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T07:11:44.059 INFO:teuthology.orchestra.run.trial022.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T07:11:44.060 DEBUG:teuthology.orchestra.run.trial022:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T07:11:44.135 DEBUG:teuthology.orchestra.run.trial022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T07:11:44.340 INFO:teuthology.orchestra.run.trial022.stderr:Generating grub configuration file ... 2026-02-24T07:11:44.407 INFO:teuthology.orchestra.run.trial022.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T07:11:44.414 INFO:teuthology.orchestra.run.trial022.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T07:11:44.667 INFO:teuthology.orchestra.run.trial022.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T07:11:44.674 INFO:teuthology.orchestra.run.trial022.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T07:11:44.708 INFO:teuthology.orchestra.run.trial022.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T07:11:44.715 INFO:teuthology.orchestra.run.trial022.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T07:11:44.746 INFO:teuthology.orchestra.run.trial022.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T07:11:44.752 INFO:teuthology.orchestra.run.trial022.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T07:11:44.775 INFO:teuthology.orchestra.run.trial022.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T07:11:44.782 INFO:teuthology.orchestra.run.trial022.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T07:11:44.868 INFO:teuthology.orchestra.run.trial022.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T07:11:44.877 INFO:teuthology.orchestra.run.trial022.stderr:done 2026-02-24T07:11:44.879 DEBUG:teuthology.orchestra.run.trial022:> test -d /sys/firmware/efi 2026-02-24T07:11:44.895 DEBUG:teuthology.orchestra.run.trial022:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T07:11:44.961 INFO:teuthology.orchestra.run.trial022.stdout:/boot/efi/EFI/BOOT 2026-02-24T07:11:44.962 INFO:teuthology.orchestra.run.trial022.stdout:/boot/efi/EFI/centos 2026-02-24T07:11:44.963 DEBUG:teuthology.orchestra.run.trial022:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T07:11:45.029 INFO:teuthology.orchestra.run.trial022.stdout:no 2026-02-24T07:11:45.030 DEBUG:teuthology.orchestra.run.trial022:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T07:11:45.094 INFO:teuthology.orchestra.run.trial022.stdout:yes 2026-02-24T07:11:45.095 DEBUG:teuthology.orchestra.run.trial022:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T07:11:45.161 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial022 2026-02-24T07:11:45.161 DEBUG:teuthology.orchestra.run.trial022:> sudo bash -c ' 2026-02-24T07:11:45.161 DEBUG:teuthology.orchestra.run.trial022:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T07:11:45.161 DEBUG:teuthology.orchestra.run.trial022:> ' 2026-02-24T07:12:11.705 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2026-02-24T07:12:11.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-24T07:12:11.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:12:15.204 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-24T07:12:15.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial022.front.sepia.ceph.com' 2026-02-24T07:12:15.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:12:25.984 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.195 2026-02-24T07:12:29.504 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.22 2026-02-24T07:12:34.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-24T07:12:34.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:12:38.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial022.front.sepia.ceph.com' 2026-02-24T07:12:38.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:13:11.179 DEBUG:teuthology.orchestra.run.trial195:> true 2026-02-24T07:13:11.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-24T07:13:11.350 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-686.el9.x86_64"... 2026-02-24T07:13:11.350 DEBUG:teuthology.orchestra.run.trial195:> uname -r 2026-02-24T07:13:11.406 INFO:teuthology.orchestra.run.trial195.stdout:5.14.0-686.el9.x86_64 2026-02-24T07:13:11.406 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T07:13:11.406 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T07:13:11.406 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T07:13:12.408 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2026-02-24T07:13:12.408 DEBUG:teuthology.orchestra.run.trial195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T07:13:12.439 INFO:teuthology.orchestra.run.trial195.stdout:ttyS1 2026-02-24T07:13:12.462 DEBUG:teuthology.parallel:result is None 2026-02-24T07:13:14.757 DEBUG:teuthology.orchestra.run.trial022:> true 2026-02-24T07:13:14.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial022.front.sepia.ceph.com' 2026-02-24T07:13:14.916 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-24T07:13:14.916 DEBUG:teuthology.orchestra.run.trial022:> uname -r 2026-02-24T07:13:14.972 INFO:teuthology.orchestra.run.trial022.stdout:5.14.0-686.el9.x86_64 2026-02-24T07:13:14.972 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T07:13:14.973 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T07:13:14.973 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T07:13:15.974 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-24T07:13:15.974 DEBUG:teuthology.orchestra.run.trial022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T07:13:16.005 INFO:teuthology.orchestra.run.trial022.stdout:ttyS1 2026-02-24T07:13:16.035 DEBUG:teuthology.parallel:result is None 2026-02-24T07:13:16.035 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T07:13:16.048 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T07:13:16.048 DEBUG:teuthology.orchestra.run.trial022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T07:13:16.077 DEBUG:teuthology.orchestra.run.trial195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T07:13:16.095 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T07:13:16.106 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T07:13:16.120 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T07:13:16.120 DEBUG:teuthology.orchestra.run.trial022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T07:13:16.133 DEBUG:teuthology.orchestra.run.trial195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T07:13:16.158 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T07:13:16.182 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T07:13:16.182 DEBUG:teuthology.orchestra.run.trial022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T07:13:16.190 DEBUG:teuthology.orchestra.run.trial195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T07:13:16.212 INFO:teuthology.orchestra.run.trial022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T07:13:16.216 INFO:teuthology.orchestra.run.trial195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T07:13:16.221 INFO:teuthology.orchestra.run.trial022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T07:13:16.225 INFO:teuthology.orchestra.run.trial195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T07:13:16.227 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T07:13:16.238 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T07:13:16.238 DEBUG:teuthology.orchestra.run.trial022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T07:13:16.266 DEBUG:teuthology.orchestra.run.trial195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T07:13:16.291 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T07:13:16.307 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T07:13:16.308 DEBUG:teuthology.orchestra.run.trial022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T07:13:16.331 DEBUG:teuthology.orchestra.run.trial195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T07:13:16.347 DEBUG:teuthology.orchestra.run.trial022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T07:13:16.507 DEBUG:teuthology.orchestra.run.trial022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T07:13:16.532 DEBUG:teuthology.orchestra.run.trial022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T07:13:16.668 DEBUG:teuthology.orchestra.run.trial022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T07:13:16.693 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:13:16.693 DEBUG:teuthology.orchestra.run.trial022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T07:13:16.757 DEBUG:teuthology.orchestra.run.trial195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T07:13:16.873 DEBUG:teuthology.orchestra.run.trial195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T07:13:16.898 DEBUG:teuthology.orchestra.run.trial195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T07:13:17.031 DEBUG:teuthology.orchestra.run.trial195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T07:13:17.054 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:13:17.054 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T07:13:17.118 DEBUG:teuthology.orchestra.run.trial022:> sudo service rsyslog restart 2026-02-24T07:13:17.120 DEBUG:teuthology.orchestra.run.trial195:> sudo service rsyslog restart 2026-02-24T07:13:17.147 INFO:teuthology.orchestra.run.trial022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T07:13:17.185 INFO:teuthology.orchestra.run.trial195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T07:13:17.665 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T07:13:17.677 INFO:teuthology.task.internal:Starting timer... 2026-02-24T07:13:17.678 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T07:13:17.702 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T07:13:17.720 DEBUG:teuthology.orchestra.run.trial022:> sudo service auditd rotate 2026-02-24T07:13:17.750 INFO:teuthology.orchestra.run.trial022.stdout:Rotating logs: 2026-02-24T07:13:17.753 DEBUG:teuthology.orchestra.run.trial195:> sudo service auditd rotate 2026-02-24T07:13:17.782 INFO:teuthology.orchestra.run.trial195.stdout:Rotating logs: 2026-02-24T07:13:17.784 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T07:13:17.784 DEBUG:teuthology.orchestra.run.trial022:> /usr/sbin/getenforce 2026-02-24T07:13:17.810 INFO:teuthology.orchestra.run.trial022.stdout:Permissive 2026-02-24T07:13:17.810 DEBUG:teuthology.orchestra.run.trial195:> /usr/sbin/getenforce 2026-02-24T07:13:17.840 INFO:teuthology.orchestra.run.trial195.stdout:Permissive 2026-02-24T07:13:17.841 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial022.front.sepia.ceph.com': 'permissive', 'ubuntu@trial195.front.sepia.ceph.com': 'permissive'} 2026-02-24T07:13:17.841 DEBUG:teuthology.orchestra.run.trial022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T07:13:17.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:13:17.876 DEBUG:teuthology.orchestra.run.trial195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T07:13:17.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:13:17.905 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T07:13:17.905 DEBUG:teuthology.orchestra.run.trial022:> sudo /usr/sbin/setenforce permissive 2026-02-24T07:13:17.939 DEBUG:teuthology.orchestra.run.trial195:> sudo /usr/sbin/setenforce permissive 2026-02-24T07:13:17.969 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T07:13:17.985 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T07:13:17.998 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T07:13:18.001 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial022.front.sepia.ceph.com,trial195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T07:16:30.538 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial022.front.sepia.ceph.com'), Remote(name='ubuntu@trial195.front.sepia.ceph.com')] 2026-02-24T07:16:30.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial022.front.sepia.ceph.com' 2026-02-24T07:16:30.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:16:30.651 DEBUG:teuthology.orchestra.run.trial022:> true 2026-02-24T07:16:30.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial022.front.sepia.ceph.com' 2026-02-24T07:16:30.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-24T07:16:30.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T07:16:30.803 DEBUG:teuthology.orchestra.run.trial195:> true 2026-02-24T07:16:30.879 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial195.front.sepia.ceph.com' 2026-02-24T07:16:30.879 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T07:16:30.892 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T07:16:30.893 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T07:16:30.893 DEBUG:teuthology.orchestra.run.trial022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T07:16:30.895 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T07:16:30.895 DEBUG:teuthology.orchestra.run.trial195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T07:16:30.921 INFO:teuthology.orchestra.run.trial022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T07:16:30.933 INFO:teuthology.orchestra.run.trial022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T07:16:30.945 INFO:teuthology.orchestra.run.trial195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T07:16:30.953 INFO:teuthology.orchestra.run.trial022.stderr:sudo: ntpd: command not found 2026-02-24T07:16:30.958 INFO:teuthology.orchestra.run.trial195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T07:16:30.962 INFO:teuthology.orchestra.run.trial022.stdout:506 Cannot talk to daemon 2026-02-24T07:16:30.973 INFO:teuthology.orchestra.run.trial022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T07:16:30.979 INFO:teuthology.orchestra.run.trial195.stderr:sudo: ntpd: command not found 2026-02-24T07:16:30.985 INFO:teuthology.orchestra.run.trial022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T07:16:30.989 INFO:teuthology.orchestra.run.trial195.stdout:506 Cannot talk to daemon 2026-02-24T07:16:31.000 INFO:teuthology.orchestra.run.trial195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T07:16:31.012 INFO:teuthology.orchestra.run.trial195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T07:16:31.031 INFO:teuthology.orchestra.run.trial022.stderr:bash: line 1: ntpq: command not found 2026-02-24T07:16:31.053 INFO:teuthology.orchestra.run.trial022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T07:16:31.054 INFO:teuthology.orchestra.run.trial022.stdout:=============================================================================== 2026-02-24T07:16:31.054 INFO:teuthology.orchestra.run.trial022.stdout:^? 38.45.64.130 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:16:31.054 INFO:teuthology.orchestra.run.trial022.stdout:^? sensei.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:16:31.054 INFO:teuthology.orchestra.run.trial022.stdout:^? us-central-1.clearnet.pw 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:16:31.054 INFO:teuthology.orchestra.run.trial022.stdout:^? pool-138-89-14-60.mad.ea> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:16:31.059 INFO:teuthology.orchestra.run.trial195.stderr:bash: line 1: ntpq: command not found 2026-02-24T07:16:31.081 INFO:teuthology.orchestra.run.trial195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T07:16:31.081 INFO:teuthology.orchestra.run.trial195.stdout:=============================================================================== 2026-02-24T07:16:31.081 INFO:teuthology.orchestra.run.trial195.stdout:^? 172-234-44-141.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:16:31.081 INFO:teuthology.orchestra.run.trial195.stdout:^? 99-28-14-242.lightspeed.> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:16:31.081 INFO:teuthology.orchestra.run.trial195.stdout:^? time-dfw.far.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:16:31.081 INFO:teuthology.orchestra.run.trial195.stdout:^? 136-60-131-14.googlefibe> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T07:16:31.082 INFO:teuthology.run_tasks:Running task install... 2026-02-24T07:16:31.096 DEBUG:teuthology.task.install:project ceph 2026-02-24T07:16:31.096 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'}} 2026-02-24T07:16:31.096 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'} 2026-02-24T07:16:31.096 INFO:teuthology.task.install:Using flavor: debug 2026-02-24T07:16:31.105 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-24T07:16:31.105 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-24T07:16:31.106 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017', 'tag': None, 'wait_for_package': False} 2026-02-24T07:16:31.107 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:16:31.110 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017', 'tag': None, 'wait_for_package': False} 2026-02-24T07:16:31.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:16:31.340 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/ 2026-02-24T07:16:31.340 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5440.gff63f3d9 2026-02-24T07:16:31.350 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/ 2026-02-24T07:16:31.350 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5440.gff63f3d9 2026-02-24T07:16:31.635 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T07:16:31.635 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:16:31.635 DEBUG:teuthology.orchestra.run.trial022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T07:16:31.662 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T07:16:31.663 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:16:31.663 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T07:16:31.664 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-24T07:16:31.665 DEBUG:teuthology.orchestra.run.trial022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ff63f3d997e38f69382fd23ac0206f07f7b05017/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T07:16:31.693 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-24T07:16:31.693 DEBUG:teuthology.orchestra.run.trial195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ff63f3d997e38f69382fd23ac0206f07f7b05017/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T07:16:31.730 DEBUG:teuthology.orchestra.run.trial022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T07:16:31.758 DEBUG:teuthology.orchestra.run.trial195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T07:16:31.803 DEBUG:teuthology.orchestra.run.trial022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T07:16:31.831 DEBUG:teuthology.orchestra.run.trial195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T07:16:31.866 INFO:teuthology.orchestra.run.trial022.stdout:check_obsoletes = 1 2026-02-24T07:16:31.868 DEBUG:teuthology.orchestra.run.trial022:> sudo yum clean all 2026-02-24T07:16:31.894 INFO:teuthology.orchestra.run.trial195.stdout:check_obsoletes = 1 2026-02-24T07:16:31.896 DEBUG:teuthology.orchestra.run.trial195:> sudo yum clean all 2026-02-24T07:16:32.016 INFO:teuthology.orchestra.run.trial022.stdout:41 files removed 2026-02-24T07:16:32.030 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-radosgw 2026-02-24T07:16:32.045 INFO:teuthology.orchestra.run.trial195.stdout:41 files removed 2026-02-24T07:16:32.060 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-radosgw 2026-02-24T07:16:32.330 INFO:teuthology.orchestra.run.trial022.stdout:ceph packages for x86_64 621 kB/s | 94 kB 00:00 2026-02-24T07:16:32.338 INFO:teuthology.orchestra.run.trial195.stdout:ceph packages for x86_64 728 kB/s | 94 kB 00:00 2026-02-24T07:16:32.473 INFO:teuthology.orchestra.run.trial022.stdout:ceph noarch packages 215 kB/s | 25 kB 00:00 2026-02-24T07:16:32.481 INFO:teuthology.orchestra.run.trial195.stdout:ceph noarch packages 215 kB/s | 25 kB 00:00 2026-02-24T07:16:32.603 INFO:teuthology.orchestra.run.trial022.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-24T07:16:32.611 INFO:teuthology.orchestra.run.trial195.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-24T07:16:33.293 INFO:teuthology.orchestra.run.trial022.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-24T07:16:33.813 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.9 MB 00:01 2026-02-24T07:16:36.363 INFO:teuthology.orchestra.run.trial022.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-24T07:16:36.579 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-24T07:16:47.955 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - CRB 904 kB/s | 8.0 MB 00:09 2026-02-24T07:16:48.732 INFO:teuthology.orchestra.run.trial022.stdout:CentOS Stream 9 - CRB 823 kB/s | 8.0 MB 00:09 2026-02-24T07:16:48.903 INFO:teuthology.orchestra.run.trial195.stdout:CentOS Stream 9 - Extras packages 97 kB/s | 20 kB 00:00 2026-02-24T07:16:49.613 INFO:teuthology.orchestra.run.trial022.stdout:CentOS Stream 9 - Extras packages 177 kB/s | 20 kB 00:00 2026-02-24T07:16:55.833 INFO:teuthology.orchestra.run.trial195.stdout:Extra Packages for Enterprise Linux 3.0 MB/s | 20 MB 00:06 2026-02-24T07:16:59.000 INFO:teuthology.orchestra.run.trial195.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-24T07:16:59.624 INFO:teuthology.orchestra.run.trial022.stdout:Extra Packages for Enterprise Linux 2.0 MB/s | 20 MB 00:09 2026-02-24T07:17:00.220 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:17:00.222 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:17:00.222 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T07:17:00.222 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:17:00.222 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:17:00.222 INFO:teuthology.orchestra.run.trial195.stdout: ceph-radosgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 11 M 2026-02-24T07:17:00.222 INFO:teuthology.orchestra.run.trial195.stdout:Upgrading: 2026-02-24T07:17:00.223 INFO:teuthology.orchestra.run.trial195.stdout: librados2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 3.3 M 2026-02-24T07:17:00.223 INFO:teuthology.orchestra.run.trial195.stdout: librbd1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.7 M 2026-02-24T07:17:00.223 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T07:17:00.223 INFO:teuthology.orchestra.run.trial195.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T07:17:00.223 INFO:teuthology.orchestra.run.trial195.stdout: ceph-base x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.1 M 2026-02-24T07:17:00.223 INFO:teuthology.orchestra.run.trial195.stdout: ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 21 M 2026-02-24T07:17:00.223 INFO:teuthology.orchestra.run.trial195.stdout: ceph-selinux x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 25 k 2026-02-24T07:17:00.223 INFO:teuthology.orchestra.run.trial195.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T07:17:00.223 INFO:teuthology.orchestra.run.trial195.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T07:17:00.223 INFO:teuthology.orchestra.run.trial195.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 859 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: libradosstriper1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 263 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: librgw2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.6 M 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T07:17:00.224 INFO:teuthology.orchestra.run.trial195.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T07:17:00.225 INFO:teuthology.orchestra.run.trial195.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T07:17:00.225 INFO:teuthology.orchestra.run.trial195.stdout: python3-ceph-argparse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 45 k 2026-02-24T07:17:00.225 INFO:teuthology.orchestra.run.trial195.stdout: python3-ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 186 k 2026-02-24T07:17:00.225 INFO:teuthology.orchestra.run.trial195.stdout: python3-cephfs x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 204 k 2026-02-24T07:17:00.225 INFO:teuthology.orchestra.run.trial195.stdout: python3-rados x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 324 k 2026-02-24T07:17:00.225 INFO:teuthology.orchestra.run.trial195.stdout: python3-rbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 306 k 2026-02-24T07:17:00.225 INFO:teuthology.orchestra.run.trial195.stdout: python3-rgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 100 k 2026-02-24T07:17:00.225 INFO:teuthology.orchestra.run.trial195.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T07:17:00.225 INFO:teuthology.orchestra.run.trial195.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T07:17:00.225 INFO:teuthology.orchestra.run.trial195.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout:Installing weak dependencies: 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs-daemon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 39 k 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 26 k 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout:Install 35 Packages 2026-02-24T07:17:00.226 INFO:teuthology.orchestra.run.trial195.stdout:Upgrade 2 Packages 2026-02-24T07:17:00.227 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:00.227 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 61 M 2026-02-24T07:17:00.228 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:17:01.155 INFO:teuthology.orchestra.run.trial195.stdout:(1/37): ceph-base-20.3.0-5440.gff63f3d9.el9.x86 18 MB/s | 5.1 MB 00:00 2026-02-24T07:17:01.185 INFO:teuthology.orchestra.run.trial195.stdout:(2/37): ceph-selinux-20.3.0-5440.gff63f3d9.el9. 837 kB/s | 25 kB 00:00 2026-02-24T07:17:01.221 INFO:teuthology.orchestra.run.trial195.stdout:(3/37): libcephfs-daemon-20.3.0-5440.gff63f3d9. 1.1 MB/s | 39 kB 00:00 2026-02-24T07:17:01.257 INFO:teuthology.orchestra.run.trial195.stdout:(4/37): libcephfs-proxy2-20.3.0-5440.gff63f3d9. 722 kB/s | 26 kB 00:00 2026-02-24T07:17:01.311 INFO:teuthology.orchestra.run.trial195.stdout:(5/37): libcephfs2-20.3.0-5440.gff63f3d9.el9.x8 16 MB/s | 859 kB 00:00 2026-02-24T07:17:01.356 INFO:teuthology.orchestra.run.trial195.stdout:(6/37): libradosstriper1-20.3.0-5440.gff63f3d9. 5.8 MB/s | 263 kB 00:00 2026-02-24T07:17:01.537 INFO:teuthology.orchestra.run.trial195.stdout:(7/37): ceph-radosgw-20.3.0-5440.gff63f3d9.el9. 17 MB/s | 11 MB 00:00 2026-02-24T07:17:01.583 INFO:teuthology.orchestra.run.trial195.stdout:(8/37): python3-ceph-argparse-20.3.0-5440.gff63 989 kB/s | 45 kB 00:00 2026-02-24T07:17:01.617 INFO:teuthology.orchestra.run.trial195.stdout:(9/37): librgw2-20.3.0-5440.gff63f3d9.el9.x86_6 22 MB/s | 5.6 MB 00:00 2026-02-24T07:17:01.633 INFO:teuthology.orchestra.run.trial195.stdout:(10/37): python3-ceph-common-20.3.0-5440.gff63f 3.6 MB/s | 186 kB 00:00 2026-02-24T07:17:01.652 INFO:teuthology.orchestra.run.trial195.stdout:(11/37): python3-cephfs-20.3.0-5440.gff63f3d9.e 5.7 MB/s | 204 kB 00:00 2026-02-24T07:17:01.672 INFO:teuthology.orchestra.run.trial195.stdout:(12/37): python3-rados-20.3.0-5440.gff63f3d9.el 8.2 MB/s | 324 kB 00:00 2026-02-24T07:17:01.694 INFO:teuthology.orchestra.run.trial195.stdout:(13/37): python3-rbd-20.3.0-5440.gff63f3d9.el9. 7.2 MB/s | 306 kB 00:00 2026-02-24T07:17:01.709 INFO:teuthology.orchestra.run.trial195.stdout:(14/37): python3-rgw-20.3.0-5440.gff63f3d9.el9. 2.6 MB/s | 100 kB 00:00 2026-02-24T07:17:01.746 INFO:teuthology.orchestra.run.trial195.stdout:(15/37): ceph-common-20.3.0-5440.gff63f3d9.el9. 24 MB/s | 21 MB 00:00 2026-02-24T07:17:01.962 INFO:teuthology.orchestra.run.trial195.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 124 kB/s | 33 kB 00:00 2026-02-24T07:17:02.029 INFO:teuthology.orchestra.run.trial195.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 1.5 MB/s | 104 kB 00:00 2026-02-24T07:17:02.076 INFO:teuthology.orchestra.run.trial195.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.6 MB/s | 164 kB 00:00 2026-02-24T07:17:02.098 INFO:teuthology.orchestra.run.trial195.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.4 MB/s | 160 kB 00:00 2026-02-24T07:17:02.120 INFO:teuthology.orchestra.run.trial195.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-24T07:17:02.144 INFO:teuthology.orchestra.run.trial195.stdout:(21/37): pciutils-3.7.0-7.el9.x86_64.rpm 235 kB/s | 93 kB 00:00 2026-02-24T07:17:02.165 INFO:teuthology.orchestra.run.trial195.stdout:(22/37): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-24T07:17:02.189 INFO:teuthology.orchestra.run.trial195.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 9.9 MB/s | 240 kB 00:00 2026-02-24T07:17:02.211 INFO:teuthology.orchestra.run.trial195.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-24T07:17:02.229 INFO:teuthology.orchestra.run.trial195.stdout:(25/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2026-02-24T07:17:02.233 INFO:teuthology.orchestra.run.trial195.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-24T07:17:02.384 INFO:teuthology.orchestra.run.trial195.stdout:(27/37): nvme-cli-2.16-1.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2026-02-24T07:17:02.846 INFO:teuthology.orchestra.run.trial022.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-24T07:17:03.240 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] libarrow-9.0.0-15.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-15.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:03.653 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] libarrow-doc-9.0.0-15.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-doc-9.0.0-15.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:17:04.036 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] libarrow-9.0.0-15.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-15.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:04.056 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:17:04.057 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout: Package Arch Version Repository Size 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout: ceph-radosgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 11 M 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout:Upgrading: 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout: librados2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 3.3 M 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout: librbd1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.7 M 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout:Installing dependencies: 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout: ceph-base x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.1 M 2026-02-24T07:17:04.058 INFO:teuthology.orchestra.run.trial022.stdout: ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 21 M 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: ceph-selinux x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 25 k 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: libcephfs2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 859 k 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: libradosstriper1 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 263 k 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: librgw2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 5.6 M 2026-02-24T07:17:04.059 INFO:teuthology.orchestra.run.trial022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: python3-ceph-argparse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 45 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: python3-ceph-common x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 186 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: python3-cephfs x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 204 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: python3-rados x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 324 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: python3-rbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 306 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: python3-rgw x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 100 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T07:17:04.060 INFO:teuthology.orchestra.run.trial022.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout:Installing weak dependencies: 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout: libcephfs-daemon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 39 k 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 26 k 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout:Install 35 Packages 2026-02-24T07:17:04.061 INFO:teuthology.orchestra.run.trial022.stdout:Upgrade 2 Packages 2026-02-24T07:17:04.062 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:04.062 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 61 M 2026-02-24T07:17:04.062 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:17:04.277 INFO:teuthology.orchestra.run.trial195.stdout:(28/37): libarrow-9.0.0-15.el9.x86_64.rpm 2.2 MB/s | 4.4 MB 00:02 2026-02-24T07:17:04.293 INFO:teuthology.orchestra.run.trial195.stdout:(29/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 13 kB/s | 25 kB 00:01 2026-02-24T07:17:04.419 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] liboath-2.6.12-1.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/liboath-2.6.12-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:04.448 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] libunwind-1.6.2-1.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libunwind-1.6.2-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:04.471 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] gperftools-libs-2.9.1-3.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-3.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:04.574 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] liboath-2.6.12-1.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/liboath-2.6.12-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:04.608 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] libunwind-1.6.2-1.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libunwind-1.6.2-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:04.655 INFO:teuthology.orchestra.run.trial195.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 129 kB/s | 49 kB 00:00 2026-02-24T07:17:04.686 INFO:teuthology.orchestra.run.trial195.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 172 kB/s | 67 kB 00:00 2026-02-24T07:17:04.757 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] gperftools-libs-2.9.1-3.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-3.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:04.758 INFO:teuthology.orchestra.run.trial195.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 2.6 MB/s | 191 kB 00:00 2026-02-24T07:17:04.767 INFO:teuthology.orchestra.run.trial195.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.3 MB/s | 838 kB 00:00 2026-02-24T07:17:04.837 INFO:teuthology.orchestra.run.trial195.stdout:(34/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 118 kB/s | 308 kB 00:02 2026-02-24T07:17:04.899 INFO:teuthology.orchestra.run.trial195.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2026-02-24T07:17:05.187 INFO:teuthology.orchestra.run.trial022.stdout:(1/37): ceph-base-20.3.0-5440.gff63f3d9.el9.x86 7.2 MB/s | 5.1 MB 00:00 2026-02-24T07:17:05.227 INFO:teuthology.orchestra.run.trial022.stdout:(2/37): ceph-selinux-20.3.0-5440.gff63f3d9.el9. 643 kB/s | 25 kB 00:00 2026-02-24T07:17:05.267 INFO:teuthology.orchestra.run.trial022.stdout:(3/37): libcephfs-daemon-20.3.0-5440.gff63f3d9. 962 kB/s | 39 kB 00:00 2026-02-24T07:17:05.308 INFO:teuthology.orchestra.run.trial022.stdout:(4/37): libcephfs-proxy2-20.3.0-5440.gff63f3d9. 638 kB/s | 26 kB 00:00 2026-02-24T07:17:05.409 INFO:teuthology.orchestra.run.trial022.stdout:(5/37): libcephfs2-20.3.0-5440.gff63f3d9.el9.x8 8.3 MB/s | 859 kB 00:00 2026-02-24T07:17:05.460 INFO:teuthology.orchestra.run.trial022.stdout:(6/37): libradosstriper1-20.3.0-5440.gff63f3d9. 5.1 MB/s | 263 kB 00:00 2026-02-24T07:17:05.621 INFO:teuthology.orchestra.run.trial022.stdout:(7/37): ceph-radosgw-20.3.0-5440.gff63f3d9.el9. 9.8 MB/s | 11 MB 00:01 2026-02-24T07:17:05.672 INFO:teuthology.orchestra.run.trial022.stdout:(8/37): python3-ceph-argparse-20.3.0-5440.gff63 886 kB/s | 45 kB 00:00 2026-02-24T07:17:05.725 INFO:teuthology.orchestra.run.trial022.stdout:(9/37): python3-ceph-common-20.3.0-5440.gff63f3 3.4 MB/s | 186 kB 00:00 2026-02-24T07:17:05.762 INFO:teuthology.orchestra.run.trial195.stdout:(36/37): librados2-20.3.0-5440.gff63f3d9.el9.x8 3.3 MB/s | 3.3 MB 00:00 2026-02-24T07:17:05.778 INFO:teuthology.orchestra.run.trial022.stdout:(10/37): python3-cephfs-20.3.0-5440.gff63f3d9.e 3.8 MB/s | 204 kB 00:00 2026-02-24T07:17:05.832 INFO:teuthology.orchestra.run.trial022.stdout:(11/37): python3-rados-20.3.0-5440.gff63f3d9.el 5.9 MB/s | 324 kB 00:00 2026-02-24T07:17:05.887 INFO:teuthology.orchestra.run.trial022.stdout:(12/37): python3-rbd-20.3.0-5440.gff63f3d9.el9. 5.5 MB/s | 306 kB 00:00 2026-02-24T07:17:05.943 INFO:teuthology.orchestra.run.trial022.stdout:(13/37): librgw2-20.3.0-5440.gff63f3d9.el9.x86_ 12 MB/s | 5.6 MB 00:00 2026-02-24T07:17:05.944 INFO:teuthology.orchestra.run.trial022.stdout:(14/37): python3-rgw-20.3.0-5440.gff63f3d9.el9. 1.7 MB/s | 100 kB 00:00 2026-02-24T07:17:06.026 INFO:teuthology.orchestra.run.trial022.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 402 kB/s | 33 kB 00:00 2026-02-24T07:17:06.097 INFO:teuthology.orchestra.run.trial022.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 1.3 MB/s | 93 kB 00:00 2026-02-24T07:17:06.148 INFO:teuthology.orchestra.run.trial022.stdout:(17/37): ceph-common-20.3.0-5440.gff63f3d9.el9. 12 MB/s | 21 MB 00:01 2026-02-24T07:17:06.149 INFO:teuthology.orchestra.run.trial022.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 2.0 MB/s | 104 kB 00:00 2026-02-24T07:17:06.153 INFO:teuthology.orchestra.run.trial022.stdout:(19/37): nvme-cli-2.16-1.el9.x86_64.rpm 5.5 MB/s | 1.2 MB 00:00 2026-02-24T07:17:06.179 INFO:teuthology.orchestra.run.trial022.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-24T07:17:06.195 INFO:teuthology.orchestra.run.trial022.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.4 MB/s | 160 kB 00:00 2026-02-24T07:17:06.197 INFO:teuthology.orchestra.run.trial195.stdout:(37/37): librbd1-20.3.0-5440.gff63f3d9.el9.x86_ 2.0 MB/s | 2.7 MB 00:01 2026-02-24T07:17:06.201 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:17:06.202 INFO:teuthology.orchestra.run.trial195.stdout:Total 10 MB/s | 61 MB 00:05 2026-02-24T07:17:06.213 INFO:teuthology.orchestra.run.trial022.stdout:(22/37): librdkafka-1.6.1-102.el9.x86_64.rpm 19 MB/s | 662 kB 00:00 2026-02-24T07:17:06.240 INFO:teuthology.orchestra.run.trial022.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 8.6 MB/s | 240 kB 00:00 2026-02-24T07:17:06.248 INFO:teuthology.orchestra.run.trial022.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.4 MB/s | 292 kB 00:00 2026-02-24T07:17:06.266 INFO:teuthology.orchestra.run.trial022.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-24T07:17:06.274 INFO:teuthology.orchestra.run.trial022.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-24T07:17:06.289 INFO:teuthology.orchestra.run.trial022.stdout:(27/37): libnbd-1.20.3-4.el9.x86_64.rpm 1.1 MB/s | 164 kB 00:00 2026-02-24T07:17:06.300 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:17:06.320 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:17:06.320 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:17:06.568 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:17:06.569 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:17:06.743 INFO:teuthology.orchestra.run.trial022.stdout:[MIRROR] libarrow-9.0.0-15.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-15.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:06.861 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:17:07.000 INFO:teuthology.orchestra.run.trial195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-24T07:17:07.005 INFO:teuthology.orchestra.run.trial195.stdout: Upgrading : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:17:07.052 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:17:07.053 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:17:07.064 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:17:07.066 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 4/39 2026-02-24T07:17:07.067 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:17:07.094 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:17:07.097 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 6/39 2026-02-24T07:17:07.104 INFO:teuthology.orchestra.run.trial195.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-24T07:17:07.107 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-24T07:17:07.110 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-24T07:17:07.114 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-24T07:17:07.125 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 11/39 2026-02-24T07:17:07.138 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T07:17:07.138 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T07:17:07.160 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T07:17:07.164 INFO:teuthology.orchestra.run.trial195.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-24T07:17:07.195 INFO:teuthology.orchestra.run.trial195.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-24T07:17:07.198 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-24T07:17:07.206 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-24T07:17:07.208 INFO:teuthology.orchestra.run.trial195.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-24T07:17:07.213 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-24T07:17:07.306 INFO:teuthology.orchestra.run.trial022.stdout:[MIRROR] libarrow-doc-9.0.0-15.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-doc-9.0.0-15.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:17:07.327 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T07:17:07.328 INFO:teuthology.orchestra.run.trial195.stdout: Upgrading : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T07:17:07.355 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T07:17:07.357 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 22/39 2026-02-24T07:17:07.364 INFO:teuthology.orchestra.run.trial195.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-24T07:17:07.479 INFO:teuthology.orchestra.run.trial022.stdout:[MIRROR] libarrow-9.0.0-15.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-15.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:07.592 INFO:teuthology.orchestra.run.trial022.stdout:[MIRROR] libarrow-doc-9.0.0-15.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-doc-9.0.0-15.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:17:07.612 INFO:teuthology.orchestra.run.trial195.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-24T07:17:07.613 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T07:17:07.629 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T07:17:07.633 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 26/39 2026-02-24T07:17:07.637 INFO:teuthology.orchestra.run.trial195.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-24T07:17:07.639 INFO:teuthology.orchestra.run.trial195.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-24T07:17:07.640 INFO:teuthology.orchestra.run.trial195.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T07:17:07.658 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T07:17:07.731 INFO:teuthology.orchestra.run.trial022.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 17 kB/s | 25 kB 00:01 2026-02-24T07:17:07.773 INFO:teuthology.orchestra.run.trial195.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-24T07:17:07.776 INFO:teuthology.orchestra.run.trial195.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T07:17:07.887 INFO:teuthology.orchestra.run.trial022.stdout:[MIRROR] liboath-2.6.12-1.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/liboath-2.6.12-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:07.947 INFO:teuthology.orchestra.run.trial022.stdout:[MIRROR] gperftools-libs-2.9.1-3.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-3.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:08.055 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T07:17:08.056 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T07:17:08.056 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:08.090 INFO:teuthology.orchestra.run.trial022.stdout:[MIRROR] gperftools-libs-2.9.1-3.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-3.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:08.099 INFO:teuthology.orchestra.run.trial195.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-24T07:17:08.101 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 33/39 2026-02-24T07:17:08.347 INFO:teuthology.orchestra.run.trial022.stdout:(29/37): libarrow-9.0.0-15.el9.x86_64.rpm 2.1 MB/s | 4.4 MB 00:02 2026-02-24T07:17:08.361 INFO:teuthology.orchestra.run.trial022.stdout:(30/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 147 kB/s | 308 kB 00:02 2026-02-24T07:17:08.481 INFO:teuthology.orchestra.run.trial022.stdout:[MIRROR] liboath-2.6.12-1.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/liboath-2.6.12-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:08.491 INFO:teuthology.orchestra.run.trial022.stdout:[MIRROR] libunwind-1.6.2-1.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/libunwind-1.6.2-1.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:08.653 INFO:teuthology.orchestra.run.trial022.stdout:[MIRROR] parquet-libs-9.0.0-15.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/parquet-libs-9.0.0-15.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:08.666 INFO:teuthology.orchestra.run.trial022.stdout:(31/37): liboath-2.6.12-1.el9.x86_64.rpm 52 kB/s | 49 kB 00:00 2026-02-24T07:17:08.674 INFO:teuthology.orchestra.run.trial022.stdout:(32/37): libunwind-1.6.2-1.el9.x86_64.rpm 206 kB/s | 67 kB 00:00 2026-02-24T07:17:09.013 INFO:teuthology.orchestra.run.trial022.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 1.3 MB/s | 838 kB 00:00 2026-02-24T07:17:09.025 INFO:teuthology.orchestra.run.trial022.stdout:(34/37): re2-20211101-20.el9.x86_64.rpm 533 kB/s | 191 kB 00:00 2026-02-24T07:17:09.040 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:17:09.042 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:17:09.308 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:17:09.311 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T07:17:09.352 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T07:17:09.352 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T07:17:09.352 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T07:17:09.352 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:09.356 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:17:09.386 INFO:teuthology.orchestra.run.trial022.stdout:(35/37): librados2-20.3.0-5440.gff63f3d9.el9.x8 8.8 MB/s | 3.3 MB 00:00 2026-02-24T07:17:09.985 INFO:teuthology.orchestra.run.trial022.stdout:(36/37): thrift-0.15.0-4.el9.x86_64.rpm 1.2 MB/s | 1.6 MB 00:01 2026-02-24T07:17:10.587 INFO:teuthology.orchestra.run.trial022.stdout:(37/37): librbd1-20.3.0-5440.gff63f3d9.el9.x86_ 1.7 MB/s | 2.7 MB 00:01 2026-02-24T07:17:10.589 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:17:10.590 INFO:teuthology.orchestra.run.trial022.stdout:Total 9.4 MB/s | 61 MB 00:06 2026-02-24T07:17:10.688 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:17:10.707 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:17:10.707 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:17:10.957 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:17:10.957 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:17:11.247 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:17:11.387 INFO:teuthology.orchestra.run.trial022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-24T07:17:11.390 INFO:teuthology.orchestra.run.trial022.stdout: Upgrading : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:17:11.439 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:17:11.440 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:17:11.453 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:17:11.455 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 4/39 2026-02-24T07:17:11.456 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:17:11.483 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:17:11.486 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 6/39 2026-02-24T07:17:11.494 INFO:teuthology.orchestra.run.trial022.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-24T07:17:11.498 INFO:teuthology.orchestra.run.trial022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-24T07:17:11.501 INFO:teuthology.orchestra.run.trial022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-24T07:17:11.506 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-24T07:17:11.517 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 11/39 2026-02-24T07:17:11.531 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T07:17:11.532 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T07:17:11.555 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 13/39 2026-02-24T07:17:11.559 INFO:teuthology.orchestra.run.trial022.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-24T07:17:11.592 INFO:teuthology.orchestra.run.trial022.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-24T07:17:11.595 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-24T07:17:11.602 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-24T07:17:11.604 INFO:teuthology.orchestra.run.trial022.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-24T07:17:11.608 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-24T07:17:11.722 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T07:17:11.723 INFO:teuthology.orchestra.run.trial022.stdout: Upgrading : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T07:17:11.749 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 21/39 2026-02-24T07:17:11.751 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 22/39 2026-02-24T07:17:11.757 INFO:teuthology.orchestra.run.trial022.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-24T07:17:12.004 INFO:teuthology.orchestra.run.trial022.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-24T07:17:12.005 INFO:teuthology.orchestra.run.trial022.stdout: Installing : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T07:17:12.021 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 25/39 2026-02-24T07:17:12.025 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 26/39 2026-02-24T07:17:12.031 INFO:teuthology.orchestra.run.trial022.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-24T07:17:12.033 INFO:teuthology.orchestra.run.trial022.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-24T07:17:12.034 INFO:teuthology.orchestra.run.trial022.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T07:17:12.052 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-24T07:17:12.169 INFO:teuthology.orchestra.run.trial022.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-24T07:17:12.171 INFO:teuthology.orchestra.run.trial022.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T07:17:12.469 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-24T07:17:12.469 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-24T07:17:12.470 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:12.514 INFO:teuthology.orchestra.run.trial022.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-24T07:17:12.516 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 33/39 2026-02-24T07:17:13.459 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:17:13.462 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:17:13.721 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 34/39 2026-02-24T07:17:13.725 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T07:17:13.764 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 35/39 2026-02-24T07:17:13.764 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T07:17:13.764 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T07:17:13.764 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:13.767 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:17:13.805 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:17:13.805 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /sys 2026-02-24T07:17:13.805 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /proc 2026-02-24T07:17:13.805 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /mnt 2026-02-24T07:17:13.805 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /var/tmp 2026-02-24T07:17:13.805 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /home 2026-02-24T07:17:13.805 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /root 2026-02-24T07:17:13.805 INFO:teuthology.orchestra.run.trial195.stdout:skipping the directory /tmp 2026-02-24T07:17:13.805 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:14.296 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T07:17:14.319 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T07:17:14.319 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:17:14.320 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T07:17:14.320 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T07:17:14.320 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T07:17:14.320 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:14.321 INFO:teuthology.orchestra.run.trial195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T07:17:14.333 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T07:17:14.333 INFO:teuthology.orchestra.run.trial195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:17:14.389 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:17:14.389 INFO:teuthology.orchestra.run.trial195.stdout:Creating group 'qat' with GID 992. 2026-02-24T07:17:14.389 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:14.693 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 7/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 8/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 9/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 10/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 11/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T07:17:14.694 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 13/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 14/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 15/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-24T07:17:14.695 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-24T07:17:14.696 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 38/39 2026-02-24T07:17:14.762 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:17:14.762 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:14.762 INFO:teuthology.orchestra.run.trial195.stdout:Upgraded: 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T07:17:14.763 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T07:17:14.764 INFO:teuthology.orchestra.run.trial195.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T07:17:14.765 INFO:teuthology.orchestra.run.trial195.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T07:17:14.766 INFO:teuthology.orchestra.run.trial195.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T07:17:14.766 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:14.766 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:17:14.804 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-test 2026-02-24T07:17:15.122 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:00:17 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:17:15.208 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:17:15.208 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:17:15.209 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T07:17:15.209 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:17:15.209 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:17:15.209 INFO:teuthology.orchestra.run.trial195.stdout: ceph-test x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 126 M 2026-02-24T07:17:15.209 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T07:17:15.209 INFO:teuthology.orchestra.run.trial195.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T07:17:15.209 INFO:teuthology.orchestra.run.trial195.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-24T07:17:15.209 INFO:teuthology.orchestra.run.trial195.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T07:17:15.209 INFO:teuthology.orchestra.run.trial195.stdout: libcephsqlite x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 153 k 2026-02-24T07:17:15.209 INFO:teuthology.orchestra.run.trial195.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout:Install 12 Packages 2026-02-24T07:17:15.210 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:15.211 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 131 M 2026-02-24T07:17:15.211 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 977 M 2026-02-24T07:17:15.211 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:17:15.810 INFO:teuthology.orchestra.run.trial195.stdout:(1/12): libcephsqlite-20.3.0-5440.gff63f3d9.el9 362 kB/s | 153 kB 00:00 2026-02-24T07:17:16.210 INFO:teuthology.orchestra.run.trial195.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 57 kB/s | 23 kB 00:00 2026-02-24T07:17:16.448 INFO:teuthology.orchestra.run.trial195.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 395 kB/s | 94 kB 00:00 2026-02-24T07:17:17.110 INFO:teuthology.orchestra.run.trial195.stdout:(4/12): libasan8-15.2.1-7.el9.x86_64.rpm 792 kB/s | 525 kB 00:00 2026-02-24T07:17:17.364 INFO:teuthology.orchestra.run.trial195.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 694 kB/s | 176 kB 00:00 2026-02-24T07:17:17.696 INFO:teuthology.orchestra.run.trial195.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 703 kB/s | 233 kB 00:00 2026-02-24T07:17:18.281 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:17:18.281 INFO:teuthology.orchestra.run.trial022.stdout:skipping the directory /sys 2026-02-24T07:17:18.281 INFO:teuthology.orchestra.run.trial022.stdout:skipping the directory /proc 2026-02-24T07:17:18.281 INFO:teuthology.orchestra.run.trial022.stdout:skipping the directory /mnt 2026-02-24T07:17:18.281 INFO:teuthology.orchestra.run.trial022.stdout:skipping the directory /var/tmp 2026-02-24T07:17:18.281 INFO:teuthology.orchestra.run.trial022.stdout:skipping the directory /home 2026-02-24T07:17:18.281 INFO:teuthology.orchestra.run.trial022.stdout:skipping the directory /root 2026-02-24T07:17:18.281 INFO:teuthology.orchestra.run.trial022.stdout:skipping the directory /tmp 2026-02-24T07:17:18.282 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:18.310 INFO:teuthology.orchestra.run.trial195.stdout:(7/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 735 kB/s | 2.1 MB 00:02 2026-02-24T07:17:18.724 INFO:teuthology.orchestra.run.trial195.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 734 kB/s | 303 kB 00:00 2026-02-24T07:17:18.776 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T07:17:18.799 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 37/39 2026-02-24T07:17:18.800 INFO:teuthology.orchestra.run.trial022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:17:18.800 INFO:teuthology.orchestra.run.trial022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T07:17:18.800 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T07:17:18.800 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T07:17:18.800 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:18.801 INFO:teuthology.orchestra.run.trial022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T07:17:18.814 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-24T07:17:18.814 INFO:teuthology.orchestra.run.trial022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:17:18.822 INFO:teuthology.orchestra.run.trial195.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 643 kB/s | 64 kB 00:00 2026-02-24T07:17:18.870 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:17:18.870 INFO:teuthology.orchestra.run.trial022.stdout:Creating group 'qat' with GID 992. 2026-02-24T07:17:18.870 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:18.881 INFO:teuthology.orchestra.run.trial195.stdout:(10/12): protobuf-3.14.0-17.el9.x86_64.rpm 867 kB/s | 1.0 MB 00:01 2026-02-24T07:17:19.162 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/39 2026-02-24T07:17:19.162 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/39 2026-02-24T07:17:19.162 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/39 2026-02-24T07:17:19.162 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_6 5/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 7/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_6 8/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 9/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9. 10/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x8 11/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 13/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 14/39 2026-02-24T07:17:19.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 15/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-24T07:17:19.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-24T07:17:19.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-24T07:17:19.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-24T07:17:19.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-24T07:17:19.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-24T07:17:19.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-24T07:17:19.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-24T07:17:19.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-24T07:17:19.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 36/39 2026-02-24T07:17:19.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-24T07:17:19.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 38/39 2026-02-24T07:17:19.229 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-24T07:17:19.229 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:19.229 INFO:teuthology.orchestra.run.trial022.stdout:Upgraded: 2026-02-24T07:17:19.229 INFO:teuthology.orchestra.run.trial022.stdout: librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: ceph-radosgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: ceph-selinux-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: libcephfs-daemon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.230 INFO:teuthology.orchestra.run.trial022.stdout: libcephfs-proxy2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: libradosstriper1-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: librgw2-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T07:17:19.231 INFO:teuthology.orchestra.run.trial022.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: python3-ceph-argparse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: python3-ceph-common-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T07:17:19.232 INFO:teuthology.orchestra.run.trial022.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T07:17:19.233 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:19.233 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:17:19.270 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-test 2026-02-24T07:17:19.586 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:00:17 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:17:19.669 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:17:19.670 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:17:19.670 INFO:teuthology.orchestra.run.trial022.stdout: Package Arch Version Repository Size 2026-02-24T07:17:19.670 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout: ceph-test x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 126 M 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout:Installing dependencies: 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout: libcephsqlite x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 153 k 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T07:17:19.671 INFO:teuthology.orchestra.run.trial022.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T07:17:19.672 INFO:teuthology.orchestra.run.trial022.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T07:17:19.672 INFO:teuthology.orchestra.run.trial022.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T07:17:19.672 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:19.672 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:17:19.672 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:17:19.672 INFO:teuthology.orchestra.run.trial022.stdout:Install 12 Packages 2026-02-24T07:17:19.672 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:19.673 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 131 M 2026-02-24T07:17:19.673 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 977 M 2026-02-24T07:17:19.673 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:17:20.122 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] yaml-cpp-0.6.3-5.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/y/yaml-cpp-0.6.3-5.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:20.211 INFO:teuthology.orchestra.run.trial022.stdout:(1/12): libcephsqlite-20.3.0-5440.gff63f3d9.el9 1.5 MB/s | 153 kB 00:00 2026-02-24T07:17:20.631 INFO:teuthology.orchestra.run.trial022.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 54 kB/s | 23 kB 00:00 2026-02-24T07:17:20.887 INFO:teuthology.orchestra.run.trial022.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 367 kB/s | 94 kB 00:00 2026-02-24T07:17:21.435 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] yaml-cpp-0.6.3-5.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/y/yaml-cpp-0.6.3-5.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:21.676 INFO:teuthology.orchestra.run.trial195.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 43 kB/s | 122 kB 00:02 2026-02-24T07:17:21.737 INFO:teuthology.orchestra.run.trial022.stdout:(4/12): libasan8-15.2.1-7.el9.x86_64.rpm 617 kB/s | 525 kB 00:00 2026-02-24T07:17:22.464 INFO:teuthology.orchestra.run.trial022.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 242 kB/s | 176 kB 00:00 2026-02-24T07:17:23.023 INFO:teuthology.orchestra.run.trial022.stdout:(6/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 737 kB/s | 2.1 MB 00:02 2026-02-24T07:17:23.220 INFO:teuthology.orchestra.run.trial022.stdout:(7/12): libxslt-1.1.34-12.el9.x86_64.rpm 309 kB/s | 233 kB 00:00 2026-02-24T07:17:24.009 INFO:teuthology.orchestra.run.trial022.stdout:(8/12): ceph-test-20.3.0-5440.gff63f3d9.el9.x86 32 MB/s | 126 MB 00:03 2026-02-24T07:17:24.012 INFO:teuthology.orchestra.run.trial022.stdout:(9/12): protobuf-3.14.0-17.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2026-02-24T07:17:24.093 INFO:teuthology.orchestra.run.trial022.stdout:(10/12): socat-1.7.4.1-8.el9.x86_64.rpm 347 kB/s | 303 kB 00:00 2026-02-24T07:17:24.270 INFO:teuthology.orchestra.run.trial022.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 472 kB/s | 122 kB 00:00 2026-02-24T07:17:24.628 INFO:teuthology.orchestra.run.trial022.stdout:(12/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2026-02-24T07:17:24.633 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:17:24.633 INFO:teuthology.orchestra.run.trial022.stdout:Total 26 MB/s | 131 MB 00:04 2026-02-24T07:17:24.714 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:17:24.724 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:17:24.725 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:17:25.148 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:17:25.149 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:17:25.599 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:17:25.608 INFO:teuthology.orchestra.run.trial022.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-24T07:17:25.617 INFO:teuthology.orchestra.run.trial022.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-24T07:17:25.622 INFO:teuthology.orchestra.run.trial022.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-24T07:17:25.627 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-24T07:17:25.629 INFO:teuthology.orchestra.run.trial022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-24T07:17:25.634 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-24T07:17:25.634 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T07:17:25.651 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T07:17:25.653 INFO:teuthology.orchestra.run.trial022.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-24T07:17:25.663 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-24T07:17:25.671 INFO:teuthology.orchestra.run.trial022.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-24T07:17:25.672 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T07:17:32.561 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T07:17:32.580 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T07:17:32.872 INFO:teuthology.orchestra.run.trial195.stdout:(12/12): ceph-test-20.3.0-5440.gff63f3d9.el9.x8 7.2 MB/s | 126 MB 00:17 2026-02-24T07:17:32.875 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:17:32.876 INFO:teuthology.orchestra.run.trial195.stdout:Total 7.4 MB/s | 131 MB 00:17 2026-02-24T07:17:32.958 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:17:32.970 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:17:32.970 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:17:33.376 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T07:17:33.376 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/12 2026-02-24T07:17:33.376 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/12 2026-02-24T07:17:33.376 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-24T07:17:33.376 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-24T07:17:33.377 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-24T07:17:33.377 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-24T07:17:33.377 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-24T07:17:33.377 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-24T07:17:33.377 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-24T07:17:33.377 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-24T07:17:33.377 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-24T07:17:33.395 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:17:33.395 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:17:33.435 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-24T07:17:33.435 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:33.435 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:17:33.435 INFO:teuthology.orchestra.run.trial022.stdout: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T07:17:33.436 INFO:teuthology.orchestra.run.trial022.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T07:17:33.437 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:33.437 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:17:33.478 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph 2026-02-24T07:17:33.794 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:00:31 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:17:33.848 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:17:33.857 INFO:teuthology.orchestra.run.trial195.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-24T07:17:33.865 INFO:teuthology.orchestra.run.trial195.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-24T07:17:33.871 INFO:teuthology.orchestra.run.trial195.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-24T07:17:33.874 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-24T07:17:33.877 INFO:teuthology.orchestra.run.trial195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-24T07:17:33.880 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:17:33.881 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-24T07:17:33.882 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T07:17:33.883 INFO:teuthology.orchestra.run.trial022.stdout:======================================================================================= 2026-02-24T07:17:33.883 INFO:teuthology.orchestra.run.trial022.stdout: Package Arch Version Repository Size 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout:======================================================================================= 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout: ceph x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 6.5 k 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout:Installing dependencies: 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 57 k 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mds x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.0 M 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 937 k 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 298 k 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 4.9 M 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout: ceph-osd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 163 k 2026-02-24T07:17:33.884 INFO:teuthology.orchestra.run.trial022.stdout: ceph-osd-classic x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 15 M 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: ceph-osd-crimson x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 87 M 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 17 k 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 1.0 M 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T07:17:33.885 INFO:teuthology.orchestra.run.trial022.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T07:17:33.886 INFO:teuthology.orchestra.run.trial022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T07:17:33.887 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T07:17:33.888 INFO:teuthology.orchestra.run.trial022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T07:17:33.889 INFO:teuthology.orchestra.run.trial022.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T07:17:33.890 INFO:teuthology.orchestra.run.trial022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout:Installing weak dependencies: 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 184 k 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 51 M 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 7.4 M 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 22 k 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-rook noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 50 k 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: ceph-volume noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 301 k 2026-02-24T07:17:33.891 INFO:teuthology.orchestra.run.trial022.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T07:17:33.892 INFO:teuthology.orchestra.run.trial022.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T07:17:33.892 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:33.892 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:17:33.892 INFO:teuthology.orchestra.run.trial022.stdout:======================================================================================= 2026-02-24T07:17:33.892 INFO:teuthology.orchestra.run.trial022.stdout:Install 96 Packages 2026-02-24T07:17:33.892 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:33.893 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 225 M 2026-02-24T07:17:33.893 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 1.5 G 2026-02-24T07:17:33.893 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:17:33.900 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T07:17:33.902 INFO:teuthology.orchestra.run.trial195.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-24T07:17:33.912 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-24T07:17:33.920 INFO:teuthology.orchestra.run.trial195.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-24T07:17:33.921 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T07:17:35.095 INFO:teuthology.orchestra.run.trial022.stdout:(1/96): ceph-mgr-20.3.0-5440.gff63f3d9.el9.x86_ 2.1 MB/s | 937 kB 00:00 2026-02-24T07:17:35.333 INFO:teuthology.orchestra.run.trial022.stdout:(2/96): ceph-mds-20.3.0-5440.gff63f3d9.el9.x86_ 3.0 MB/s | 2.0 MB 00:00 2026-02-24T07:17:35.389 INFO:teuthology.orchestra.run.trial022.stdout:(3/96): ceph-osd-20.3.0-5440.gff63f3d9.el9.x86_ 2.9 MB/s | 163 kB 00:00 2026-02-24T07:17:35.598 INFO:teuthology.orchestra.run.trial022.stdout:(4/96): ceph-mon-20.3.0-5440.gff63f3d9.el9.x86_ 9.7 MB/s | 4.9 MB 00:00 2026-02-24T07:17:36.943 INFO:teuthology.orchestra.run.trial022.stdout:(5/96): ceph-20.3.0-5440.gff63f3d9.el9.x86_64.r 2.8 kB/s | 6.5 kB 00:02 2026-02-24T07:17:37.119 INFO:teuthology.orchestra.run.trial022.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5440.gff 326 kB/s | 57 kB 00:00 2026-02-24T07:17:37.240 INFO:teuthology.orchestra.run.trial022.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5440.gff63f3d9. 1.5 MB/s | 184 kB 00:00 2026-02-24T07:17:37.397 INFO:teuthology.orchestra.run.trial022.stdout:(8/96): ceph-osd-classic-20.3.0-5440.gff63f3d9. 7.4 MB/s | 15 MB 00:02 2026-02-24T07:17:38.745 INFO:teuthology.orchestra.run.trial022.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-54 5.5 MB/s | 7.4 MB 00:01 2026-02-24T07:17:38.787 INFO:teuthology.orchestra.run.trial022.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5440.gff63f3 535 kB/s | 22 kB 00:00 2026-02-24T07:17:38.881 INFO:teuthology.orchestra.run.trial022.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5440.gff6 3.1 MB/s | 298 kB 00:00 2026-02-24T07:17:38.927 INFO:teuthology.orchestra.run.trial022.stdout:(12/96): ceph-mgr-rook-20.3.0-5440.gff63f3d9.el 1.1 MB/s | 50 kB 00:00 2026-02-24T07:17:38.972 INFO:teuthology.orchestra.run.trial022.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5440.gff 383 kB/s | 17 kB 00:00 2026-02-24T07:17:39.067 INFO:teuthology.orchestra.run.trial022.stdout:(14/96): ceph-volume-20.3.0-5440.gff63f3d9.el9. 3.1 MB/s | 301 kB 00:00 2026-02-24T07:17:39.274 INFO:teuthology.orchestra.run.trial022.stdout:(15/96): cephadm-20.3.0-5440.gff63f3d9.el9.noar 4.9 MB/s | 1.0 MB 00:00 2026-02-24T07:17:39.333 INFO:teuthology.orchestra.run.trial022.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 5.9 MB/s | 351 kB 00:00 2026-02-24T07:17:39.342 INFO:teuthology.orchestra.run.trial022.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.3 MB/s | 40 kB 00:00 2026-02-24T07:17:39.352 INFO:teuthology.orchestra.run.trial022.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 7.3 MB/s | 72 kB 00:00 2026-02-24T07:17:39.380 INFO:teuthology.orchestra.run.trial022.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 28 MB/s | 794 kB 00:00 2026-02-24T07:17:39.392 INFO:teuthology.orchestra.run.trial022.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 15 MB/s | 184 kB 00:00 2026-02-24T07:17:39.405 INFO:teuthology.orchestra.run.trial022.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 21 MB/s | 253 kB 00:00 2026-02-24T07:17:39.438 INFO:teuthology.orchestra.run.trial022.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 37 MB/s | 1.2 MB 00:00 2026-02-24T07:17:39.449 INFO:teuthology.orchestra.run.trial022.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 9.9 MB/s | 106 kB 00:00 2026-02-24T07:17:39.460 INFO:teuthology.orchestra.run.trial022.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 12 MB/s | 135 kB 00:00 2026-02-24T07:17:39.471 INFO:teuthology.orchestra.run.trial022.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 14 MB/s | 150 kB 00:00 2026-02-24T07:17:39.482 INFO:teuthology.orchestra.run.trial022.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 11 MB/s | 126 kB 00:00 2026-02-24T07:17:39.494 INFO:teuthology.orchestra.run.trial022.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 19 MB/s | 218 kB 00:00 2026-02-24T07:17:39.505 INFO:teuthology.orchestra.run.trial022.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 15 MB/s | 182 kB 00:00 2026-02-24T07:17:39.516 INFO:teuthology.orchestra.run.trial022.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 24 MB/s | 266 kB 00:00 2026-02-24T07:17:39.597 INFO:teuthology.orchestra.run.trial022.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 365 kB/s | 30 kB 00:00 2026-02-24T07:17:39.785 INFO:teuthology.orchestra.run.trial022.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 16 MB/s | 3.0 MB 00:00 2026-02-24T07:17:39.810 INFO:teuthology.orchestra.run.trial022.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 589 kB/s | 15 kB 00:00 2026-02-24T07:17:39.838 INFO:teuthology.orchestra.run.trial022.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 8.8 MB/s | 246 kB 00:00 2026-02-24T07:17:39.865 INFO:teuthology.orchestra.run.trial022.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 6.7 MB/s | 188 kB 00:00 2026-02-24T07:17:39.890 INFO:teuthology.orchestra.run.trial022.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-24T07:17:39.956 INFO:teuthology.orchestra.run.trial022.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 81 MB/s | 5.3 MB 00:00 2026-02-24T07:17:40.021 INFO:teuthology.orchestra.run.trial022.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 92 MB/s | 6.0 MB 00:00 2026-02-24T07:17:40.049 INFO:teuthology.orchestra.run.trial022.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 8.5 MB/s | 244 kB 00:00 2026-02-24T07:17:40.077 INFO:teuthology.orchestra.run.trial022.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.7 MB/s | 249 kB 00:00 2026-02-24T07:17:40.103 INFO:teuthology.orchestra.run.trial022.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 1.8 MB/s | 48 kB 00:00 2026-02-24T07:17:40.129 INFO:teuthology.orchestra.run.trial022.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 6.5 MB/s | 177 kB 00:00 2026-02-24T07:17:40.160 INFO:teuthology.orchestra.run.trial022.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 40 MB/s | 1.2 MB 00:00 2026-02-24T07:17:40.189 INFO:teuthology.orchestra.run.trial022.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 1.2 MB/s | 35 kB 00:00 2026-02-24T07:17:40.254 INFO:teuthology.orchestra.run.trial022.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 95 MB/s | 6.1 MB 00:00 2026-02-24T07:17:40.283 INFO:teuthology.orchestra.run.trial022.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-24T07:17:40.309 INFO:teuthology.orchestra.run.trial022.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 2.9 MB/s | 77 kB 00:00 2026-02-24T07:17:40.381 INFO:teuthology.orchestra.run.trial022.stdout:(47/96): ceph-mgr-dashboard-20.3.0-5440.gff63f3 16 MB/s | 51 MB 00:03 2026-02-24T07:17:40.382 INFO:teuthology.orchestra.run.trial022.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 3.6 MB/s | 267 kB 00:00 2026-02-24T07:17:40.410 INFO:teuthology.orchestra.run.trial022.stdout:(49/96): python3-pyasn1-modules-0.4.8-7.el9.noa 9.7 MB/s | 277 kB 00:00 2026-02-24T07:17:40.436 INFO:teuthology.orchestra.run.trial022.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 2.0 MB/s | 54 kB 00:00 2026-02-24T07:17:40.521 INFO:teuthology.orchestra.run.trial022.stdout:(51/96): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.1 MB/s | 157 kB 00:00 2026-02-24T07:17:40.550 INFO:teuthology.orchestra.run.trial022.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 1.4 MB/s | 42 kB 00:00 2026-02-24T07:17:40.618 INFO:teuthology.orchestra.run.trial022.stdout:(53/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 106 MB/s | 19 MB 00:00 2026-02-24T07:17:40.618 INFO:teuthology.orchestra.run.trial022.stdout:(54/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.7 MB/s | 189 kB 00:00 2026-02-24T07:17:40.644 INFO:teuthology.orchestra.run.trial022.stdout:(55/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.4 MB/s | 90 kB 00:00 2026-02-24T07:17:40.808 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 11/12 2026-02-24T07:17:40.828 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T07:17:41.025 INFO:teuthology.orchestra.run.trial022.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 55 kB/s | 22 kB 00:00 2026-02-24T07:17:41.362 INFO:teuthology.orchestra.run.trial022.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.6 MB/s | 551 kB 00:00 2026-02-24T07:17:41.499 INFO:teuthology.orchestra.run.trial022.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 141 kB/s | 19 kB 00:00 2026-02-24T07:17:41.614 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 12/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-24T07:17:41.615 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-24T07:17:41.675 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-24T07:17:41.675 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:41.675 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:17:41.675 INFO:teuthology.orchestra.run.trial195.stdout: ceph-test-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: libcephsqlite-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T07:17:41.676 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:41.677 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:17:41.719 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph 2026-02-24T07:17:41.729 INFO:teuthology.orchestra.run.trial022.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 660 kB/s | 151 kB 00:00 2026-02-24T07:17:41.784 INFO:teuthology.orchestra.run.trial022.stdout:(60/96): protobuf-compiler-3.14.0-17.el9.x86_64 756 kB/s | 862 kB 00:01 2026-02-24T07:17:41.920 INFO:teuthology.orchestra.run.trial022.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 217 kB/s | 29 kB 00:00 2026-02-24T07:17:42.039 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:00:44 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:17:42.046 INFO:teuthology.orchestra.run.trial022.stdout:(62/96): python3-asyncssh-2.13.2-5.el9.noarch.r 1.7 MB/s | 548 kB 00:00 2026-02-24T07:17:42.103 INFO:teuthology.orchestra.run.trial022.stdout:(63/96): python3-backports-tarfile-1.2.0-1.el9. 328 kB/s | 60 kB 00:00 2026-02-24T07:17:42.124 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:17:42.127 INFO:teuthology.orchestra.run.trial195.stdout:======================================================================================= 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repository Size 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout:======================================================================================= 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout: ceph x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 6.5 k 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout:Installing dependencies: 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 57 k 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mds x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.0 M 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 937 k 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 298 k 2026-02-24T07:17:42.128 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mon x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 4.9 M 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 163 k 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd-classic x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 15 M 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd-crimson x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 87 M 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 17 k 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 1.0 M 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T07:17:42.129 INFO:teuthology.orchestra.run.trial195.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T07:17:42.130 INFO:teuthology.orchestra.run.trial195.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T07:17:42.131 INFO:teuthology.orchestra.run.trial195.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T07:17:42.132 INFO:teuthology.orchestra.run.trial195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T07:17:42.133 INFO:teuthology.orchestra.run.trial195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T07:17:42.134 INFO:teuthology.orchestra.run.trial195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout:Installing weak dependencies: 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 184 k 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 51 M 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 7.4 M 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 22 k 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-rook noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 50 k 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: ceph-volume noarch 2:20.3.0-5440.gff63f3d9.el9 ceph-noarch 301 k 2026-02-24T07:17:42.135 INFO:teuthology.orchestra.run.trial195.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-24T07:17:42.136 INFO:teuthology.orchestra.run.trial195.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-24T07:17:42.136 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:42.136 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:17:42.136 INFO:teuthology.orchestra.run.trial195.stdout:======================================================================================= 2026-02-24T07:17:42.136 INFO:teuthology.orchestra.run.trial195.stdout:Install 96 Packages 2026-02-24T07:17:42.136 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:17:42.137 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 225 M 2026-02-24T07:17:42.137 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 1.5 G 2026-02-24T07:17:42.137 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:17:42.231 INFO:teuthology.orchestra.run.trial022.stdout:(64/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 235 kB/s | 43 kB 00:00 2026-02-24T07:17:42.242 INFO:teuthology.orchestra.run.trial022.stdout:(65/96): python3-cachetools-4.2.4-1.el9.noarch. 232 kB/s | 32 kB 00:00 2026-02-24T07:17:42.324 INFO:teuthology.orchestra.run.trial022.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 152 kB/s | 14 kB 00:00 2026-02-24T07:17:42.472 INFO:teuthology.orchestra.run.trial022.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 756 kB/s | 173 kB 00:00 2026-02-24T07:17:42.599 INFO:teuthology.orchestra.run.trial022.stdout:(68/96): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2026-02-24T07:17:42.746 INFO:teuthology.orchestra.run.trial022.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 928 kB/s | 254 kB 00:00 2026-02-24T07:17:42.927 INFO:teuthology.orchestra.run.trial195.stdout:(1/96): ceph-20.3.0-5440.gff63f3d9.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2026-02-24T07:17:43.019 INFO:teuthology.orchestra.run.trial022.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 530 kB/s | 144 kB 00:00 2026-02-24T07:17:43.103 INFO:teuthology.orchestra.run.trial022.stdout:(71/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 4.0 MB/s | 2.0 MB 00:00 2026-02-24T07:17:43.287 INFO:teuthology.orchestra.run.trial022.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 305 kB/s | 56 kB 00:00 2026-02-24T07:17:43.293 INFO:teuthology.orchestra.run.trial022.stdout:(73/96): python3-influxdb-5.3.1-1.el9.noarch.rp 506 kB/s | 139 kB 00:00 2026-02-24T07:17:43.380 INFO:teuthology.orchestra.run.trial022.stdout:(74/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 114 kB/s | 11 kB 00:00 2026-02-24T07:17:43.430 INFO:teuthology.orchestra.run.trial022.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 129 kB/s | 18 kB 00:00 2026-02-24T07:17:43.476 INFO:teuthology.orchestra.run.trial195.stdout:(2/96): ceph-mds-20.3.0-5440.gff63f3d9.el9.x86_ 2.5 MB/s | 2.0 MB 00:00 2026-02-24T07:17:43.519 INFO:teuthology.orchestra.run.trial022.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 167 kB/s | 23 kB 00:00 2026-02-24T07:17:43.535 INFO:teuthology.orchestra.run.trial195.stdout:(3/96): ceph-osd-20.3.0-5440.gff63f3d9.el9.x86_ 2.7 MB/s | 163 kB 00:00 2026-02-24T07:17:43.566 INFO:teuthology.orchestra.run.trial022.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 145 kB/s | 20 kB 00:00 2026-02-24T07:17:43.655 INFO:teuthology.orchestra.run.trial022.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 142 kB/s | 19 kB 00:00 2026-02-24T07:17:43.706 INFO:teuthology.orchestra.run.trial022.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 189 kB/s | 26 kB 00:00 2026-02-24T07:17:43.872 INFO:teuthology.orchestra.run.trial022.stdout:(80/96): ceph-osd-crimson-20.3.0-5440.gff63f3d9 10 MB/s | 87 MB 00:08 2026-02-24T07:17:43.943 INFO:teuthology.orchestra.run.trial195.stdout:(4/96): ceph-mon-20.3.0-5440.gff63f3d9.el9.x86_ 4.8 MB/s | 4.9 MB 00:01 2026-02-24T07:17:44.054 INFO:teuthology.orchestra.run.trial022.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 474 kB/s | 86 kB 00:00 2026-02-24T07:17:44.055 INFO:teuthology.orchestra.run.trial022.stdout:(82/96): python3-more-itertools-8.12.0-2.el9.no 226 kB/s | 79 kB 00:00 2026-02-24T07:17:44.116 INFO:teuthology.orchestra.run.trial022.stdout:(83/96): python3-kubernetes-26.1.0-3.el9.noarch 2.2 MB/s | 1.0 MB 00:00 2026-02-24T07:17:44.192 INFO:teuthology.orchestra.run.trial022.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 119 kB/s | 16 kB 00:00 2026-02-24T07:17:44.236 INFO:teuthology.orchestra.run.trial022.stdout:(85/96): python3-natsort-7.1.1-5.el9.noarch.rpm 316 kB/s | 58 kB 00:00 2026-02-24T07:17:44.300 INFO:teuthology.orchestra.run.trial022.stdout:(86/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 488 kB/s | 90 kB 00:00 2026-02-24T07:17:44.331 INFO:teuthology.orchestra.run.trial022.stdout:(87/96): python3-repoze-lru-0.7-16.el9.noarch.r 222 kB/s | 31 kB 00:00 2026-02-24T07:17:44.487 INFO:teuthology.orchestra.run.trial022.stdout:(88/96): python3-rsa-4.9-2.el9.noarch.rpm 317 kB/s | 59 kB 00:00 2026-02-24T07:17:44.557 INFO:teuthology.orchestra.run.trial022.stdout:(89/96): python3-routes-2.5.1-5.el9.noarch.rpm 589 kB/s | 188 kB 00:00 2026-02-24T07:17:44.607 INFO:teuthology.orchestra.run.trial022.stdout:(90/96): python3-saml-1.16.0-1.el9.noarch.rpm 452 kB/s | 125 kB 00:00 2026-02-24T07:17:44.625 INFO:teuthology.orchestra.run.trial022.stdout:(91/96): python3-tempora-5.0.0-2.el9.noarch.rpm 258 kB/s | 36 kB 00:00 2026-02-24T07:17:44.740 INFO:teuthology.orchestra.run.trial022.stdout:(92/96): python3-typing-extensions-4.15.0-1.el9 472 kB/s | 86 kB 00:00 2026-02-24T07:17:44.835 INFO:teuthology.orchestra.run.trial022.stdout:(93/96): python3-websocket-client-1.2.3-2.el9.n 393 kB/s | 90 kB 00:00 2026-02-24T07:17:44.855 INFO:teuthology.orchestra.run.trial022.stdout:(94/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 211 kB/s | 48 kB 00:00 2026-02-24T07:17:44.879 INFO:teuthology.orchestra.run.trial022.stdout:(95/96): python3-xmltodict-0.12.0-15.el9.noarch 159 kB/s | 22 kB 00:00 2026-02-24T07:17:44.972 INFO:teuthology.orchestra.run.trial022.stdout:(96/96): python3-zc-lockfile-2.0-10.el9.noarch. 146 kB/s | 20 kB 00:00 2026-02-24T07:17:44.976 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:17:44.977 INFO:teuthology.orchestra.run.trial022.stdout:Total 20 MB/s | 225 MB 00:11 2026-02-24T07:17:45.389 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:17:45.426 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:17:45.427 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:17:45.594 INFO:teuthology.orchestra.run.trial195.stdout:(5/96): ceph-mgr-20.3.0-5440.gff63f3d9.el9.x86_ 319 kB/s | 937 kB 00:02 2026-02-24T07:17:45.726 INFO:teuthology.orchestra.run.trial195.stdout:(6/96): ceph-osd-classic-20.3.0-5440.gff63f3d9. 6.7 MB/s | 15 MB 00:02 2026-02-24T07:17:45.727 INFO:teuthology.orchestra.run.trial195.stdout:(7/96): ceph-grafana-dashboards-20.3.0-5440.gff 429 kB/s | 57 kB 00:00 2026-02-24T07:17:45.796 INFO:teuthology.orchestra.run.trial195.stdout:(8/96): ceph-mgr-cephadm-20.3.0-5440.gff63f3d9. 2.6 MB/s | 184 kB 00:00 2026-02-24T07:17:46.224 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:17:46.224 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:17:47.046 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:17:47.048 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-24T07:17:47.052 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-24T07:17:47.074 INFO:teuthology.orchestra.run.trial022.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-24T07:17:47.108 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/96 2026-02-24T07:17:47.114 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-24T07:17:47.117 INFO:teuthology.orchestra.run.trial022.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-24T07:17:47.121 INFO:teuthology.orchestra.run.trial022.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-24T07:17:47.145 INFO:teuthology.orchestra.run.trial022.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-24T07:17:47.157 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-24T07:17:47.160 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-24T07:17:47.166 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-24T07:17:47.168 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-24T07:17:47.179 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-24T07:17:47.185 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-24T07:17:47.210 INFO:teuthology.orchestra.run.trial022.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-24T07:17:47.213 INFO:teuthology.orchestra.run.trial022.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-24T07:17:47.264 INFO:teuthology.orchestra.run.trial022.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-24T07:17:47.277 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 18/96 2026-02-24T07:17:47.279 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-24T07:17:47.283 INFO:teuthology.orchestra.run.trial022.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-24T07:17:47.289 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-24T07:17:47.294 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-24T07:17:47.297 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-24T07:17:47.311 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-24T07:17:47.316 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-24T07:17:47.321 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-24T07:17:47.332 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-24T07:17:47.341 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-24T07:17:47.348 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-24T07:17:47.367 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-24T07:17:47.378 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-24T07:17:47.394 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-24T07:17:47.399 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-24T07:17:47.407 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-24T07:17:47.447 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-24T07:17:47.450 INFO:teuthology.orchestra.run.trial195.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-54 4.5 MB/s | 7.4 MB 00:01 2026-02-24T07:17:47.506 INFO:teuthology.orchestra.run.trial195.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5440.gff63f3 402 kB/s | 22 kB 00:00 2026-02-24T07:17:47.618 INFO:teuthology.orchestra.run.trial195.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5440.gff6 2.6 MB/s | 298 kB 00:00 2026-02-24T07:17:47.676 INFO:teuthology.orchestra.run.trial195.stdout:(12/96): ceph-mgr-rook-20.3.0-5440.gff63f3d9.el 880 kB/s | 50 kB 00:00 2026-02-24T07:17:47.734 INFO:teuthology.orchestra.run.trial195.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5440.gff 298 kB/s | 17 kB 00:00 2026-02-24T07:17:47.773 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-24T07:17:47.783 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-24T07:17:47.787 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-24T07:17:47.793 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-24T07:17:47.795 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-24T07:17:47.823 INFO:teuthology.orchestra.run.trial022.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-24T07:17:47.867 INFO:teuthology.orchestra.run.trial022.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-24T07:17:47.867 INFO:teuthology.orchestra.run.trial195.stdout:(14/96): ceph-volume-20.3.0-5440.gff63f3d9.el9. 2.2 MB/s | 301 kB 00:00 2026-02-24T07:17:47.875 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-24T07:17:47.881 INFO:teuthology.orchestra.run.trial022.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-24T07:17:47.884 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-24T07:17:47.890 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-24T07:17:47.894 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-24T07:17:47.901 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-24T07:17:47.904 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-24T07:17:47.932 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-24T07:17:47.942 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-24T07:17:47.948 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-24T07:17:47.955 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-24T07:17:47.990 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-24T07:17:48.189 INFO:teuthology.orchestra.run.trial195.stdout:(15/96): cephadm-20.3.0-5440.gff63f3d9.el9.noar 3.2 MB/s | 1.0 MB 00:00 2026-02-24T07:17:48.217 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-24T07:17:48.240 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-24T07:17:48.244 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-24T07:17:48.303 INFO:teuthology.orchestra.run.trial022.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-24T07:17:48.304 INFO:teuthology.orchestra.run.trial022.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-24T07:17:48.325 INFO:teuthology.orchestra.run.trial022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-24T07:17:48.655 INFO:teuthology.orchestra.run.trial022.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-24T07:17:48.729 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-24T07:17:49.142 INFO:teuthology.orchestra.run.trial195.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 368 kB/s | 351 kB 00:00 2026-02-24T07:17:49.302 INFO:teuthology.orchestra.run.trial195.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 253 kB/s | 40 kB 00:00 2026-02-24T07:17:49.406 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-24T07:17:49.423 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-24T07:17:49.433 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-24T07:17:49.439 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-24T07:17:49.453 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-24T07:17:49.469 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-24T07:17:49.540 INFO:teuthology.orchestra.run.trial195.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 303 kB/s | 72 kB 00:00 2026-02-24T07:17:49.545 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-24T07:17:49.554 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-24T07:17:49.578 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-24T07:17:49.608 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-24T07:17:49.659 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-24T07:17:49.665 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-24T07:17:49.668 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-24T07:17:49.669 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-24T07:17:49.688 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:17:49.688 INFO:teuthology.orchestra.run.trial022.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T07:17:49.688 INFO:teuthology.orchestra.run.trial022.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T07:17:49.688 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:49.695 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:17:49.721 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:17:49.721 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T07:17:49.721 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:49.758 INFO:teuthology.orchestra.run.trial022.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-24T07:17:50.346 INFO:teuthology.orchestra.run.trial022.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-24T07:17:50.564 INFO:teuthology.orchestra.run.trial195.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 776 kB/s | 794 kB 00:01 2026-02-24T07:17:50.881 INFO:teuthology.orchestra.run.trial195.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 583 kB/s | 184 kB 00:00 2026-02-24T07:17:51.277 INFO:teuthology.orchestra.run.trial195.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 639 kB/s | 253 kB 00:00 2026-02-24T07:17:52.853 INFO:teuthology.orchestra.run.trial195.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 809 kB/s | 1.2 MB 00:01 2026-02-24T07:17:53.092 INFO:teuthology.orchestra.run.trial195.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 446 kB/s | 106 kB 00:00 2026-02-24T07:17:53.332 INFO:teuthology.orchestra.run.trial195.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 563 kB/s | 135 kB 00:00 2026-02-24T07:17:53.649 INFO:teuthology.orchestra.run.trial195.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 474 kB/s | 150 kB 00:00 2026-02-24T07:17:53.888 INFO:teuthology.orchestra.run.trial195.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 529 kB/s | 126 kB 00:00 2026-02-24T07:17:54.285 INFO:teuthology.orchestra.run.trial195.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 550 kB/s | 218 kB 00:00 2026-02-24T07:17:54.602 INFO:teuthology.orchestra.run.trial195.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 574 kB/s | 182 kB 00:00 2026-02-24T07:17:54.841 INFO:teuthology.orchestra.run.trial195.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 1.1 MB/s | 266 kB 00:00 2026-02-24T07:17:55.104 INFO:teuthology.orchestra.run.trial195.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 112 kB/s | 30 kB 00:00 2026-02-24T07:17:55.701 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 80/96 2026-02-24T07:17:55.705 INFO:teuthology.orchestra.run.trial195.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 5.0 MB/s | 3.0 MB 00:00 2026-02-24T07:17:55.765 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 81/96 2026-02-24T07:17:55.767 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T07:17:55.782 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T07:17:55.782 INFO:teuthology.orchestra.run.trial022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:17:55.782 INFO:teuthology.orchestra.run.trial022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T07:17:55.782 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:55.784 INFO:teuthology.orchestra.run.trial195.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 188 kB/s | 15 kB 00:00 2026-02-24T07:17:55.792 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T07:17:55.816 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T07:17:55.817 INFO:teuthology.orchestra.run.trial022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:17:55.817 INFO:teuthology.orchestra.run.trial022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T07:17:55.817 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T07:17:55.817 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T07:17:55.817 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:55.866 INFO:teuthology.orchestra.run.trial195.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.9 MB/s | 246 kB 00:00 2026-02-24T07:17:55.873 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T07:17:55.875 INFO:teuthology.orchestra.run.trial022.stdout: Installing : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T07:17:55.885 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 85/96 2026-02-24T07:17:55.909 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 86/96 2026-02-24T07:17:55.910 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T07:17:55.947 INFO:teuthology.orchestra.run.trial195.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 2.3 MB/s | 188 kB 00:00 2026-02-24T07:17:56.027 INFO:teuthology.orchestra.run.trial195.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 532 kB/s | 42 kB 00:00 2026-02-24T07:17:56.235 INFO:teuthology.orchestra.run.trial195.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 25 MB/s | 5.3 MB 00:00 2026-02-24T07:17:56.423 INFO:teuthology.orchestra.run.trial195.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 6.0 MB 00:00 2026-02-24T07:17:56.505 INFO:teuthology.orchestra.run.trial195.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2026-02-24T07:17:56.587 INFO:teuthology.orchestra.run.trial195.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 3.0 MB/s | 249 kB 00:00 2026-02-24T07:17:56.667 INFO:teuthology.orchestra.run.trial195.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 596 kB/s | 48 kB 00:00 2026-02-24T07:17:56.748 INFO:teuthology.orchestra.run.trial195.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 2.1 MB/s | 177 kB 00:00 2026-02-24T07:17:56.836 INFO:teuthology.orchestra.run.trial195.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2026-02-24T07:17:56.916 INFO:teuthology.orchestra.run.trial195.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 436 kB/s | 35 kB 00:00 2026-02-24T07:17:57.104 INFO:teuthology.orchestra.run.trial195.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 33 MB/s | 6.1 MB 00:00 2026-02-24T07:17:57.187 INFO:teuthology.orchestra.run.trial195.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 5.2 MB/s | 442 kB 00:00 2026-02-24T07:17:57.267 INFO:teuthology.orchestra.run.trial195.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 961 kB/s | 77 kB 00:00 2026-02-24T07:17:57.348 INFO:teuthology.orchestra.run.trial195.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 3.2 MB/s | 267 kB 00:00 2026-02-24T07:17:57.430 INFO:teuthology.orchestra.run.trial195.stdout:(48/96): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.9 MB/s | 157 kB 00:00 2026-02-24T07:17:57.512 INFO:teuthology.orchestra.run.trial195.stdout:(49/96): python3-pyasn1-modules-0.4.8-7.el9.noa 3.3 MB/s | 277 kB 00:00 2026-02-24T07:17:57.592 INFO:teuthology.orchestra.run.trial195.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 669 kB/s | 54 kB 00:00 2026-02-24T07:17:58.211 INFO:teuthology.orchestra.run.trial195.stdout:(51/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 31 MB/s | 19 MB 00:00 2026-02-24T07:17:58.291 INFO:teuthology.orchestra.run.trial195.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 522 kB/s | 42 kB 00:00 2026-02-24T07:17:58.372 INFO:teuthology.orchestra.run.trial195.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.3 MB/s | 189 kB 00:00 2026-02-24T07:17:58.452 INFO:teuthology.orchestra.run.trial195.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.1 MB/s | 90 kB 00:00 2026-02-24T07:17:58.485 INFO:teuthology.orchestra.run.trial195.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 693 kB/s | 22 kB 00:00 2026-02-24T07:17:58.544 INFO:teuthology.orchestra.run.trial195.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 14 MB/s | 862 kB 00:00 2026-02-24T07:17:58.816 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T07:17:58.823 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T07:17:59.010 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] abseil-cpp-20211102.0-4.el9.x86_64.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/a/abseil-cpp-20211102.0-4.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:17:59.279 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T07:17:59.280 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T07:17:59.292 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T07:17:59.293 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T07:17:59.356 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T07:17:59.396 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 91/96 2026-02-24T07:17:59.397 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T07:17:59.419 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T07:17:59.420 INFO:teuthology.orchestra.run.trial022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:17:59.420 INFO:teuthology.orchestra.run.trial022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T07:17:59.420 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T07:17:59.420 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T07:17:59.420 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:59.433 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T07:17:59.648 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T07:17:59.649 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T07:17:59.671 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T07:17:59.671 INFO:teuthology.orchestra.run.trial022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:17:59.671 INFO:teuthology.orchestra.run.trial022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T07:17:59.671 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T07:17:59.671 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T07:17:59.671 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:59.755 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T07:17:59.777 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T07:17:59.777 INFO:teuthology.orchestra.run.trial022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:17:59.777 INFO:teuthology.orchestra.run.trial022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T07:17:59.777 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T07:17:59.777 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T07:17:59.778 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:17:59.778 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T07:17:59.785 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T07:17:59.811 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T07:18:00.335 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] abseil-cpp-20211102.0-4.el9.x86_64.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/a/abseil-cpp-20211102.0-4.el9.x86_64.rpm (IP: 23.152.160.16) 2026-02-24T07:18:01.162 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T07:18:01.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/96 2026-02-24T07:18:01.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/96 2026-02-24T07:18:01.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/96 2026-02-24T07:18:01.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/96 2026-02-24T07:18:01.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 5/96 2026-02-24T07:18:01.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/96 2026-02-24T07:18:01.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 7/96 2026-02-24T07:18:01.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 8/96 2026-02-24T07:18:01.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 9/96 2026-02-24T07:18:01.163 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 10/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 11/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 12/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 13/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 14/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 15/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 16/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 17/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-24T07:18:01.164 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-24T07:18:01.165 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-24T07:18:01.166 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 50/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 51/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-24T07:18:01.167 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-24T07:18:01.168 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-24T07:18:01.169 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-24T07:18:01.170 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-24T07:18:01.170 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-24T07:18:01.170 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-24T07:18:01.170 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-24T07:18:01.170 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-24T07:18:01.170 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-24T07:18:01.170 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-24T07:18:01.170 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-24T07:18:01.170 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-24T07:18:01.170 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-24T07:18:01.232 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-24T07:18:01.232 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:01.232 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:18:01.232 INFO:teuthology.orchestra.run.trial022.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T07:18:01.232 INFO:teuthology.orchestra.run.trial022.stdout: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:01.232 INFO:teuthology.orchestra.run.trial022.stdout: ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:01.233 INFO:teuthology.orchestra.run.trial022.stdout: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T07:18:01.234 INFO:teuthology.orchestra.run.trial022.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T07:18:01.235 INFO:teuthology.orchestra.run.trial022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T07:18:01.236 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T07:18:01.237 INFO:teuthology.orchestra.run.trial022.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T07:18:01.238 INFO:teuthology.orchestra.run.trial022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T07:18:01.239 INFO:teuthology.orchestra.run.trial022.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T07:18:01.240 INFO:teuthology.orchestra.run.trial022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T07:18:01.240 INFO:teuthology.orchestra.run.trial022.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T07:18:01.240 INFO:teuthology.orchestra.run.trial022.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T07:18:01.240 INFO:teuthology.orchestra.run.trial022.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T07:18:01.240 INFO:teuthology.orchestra.run.trial022.stdout: zip-3.0-35.el9.x86_64 2026-02-24T07:18:01.240 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:01.240 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:01.301 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-base 2026-02-24T07:18:01.525 INFO:teuthology.orchestra.run.trial195.stdout:(57/96): ceph-osd-crimson-20.3.0-5440.gff63f3d9 4.9 MB/s | 87 MB 00:17 2026-02-24T07:18:01.623 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:00:59 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:01.688 INFO:teuthology.orchestra.run.trial022.stdout:Package ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:01.707 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:01.707 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:01.707 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:01.729 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install cephadm 2026-02-24T07:18:02.037 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:00 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:02.102 INFO:teuthology.orchestra.run.trial022.stdout:Package cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:02.120 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:02.121 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:02.121 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:02.135 INFO:teuthology.orchestra.run.trial195.stdout:(58/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 154 kB/s | 551 kB 00:03 2026-02-24T07:18:02.142 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T07:18:02.456 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:00 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:02.541 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:02.541 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:02.541 INFO:teuthology.orchestra.run.trial022.stdout: Package Arch Version Repo Size 2026-02-24T07:18:02.541 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:02.541 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:18:02.541 INFO:teuthology.orchestra.run.trial022.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 149 k 2026-02-24T07:18:02.541 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:02.542 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:18:02.542 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:02.542 INFO:teuthology.orchestra.run.trial022.stdout:Install 1 Package 2026-02-24T07:18:02.542 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:02.542 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 149 k 2026-02-24T07:18:02.542 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 455 k 2026-02-24T07:18:02.542 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:18:02.567 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] grpc-data-1.46.7-10.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/grpc-data-1.46.7-10.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:18:03.003 INFO:teuthology.orchestra.run.trial022.stdout:ceph-immutable-object-cache-20.3.0-5440.gff63f3 324 kB/s | 149 kB 00:00 2026-02-24T07:18:03.003 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:03.004 INFO:teuthology.orchestra.run.trial022.stdout:Total 323 kB/s | 149 kB 00:00 2026-02-24T07:18:03.004 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:18:03.008 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:18:03.008 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:18:03.039 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:18:03.039 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:18:03.094 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:18:03.096 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:18:03.119 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:18:03.119 INFO:teuthology.orchestra.run.trial022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:18:03.119 INFO:teuthology.orchestra.run.trial022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T07:18:03.119 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:03.368 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] grpc-data-1.46.7-10.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/g/grpc-data-1.46.7-10.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:18:03.412 INFO:teuthology.orchestra.run.trial195.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 10 kB/s | 19 kB 00:01 2026-02-24T07:18:03.414 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:18:03.414 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:03.414 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:18:03.414 INFO:teuthology.orchestra.run.trial022.stdout: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:03.415 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:03.415 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:03.442 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-mgr 2026-02-24T07:18:03.554 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] python3-asyncssh-2.13.2-5.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-asyncssh-2.13.2-5.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:18:03.753 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:01 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:03.818 INFO:teuthology.orchestra.run.trial022.stdout:Package ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:03.836 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:03.837 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:03.837 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:03.858 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T07:18:04.170 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:02 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:04.205 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] python3-asyncssh-2.13.2-5.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/p/python3-asyncssh-2.13.2-5.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:18:04.235 INFO:teuthology.orchestra.run.trial022.stdout:Package ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:04.254 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:04.254 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:04.254 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:04.275 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T07:18:04.293 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] luarocks-3.9.2-5.el9.noarch.rpm: Status code: 503 for https://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/luarocks-3.9.2-5.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:18:04.445 INFO:teuthology.orchestra.run.trial195.stdout:[MIRROR] luarocks-3.9.2-5.el9.noarch.rpm: Status code: 503 for http://mirror.fcix.net/epel/9/Everything/x86_64/Packages/l/luarocks-3.9.2-5.el9.noarch.rpm (IP: 23.152.160.16) 2026-02-24T07:18:04.587 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:02 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:04.603 INFO:teuthology.orchestra.run.trial195.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 460 kB/s | 548 kB 00:01 2026-02-24T07:18:04.604 INFO:teuthology.orchestra.run.trial195.stdout:(61/96): luarocks-3.9.2-5.el9.noarch.rpm 61 kB/s | 151 kB 00:02 2026-02-24T07:18:04.629 INFO:teuthology.orchestra.run.trial195.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 2.3 MB/s | 60 kB 00:00 2026-02-24T07:18:04.646 INFO:teuthology.orchestra.run.trial195.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.5 MB/s | 43 kB 00:00 2026-02-24T07:18:04.652 INFO:teuthology.orchestra.run.trial022.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:04.670 INFO:teuthology.orchestra.run.trial195.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 1.3 MB/s | 32 kB 00:00 2026-02-24T07:18:04.670 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:04.671 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:04.671 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:04.687 INFO:teuthology.orchestra.run.trial195.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 842 kB/s | 14 kB 00:00 2026-02-24T07:18:04.692 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-mgr-rook 2026-02-24T07:18:04.793 INFO:teuthology.orchestra.run.trial195.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 1.6 MB/s | 173 kB 00:00 2026-02-24T07:18:04.847 INFO:teuthology.orchestra.run.trial195.stdout:(67/96): python3-autocommand-2.2.2-8.el9.noarch 121 kB/s | 29 kB 00:00 2026-02-24T07:18:04.919 INFO:teuthology.orchestra.run.trial195.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 3.4 MB/s | 254 kB 00:00 2026-02-24T07:18:05.003 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:03 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:05.067 INFO:teuthology.orchestra.run.trial022.stdout:Package ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:05.086 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:05.087 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:05.087 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:05.107 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T07:18:05.214 INFO:teuthology.orchestra.run.trial195.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.9 MB/s | 2.0 MB 00:00 2026-02-24T07:18:05.263 INFO:teuthology.orchestra.run.trial195.stdout:(70/96): python3-cherrypy-18.6.1-2.el9.noarch.r 761 kB/s | 358 kB 00:00 2026-02-24T07:18:05.290 INFO:teuthology.orchestra.run.trial195.stdout:(71/96): python3-grpcio-tools-1.46.7-10.el9.x86 1.9 MB/s | 144 kB 00:00 2026-02-24T07:18:05.317 INFO:teuthology.orchestra.run.trial195.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 2.0 MB/s | 56 kB 00:00 2026-02-24T07:18:05.334 INFO:teuthology.orchestra.run.trial195.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 630 kB/s | 11 kB 00:00 2026-02-24T07:18:05.359 INFO:teuthology.orchestra.run.trial195.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 718 kB/s | 18 kB 00:00 2026-02-24T07:18:05.379 INFO:teuthology.orchestra.run.trial195.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-24T07:18:05.389 INFO:teuthology.orchestra.run.trial195.stdout:(76/96): python3-influxdb-5.3.1-1.el9.noarch.rp 1.1 MB/s | 139 kB 00:00 2026-02-24T07:18:05.397 INFO:teuthology.orchestra.run.trial195.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 1.1 MB/s | 20 kB 00:00 2026-02-24T07:18:05.413 INFO:teuthology.orchestra.run.trial195.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 823 kB/s | 19 kB 00:00 2026-02-24T07:18:05.414 INFO:teuthology.orchestra.run.trial195.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 1.5 MB/s | 26 kB 00:00 2026-02-24T07:18:05.425 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:03 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:05.440 INFO:teuthology.orchestra.run.trial195.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 3.0 MB/s | 79 kB 00:00 2026-02-24T07:18:05.490 INFO:teuthology.orchestra.run.trial022.stdout:Package ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:05.509 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:05.509 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:05.509 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:05.522 INFO:teuthology.orchestra.run.trial195.stdout:(81/96): ceph-mgr-dashboard-20.3.0-5440.gff63f3 2.6 MB/s | 51 MB 00:19 2026-02-24T07:18:05.522 INFO:teuthology.orchestra.run.trial195.stdout:(82/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2026-02-24T07:18:05.530 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-osd 2026-02-24T07:18:05.572 INFO:teuthology.orchestra.run.trial195.stdout:(83/96): python3-kubernetes-26.1.0-3.el9.noarch 6.4 MB/s | 1.0 MB 00:00 2026-02-24T07:18:05.579 INFO:teuthology.orchestra.run.trial195.stdout:(84/96): python3-natsort-7.1.1-5.el9.noarch.rpm 1.0 MB/s | 58 kB 00:00 2026-02-24T07:18:05.580 INFO:teuthology.orchestra.run.trial195.stdout:(85/96): python3-portend-3.1.0-2.el9.noarch.rpm 288 kB/s | 16 kB 00:00 2026-02-24T07:18:05.596 INFO:teuthology.orchestra.run.trial195.stdout:(86/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.7 MB/s | 90 kB 00:00 2026-02-24T07:18:05.598 INFO:teuthology.orchestra.run.trial195.stdout:(87/96): python3-repoze-lru-0.7-16.el9.noarch.r 1.7 MB/s | 31 kB 00:00 2026-02-24T07:18:05.614 INFO:teuthology.orchestra.run.trial195.stdout:(88/96): python3-rsa-4.9-2.el9.noarch.rpm 3.2 MB/s | 59 kB 00:00 2026-02-24T07:18:05.621 INFO:teuthology.orchestra.run.trial195.stdout:(89/96): python3-saml-1.16.0-1.el9.noarch.rpm 5.2 MB/s | 125 kB 00:00 2026-02-24T07:18:05.631 INFO:teuthology.orchestra.run.trial195.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 2.0 MB/s | 36 kB 00:00 2026-02-24T07:18:05.639 INFO:teuthology.orchestra.run.trial195.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 4.8 MB/s | 86 kB 00:00 2026-02-24T07:18:05.655 INFO:teuthology.orchestra.run.trial195.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2026-02-24T07:18:05.662 INFO:teuthology.orchestra.run.trial195.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.0 MB/s | 48 kB 00:00 2026-02-24T07:18:05.672 INFO:teuthology.orchestra.run.trial195.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 1.3 MB/s | 22 kB 00:00 2026-02-24T07:18:05.680 INFO:teuthology.orchestra.run.trial195.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 1.1 MB/s | 20 kB 00:00 2026-02-24T07:18:05.844 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:03 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:05.908 INFO:teuthology.orchestra.run.trial022.stdout:Package ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:05.927 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:05.928 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:05.928 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:05.949 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-osd-classic 2026-02-24T07:18:06.135 INFO:teuthology.orchestra.run.trial195.stdout:(96/96): python3-routes-2.5.1-5.el9.noarch.rpm 339 kB/s | 188 kB 00:00 2026-02-24T07:18:06.141 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:06.141 INFO:teuthology.orchestra.run.trial195.stdout:Total 9.4 MB/s | 225 MB 00:24 2026-02-24T07:18:06.261 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:04 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:06.326 INFO:teuthology.orchestra.run.trial022.stdout:Package ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:06.345 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:06.345 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:06.345 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:06.367 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-fuse 2026-02-24T07:18:06.543 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:18:06.582 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:18:06.582 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:18:06.678 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:04 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:06.762 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:06.762 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:06.762 INFO:teuthology.orchestra.run.trial022.stdout: Package Arch Version Repo Size 2026-02-24T07:18:06.763 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:06.763 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:18:06.763 INFO:teuthology.orchestra.run.trial022.stdout: ceph-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 914 k 2026-02-24T07:18:06.763 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:06.763 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:18:06.763 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:06.763 INFO:teuthology.orchestra.run.trial022.stdout:Install 1 Package 2026-02-24T07:18:06.763 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:06.764 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 914 k 2026-02-24T07:18:06.764 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 2.9 M 2026-02-24T07:18:06.764 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:18:07.376 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:18:07.376 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:18:07.391 INFO:teuthology.orchestra.run.trial022.stdout:ceph-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 1.4 MB/s | 914 kB 00:00 2026-02-24T07:18:07.392 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:07.392 INFO:teuthology.orchestra.run.trial022.stdout:Total 1.4 MB/s | 914 kB 00:00 2026-02-24T07:18:07.392 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:18:07.397 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:18:07.397 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:18:07.431 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:18:07.431 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:18:07.525 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:18:07.543 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:07.802 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:07.864 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:07.864 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:07.864 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:18:07.864 INFO:teuthology.orchestra.run.trial022.stdout: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:07.864 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:07.864 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:07.892 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-volume 2026-02-24T07:18:08.198 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:18:08.200 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-24T07:18:08.203 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-24T07:18:08.209 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:06 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:08.224 INFO:teuthology.orchestra.run.trial195.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-24T07:18:08.258 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/96 2026-02-24T07:18:08.264 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-24T07:18:08.267 INFO:teuthology.orchestra.run.trial195.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-24T07:18:08.271 INFO:teuthology.orchestra.run.trial195.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-24T07:18:08.275 INFO:teuthology.orchestra.run.trial022.stdout:Package ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:08.294 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:08.295 INFO:teuthology.orchestra.run.trial195.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-24T07:18:08.295 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:08.295 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:08.307 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-24T07:18:08.310 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-24T07:18:08.316 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install librados-devel 2026-02-24T07:18:08.317 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-24T07:18:08.318 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-24T07:18:08.328 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-24T07:18:08.334 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-24T07:18:08.358 INFO:teuthology.orchestra.run.trial195.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-24T07:18:08.361 INFO:teuthology.orchestra.run.trial195.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-24T07:18:08.410 INFO:teuthology.orchestra.run.trial195.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-24T07:18:08.423 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 18/96 2026-02-24T07:18:08.425 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-24T07:18:08.430 INFO:teuthology.orchestra.run.trial195.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-24T07:18:08.435 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-24T07:18:08.439 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-24T07:18:08.443 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-24T07:18:08.457 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-24T07:18:08.461 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-24T07:18:08.466 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-24T07:18:08.477 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-24T07:18:08.486 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-24T07:18:08.492 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-24T07:18:08.511 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-24T07:18:08.522 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-24T07:18:08.537 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-24T07:18:08.542 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-24T07:18:08.550 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-24T07:18:08.589 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-24T07:18:08.631 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:06 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:08.715 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:08.716 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:08.716 INFO:teuthology.orchestra.run.trial022.stdout: Package Arch Version Repo Size 2026-02-24T07:18:08.716 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:08.716 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:18:08.716 INFO:teuthology.orchestra.run.trial022.stdout: librados-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 124 k 2026-02-24T07:18:08.716 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:08.716 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:18:08.716 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:08.717 INFO:teuthology.orchestra.run.trial022.stdout:Install 1 Package 2026-02-24T07:18:08.717 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:08.717 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 124 k 2026-02-24T07:18:08.717 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 434 k 2026-02-24T07:18:08.717 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:18:08.908 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-24T07:18:08.918 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-24T07:18:08.922 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-24T07:18:08.928 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-24T07:18:08.930 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-24T07:18:08.958 INFO:teuthology.orchestra.run.trial195.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-24T07:18:09.001 INFO:teuthology.orchestra.run.trial195.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-24T07:18:09.010 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-24T07:18:09.015 INFO:teuthology.orchestra.run.trial195.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-24T07:18:09.019 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-24T07:18:09.024 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-24T07:18:09.028 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-24T07:18:09.035 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-24T07:18:09.038 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-24T07:18:09.066 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-24T07:18:09.076 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-24T07:18:09.082 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-24T07:18:09.089 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-24T07:18:09.124 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-24T07:18:09.179 INFO:teuthology.orchestra.run.trial022.stdout:librados-devel-20.3.0-5440.gff63f3d9.el9.x86_64 267 kB/s | 124 kB 00:00 2026-02-24T07:18:09.180 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:09.180 INFO:teuthology.orchestra.run.trial022.stdout:Total 267 kB/s | 124 kB 00:00 2026-02-24T07:18:09.180 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:18:09.183 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:18:09.183 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:18:09.215 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:18:09.215 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:18:09.270 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:18:09.288 INFO:teuthology.orchestra.run.trial022.stdout: Installing : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:09.349 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-24T07:18:09.373 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-24T07:18:09.377 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-24T07:18:09.378 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:09.435 INFO:teuthology.orchestra.run.trial195.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-24T07:18:09.436 INFO:teuthology.orchestra.run.trial195.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-24T07:18:09.441 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:09.441 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:09.441 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:18:09.442 INFO:teuthology.orchestra.run.trial022.stdout: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:09.442 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:09.442 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:09.457 INFO:teuthology.orchestra.run.trial195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-24T07:18:09.469 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install libcephfs2 2026-02-24T07:18:09.784 INFO:teuthology.orchestra.run.trial195.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-24T07:18:09.785 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:07 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:09.850 INFO:teuthology.orchestra.run.trial022.stdout:Package libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:09.858 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-24T07:18:09.868 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:09.869 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:09.869 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:09.891 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install libcephfs-devel 2026-02-24T07:18:10.206 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:08 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:10.290 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:10.291 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:10.291 INFO:teuthology.orchestra.run.trial022.stdout: Package Arch Version Repo Size 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout: libcephfs-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 37 k 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout:Install 1 Package 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 37 k 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 171 k 2026-02-24T07:18:10.292 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:18:10.532 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-24T07:18:10.549 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-24T07:18:10.560 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-24T07:18:10.567 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-24T07:18:10.582 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-24T07:18:10.598 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-24T07:18:10.675 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-24T07:18:10.683 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-24T07:18:10.707 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-24T07:18:10.737 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-24T07:18:10.787 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-24T07:18:10.793 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-24T07:18:10.797 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-24T07:18:10.798 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-24T07:18:10.815 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:18:10.815 INFO:teuthology.orchestra.run.trial195.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T07:18:10.815 INFO:teuthology.orchestra.run.trial195.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T07:18:10.815 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:10.822 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:18:10.847 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-24T07:18:10.847 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T07:18:10.848 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:10.881 INFO:teuthology.orchestra.run.trial195.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-24T07:18:11.469 INFO:teuthology.orchestra.run.trial195.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-24T07:18:12.744 INFO:teuthology.orchestra.run.trial022.stdout:libcephfs-devel-20.3.0-5440.gff63f3d9.el9.x86_6 15 kB/s | 37 kB 00:02 2026-02-24T07:18:12.744 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:12.744 INFO:teuthology.orchestra.run.trial022.stdout:Total 15 kB/s | 37 kB 00:02 2026-02-24T07:18:12.744 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:18:12.747 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:18:12.747 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:18:12.750 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:18:12.750 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:18:12.773 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:18:12.790 INFO:teuthology.orchestra.run.trial022.stdout: Installing : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:12.852 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:12.913 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:12.914 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:12.914 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:18:12.914 INFO:teuthology.orchestra.run.trial022.stdout: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:12.914 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:12.914 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:12.940 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install librados2 2026-02-24T07:18:13.255 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:11 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:13.320 INFO:teuthology.orchestra.run.trial022.stdout:Package librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:13.337 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:13.338 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:13.338 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:13.359 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install librbd1 2026-02-24T07:18:13.672 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:11 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:13.737 INFO:teuthology.orchestra.run.trial022.stdout:Package librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:13.754 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:13.755 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:13.755 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:13.778 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install python3-rados 2026-02-24T07:18:14.094 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:12 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:14.160 INFO:teuthology.orchestra.run.trial022.stdout:Package python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:14.177 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:14.179 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:14.179 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:14.200 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install python3-rgw 2026-02-24T07:18:14.512 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:12 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:14.577 INFO:teuthology.orchestra.run.trial022.stdout:Package python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:14.594 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:14.595 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:14.595 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:14.616 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install python3-cephfs 2026-02-24T07:18:14.933 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:12 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:14.999 INFO:teuthology.orchestra.run.trial022.stdout:Package python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:15.016 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:15.017 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:15.017 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:15.038 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install python3-rbd 2026-02-24T07:18:15.359 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:13 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:15.426 INFO:teuthology.orchestra.run.trial022.stdout:Package python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:15.444 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:15.445 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:15.445 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:15.466 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install rbd-fuse 2026-02-24T07:18:15.783 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:13 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:15.866 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:15.866 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:15.866 INFO:teuthology.orchestra.run.trial022.stdout: Package Architecture Version Repository Size 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout: rbd-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 86 k 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout:Install 1 Package 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 86 k 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 236 k 2026-02-24T07:18:15.867 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:18:16.290 INFO:teuthology.orchestra.run.trial022.stdout:rbd-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 204 kB/s | 86 kB 00:00 2026-02-24T07:18:16.290 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:16.291 INFO:teuthology.orchestra.run.trial022.stdout:Total 204 kB/s | 86 kB 00:00 2026-02-24T07:18:16.291 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:18:16.295 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:18:16.295 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:18:16.326 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:18:16.326 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:18:16.377 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:18:16.395 INFO:teuthology.orchestra.run.trial022.stdout: Installing : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:16.481 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:16.544 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:16.544 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:16.544 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:18:16.544 INFO:teuthology.orchestra.run.trial022.stdout: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:16.544 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:16.544 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:16.572 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install rbd-mirror 2026-02-24T07:18:16.799 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 80/96 2026-02-24T07:18:16.863 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 81/96 2026-02-24T07:18:16.865 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T07:18:16.879 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 82/96 2026-02-24T07:18:16.879 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:18:16.879 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T07:18:16.879 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:16.890 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T07:18:16.892 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:14 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:16.914 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 83/96 2026-02-24T07:18:16.915 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:18:16.915 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T07:18:16.915 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T07:18:16.915 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T07:18:16.915 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:16.971 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T07:18:16.972 INFO:teuthology.orchestra.run.trial195.stdout: Installing : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 84/96 2026-02-24T07:18:16.975 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:16.975 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:16.976 INFO:teuthology.orchestra.run.trial022.stdout: Package Arch Version Repo Size 2026-02-24T07:18:16.976 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:16.976 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:18:16.976 INFO:teuthology.orchestra.run.trial022.stdout: rbd-mirror x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.6 M 2026-02-24T07:18:16.976 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:16.976 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:18:16.976 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:16.976 INFO:teuthology.orchestra.run.trial022.stdout:Install 1 Package 2026-02-24T07:18:16.976 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:16.977 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 2.6 M 2026-02-24T07:18:16.977 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 11 M 2026-02-24T07:18:16.977 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:18:16.982 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 85/96 2026-02-24T07:18:17.006 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 86/96 2026-02-24T07:18:17.007 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T07:18:17.654 INFO:teuthology.orchestra.run.trial022.stdout:rbd-mirror-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 3.8 MB/s | 2.6 MB 00:00 2026-02-24T07:18:17.655 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:17.655 INFO:teuthology.orchestra.run.trial022.stdout:Total 3.8 MB/s | 2.6 MB 00:00 2026-02-24T07:18:17.655 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:18:17.660 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:18:17.660 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:18:17.699 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:18:17.699 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:18:17.864 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:18:17.866 INFO:teuthology.orchestra.run.trial022.stdout: Installing : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:17.889 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:17.889 INFO:teuthology.orchestra.run.trial022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:18:17.889 INFO:teuthology.orchestra.run.trial022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T07:18:17.889 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T07:18:17.890 INFO:teuthology.orchestra.run.trial022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T07:18:17.890 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:18.214 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:18.214 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:18.214 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:18:18.214 INFO:teuthology.orchestra.run.trial022.stdout: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:18.214 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:18.214 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:18.243 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install rbd-nbd 2026-02-24T07:18:18.566 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:16 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:18.649 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:18.649 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:18.649 INFO:teuthology.orchestra.run.trial022.stdout: Package Architecture Version Repository Size 2026-02-24T07:18:18.650 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:18.650 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:18:18.650 INFO:teuthology.orchestra.run.trial022.stdout: rbd-nbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 166 k 2026-02-24T07:18:18.650 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:18.650 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:18:18.650 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:18.650 INFO:teuthology.orchestra.run.trial022.stdout:Install 1 Package 2026-02-24T07:18:18.650 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:18.650 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 166 k 2026-02-24T07:18:18.651 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 496 k 2026-02-24T07:18:18.651 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:18:19.048 INFO:teuthology.orchestra.run.trial022.stdout:rbd-nbd-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 418 kB/s | 166 kB 00:00 2026-02-24T07:18:19.048 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:19.048 INFO:teuthology.orchestra.run.trial022.stdout:Total 417 kB/s | 166 kB 00:00 2026-02-24T07:18:19.048 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:18:19.053 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:18:19.053 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:18:19.084 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:18:19.084 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:18:19.140 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:18:19.157 INFO:teuthology.orchestra.run.trial022.stdout: Installing : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:19.244 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:19.307 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:19.307 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:19.307 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:18:19.307 INFO:teuthology.orchestra.run.trial022.stdout: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:19.307 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:19.307 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:19.336 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-osd-crimson 2026-02-24T07:18:19.652 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:17 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:19.717 INFO:teuthology.orchestra.run.trial022.stdout:Package ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:19.735 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:19.736 INFO:teuthology.orchestra.run.trial022.stdout:Nothing to do. 2026-02-24T07:18:19.736 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:18:19.757 DEBUG:teuthology.orchestra.run.trial022:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-24T07:18:19.897 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 87/96 2026-02-24T07:18:19.904 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T07:18:20.070 INFO:teuthology.orchestra.run.trial022.stdout:Last metadata expiration check: 0:01:18 ago on Tue 24 Feb 2026 07:17:02 AM UTC. 2026-02-24T07:18:20.153 INFO:teuthology.orchestra.run.trial022.stdout:Dependencies resolved. 2026-02-24T07:18:20.154 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:20.154 INFO:teuthology.orchestra.run.trial022.stdout: Package Arch Version Repo Size 2026-02-24T07:18:20.154 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:20.154 INFO:teuthology.orchestra.run.trial022.stdout:Installing: 2026-02-24T07:18:20.154 INFO:teuthology.orchestra.run.trial022.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 429 M 2026-02-24T07:18:20.154 INFO:teuthology.orchestra.run.trial022.stdout:Installing weak dependencies: 2026-02-24T07:18:20.154 INFO:teuthology.orchestra.run.trial022.stdout: ceph-debugsource x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 12 M 2026-02-24T07:18:20.155 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:20.155 INFO:teuthology.orchestra.run.trial022.stdout:Transaction Summary 2026-02-24T07:18:20.155 INFO:teuthology.orchestra.run.trial022.stdout:================================================================================ 2026-02-24T07:18:20.155 INFO:teuthology.orchestra.run.trial022.stdout:Install 2 Packages 2026-02-24T07:18:20.155 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:18:20.155 INFO:teuthology.orchestra.run.trial022.stdout:Total download size: 441 M 2026-02-24T07:18:20.155 INFO:teuthology.orchestra.run.trial022.stdout:Installed size: 2.7 G 2026-02-24T07:18:20.155 INFO:teuthology.orchestra.run.trial022.stdout:Downloading Packages: 2026-02-24T07:18:20.359 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 88/96 2026-02-24T07:18:20.360 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T07:18:20.373 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 89/96 2026-02-24T07:18:20.374 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T07:18:20.436 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 90/96 2026-02-24T07:18:20.476 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 91/96 2026-02-24T07:18:20.477 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T07:18:20.498 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 92/96 2026-02-24T07:18:20.498 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:18:20.498 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T07:18:20.498 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T07:18:20.498 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T07:18:20.498 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:20.510 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T07:18:20.725 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 93/96 2026-02-24T07:18:20.726 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T07:18:20.748 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 94/96 2026-02-24T07:18:20.748 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:18:20.749 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T07:18:20.749 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T07:18:20.749 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T07:18:20.749 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:20.832 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T07:18:20.852 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 95/96 2026-02-24T07:18:20.853 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:18:20.853 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T07:18:20.853 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T07:18:20.853 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T07:18:20.853 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:20.854 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T07:18:20.860 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T07:18:20.886 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 96/96 2026-02-24T07:18:22.112 INFO:teuthology.orchestra.run.trial022.stdout:(1/2): ceph-debugsource-20.3.0-5440.gff63f3d9.e 6.2 MB/s | 12 MB 00:01 2026-02-24T07:18:22.263 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 96/96 2026-02-24T07:18:22.263 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/96 2026-02-24T07:18:22.263 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2/96 2026-02-24T07:18:22.263 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 3/96 2026-02-24T07:18:22.263 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 4/96 2026-02-24T07:18:22.263 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 5/96 2026-02-24T07:18:22.263 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_6 6/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_6 7/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el 8/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarc 9/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noa 10/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f 11/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noa 12/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9. 13/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 14/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9 15/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 16/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 17/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-24T07:18:22.264 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-24T07:18:22.265 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-24T07:18:22.266 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 50/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 51/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-24T07:18:22.267 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-24T07:18:22.268 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-24T07:18:22.269 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-24T07:18:22.270 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-24T07:18:22.330 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-24T07:18:22.330 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:22.330 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: ceph-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: ceph-grafana-dashboards-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mds-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-k8sevents-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-modules-core-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:22.331 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: ceph-mon-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: ceph-prometheus-alerts-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T07:18:22.332 INFO:teuthology.orchestra.run.trial195.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T07:18:22.333 INFO:teuthology.orchestra.run.trial195.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T07:18:22.334 INFO:teuthology.orchestra.run.trial195.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T07:18:22.335 INFO:teuthology.orchestra.run.trial195.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T07:18:22.336 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T07:18:22.337 INFO:teuthology.orchestra.run.trial195.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: zip-3.0-35.el9.x86_64 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:22.338 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:22.401 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-base 2026-02-24T07:18:22.726 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:24 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:22.791 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-base-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:22.810 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:22.811 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:22.811 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:22.833 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install cephadm 2026-02-24T07:18:23.152 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:25 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:23.219 INFO:teuthology.orchestra.run.trial195.stdout:Package cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:23.238 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:23.239 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:23.239 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:23.260 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T07:18:23.581 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:25 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:23.666 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:23.667 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:23.667 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T07:18:23.667 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:23.667 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:18:23.668 INFO:teuthology.orchestra.run.trial195.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 149 k 2026-02-24T07:18:23.668 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:23.668 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:18:23.668 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:23.668 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T07:18:23.668 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:23.668 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 149 k 2026-02-24T07:18:23.668 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 455 k 2026-02-24T07:18:23.668 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:18:24.033 INFO:teuthology.orchestra.run.trial195.stdout:ceph-immutable-object-cache-20.3.0-5440.gff63f3 408 kB/s | 149 kB 00:00 2026-02-24T07:18:24.034 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:24.034 INFO:teuthology.orchestra.run.trial195.stdout:Total 407 kB/s | 149 kB 00:00 2026-02-24T07:18:24.034 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:18:24.038 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:18:24.038 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:18:24.070 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:18:24.070 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:18:24.125 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:18:24.126 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:18:24.149 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:18:24.149 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:18:24.149 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T07:18:24.149 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:24.471 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9. 1/1 2026-02-24T07:18:24.471 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:24.471 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:18:24.471 INFO:teuthology.orchestra.run.trial195.stdout: ceph-immutable-object-cache-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:24.471 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:24.471 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:24.499 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr 2026-02-24T07:18:24.817 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:26 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:24.883 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-mgr-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:24.902 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:24.903 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:24.903 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:24.925 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T07:18:25.242 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:27 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:25.307 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-mgr-dashboard-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:25.326 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:25.327 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:25.327 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:25.348 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T07:18:25.666 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:27 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:25.732 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:25.750 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:25.751 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:25.751 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:25.772 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr-rook 2026-02-24T07:18:26.089 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:26.155 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-mgr-rook-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:26.174 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:26.175 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:26.175 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:26.196 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T07:18:26.519 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:26.583 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-mgr-cephadm-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:26.602 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:26.603 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:26.603 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:26.624 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-osd 2026-02-24T07:18:26.937 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:27.003 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-osd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:27.021 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:27.022 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:27.022 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:27.044 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-osd-classic 2026-02-24T07:18:27.361 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:29 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:27.427 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-osd-classic-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:27.446 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:27.447 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:27.447 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:27.468 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-fuse 2026-02-24T07:18:27.778 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:29 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:27.862 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:27.862 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:27.862 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T07:18:27.862 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:27.862 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:18:27.862 INFO:teuthology.orchestra.run.trial195.stdout: ceph-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 914 k 2026-02-24T07:18:27.862 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:27.863 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:18:27.863 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:27.863 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T07:18:27.863 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:27.863 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 914 k 2026-02-24T07:18:27.863 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 2.9 M 2026-02-24T07:18:27.863 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:18:28.109 INFO:teuthology.orchestra.run.trial195.stdout:ceph-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 3.6 MB/s | 914 kB 00:00 2026-02-24T07:18:28.109 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:28.109 INFO:teuthology.orchestra.run.trial195.stdout:Total 3.6 MB/s | 914 kB 00:00 2026-02-24T07:18:28.110 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:18:28.114 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:18:28.114 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:18:28.148 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:18:28.148 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:18:28.238 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:18:28.256 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:28.482 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:28.544 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:28.544 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:28.544 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:18:28.544 INFO:teuthology.orchestra.run.trial195.stdout: ceph-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:28.545 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:28.545 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:28.571 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-volume 2026-02-24T07:18:28.890 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:30 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:28.954 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-volume-2:20.3.0-5440.gff63f3d9.el9.noarch is already installed. 2026-02-24T07:18:28.973 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:28.973 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:28.973 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:28.993 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install librados-devel 2026-02-24T07:18:29.305 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:31 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:29.390 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:29.391 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:29.391 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T07:18:29.391 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:29.391 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:18:29.391 INFO:teuthology.orchestra.run.trial195.stdout: librados-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 124 k 2026-02-24T07:18:29.391 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:29.391 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:18:29.391 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:29.391 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T07:18:29.391 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:29.392 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 124 k 2026-02-24T07:18:29.392 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 434 k 2026-02-24T07:18:29.392 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:18:29.574 INFO:teuthology.orchestra.run.trial195.stdout:librados-devel-20.3.0-5440.gff63f3d9.el9.x86_64 676 kB/s | 124 kB 00:00 2026-02-24T07:18:29.575 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:29.575 INFO:teuthology.orchestra.run.trial195.stdout:Total 672 kB/s | 124 kB 00:00 2026-02-24T07:18:29.575 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:18:29.578 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:18:29.578 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:18:29.610 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:18:29.610 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:18:29.666 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:18:29.683 INFO:teuthology.orchestra.run.trial195.stdout: Installing : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:29.772 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:29.834 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:29.834 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:29.834 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:18:29.834 INFO:teuthology.orchestra.run.trial195.stdout: librados-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:29.834 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:29.834 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:29.863 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install libcephfs2 2026-02-24T07:18:30.181 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:32 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:30.247 INFO:teuthology.orchestra.run.trial195.stdout:Package libcephfs2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:30.265 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:30.266 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:30.266 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:30.288 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install libcephfs-devel 2026-02-24T07:18:30.605 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:32 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:30.691 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:30.691 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:30.691 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T07:18:30.691 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:30.691 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:18:30.691 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs-devel x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 37 k 2026-02-24T07:18:30.692 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:30.692 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:18:30.692 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:30.692 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T07:18:30.692 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:30.692 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 37 k 2026-02-24T07:18:30.692 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 171 k 2026-02-24T07:18:30.692 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:18:30.891 INFO:teuthology.orchestra.run.trial195.stdout:libcephfs-devel-20.3.0-5440.gff63f3d9.el9.x86_6 186 kB/s | 37 kB 00:00 2026-02-24T07:18:30.892 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:30.892 INFO:teuthology.orchestra.run.trial195.stdout:Total 185 kB/s | 37 kB 00:00 2026-02-24T07:18:30.893 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:18:30.895 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:18:30.895 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:18:30.897 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:18:30.898 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:18:30.920 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:18:30.938 INFO:teuthology.orchestra.run.trial195.stdout: Installing : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:31.002 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:31.065 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:31.066 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:31.066 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:18:31.066 INFO:teuthology.orchestra.run.trial195.stdout: libcephfs-devel-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:31.066 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:31.066 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:31.093 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install librados2 2026-02-24T07:18:31.410 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:33 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:31.477 INFO:teuthology.orchestra.run.trial195.stdout:Package librados2-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:31.495 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:31.496 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:31.496 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:31.516 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install librbd1 2026-02-24T07:18:31.832 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:33 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:31.899 INFO:teuthology.orchestra.run.trial195.stdout:Package librbd1-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:31.917 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:31.917 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:31.917 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:31.940 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-rados 2026-02-24T07:18:32.255 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:34 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:32.322 INFO:teuthology.orchestra.run.trial195.stdout:Package python3-rados-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:32.339 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:32.340 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:32.340 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:32.361 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-rgw 2026-02-24T07:18:32.676 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:34 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:32.741 INFO:teuthology.orchestra.run.trial195.stdout:Package python3-rgw-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:32.759 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:32.759 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:32.759 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:32.780 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-cephfs 2026-02-24T07:18:33.097 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:35 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:33.163 INFO:teuthology.orchestra.run.trial195.stdout:Package python3-cephfs-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:33.181 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:33.181 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:33.181 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:33.203 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install python3-rbd 2026-02-24T07:18:33.522 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:35 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:33.588 INFO:teuthology.orchestra.run.trial195.stdout:Package python3-rbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:33.606 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:33.607 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:33.607 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:33.629 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install rbd-fuse 2026-02-24T07:18:33.948 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:35 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:34.032 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:34.033 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:34.034 INFO:teuthology.orchestra.run.trial195.stdout: Package Architecture Version Repository Size 2026-02-24T07:18:34.034 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:34.034 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:18:34.034 INFO:teuthology.orchestra.run.trial195.stdout: rbd-fuse x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 86 k 2026-02-24T07:18:34.034 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:34.034 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:18:34.034 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:34.034 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T07:18:34.034 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:34.035 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 86 k 2026-02-24T07:18:34.035 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 236 k 2026-02-24T07:18:34.035 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:18:34.438 INFO:teuthology.orchestra.run.trial195.stdout:rbd-fuse-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 214 kB/s | 86 kB 00:00 2026-02-24T07:18:34.438 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:34.438 INFO:teuthology.orchestra.run.trial195.stdout:Total 214 kB/s | 86 kB 00:00 2026-02-24T07:18:34.438 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:18:34.442 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:18:34.442 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:18:34.474 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:18:34.474 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:18:34.525 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:18:34.543 INFO:teuthology.orchestra.run.trial195.stdout: Installing : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:34.629 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:34.693 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:34.693 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:34.694 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:18:34.694 INFO:teuthology.orchestra.run.trial195.stdout: rbd-fuse-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:34.694 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:34.694 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:34.723 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install rbd-mirror 2026-02-24T07:18:35.037 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:37 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:35.120 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:35.120 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:35.120 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T07:18:35.120 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:35.121 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:18:35.121 INFO:teuthology.orchestra.run.trial195.stdout: rbd-mirror x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 2.6 M 2026-02-24T07:18:35.121 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:35.121 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:18:35.121 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:35.121 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T07:18:35.121 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:35.121 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 2.6 M 2026-02-24T07:18:35.121 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 11 M 2026-02-24T07:18:35.121 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:18:35.622 INFO:teuthology.orchestra.run.trial195.stdout:rbd-mirror-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 5.2 MB/s | 2.6 MB 00:00 2026-02-24T07:18:35.623 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:35.623 INFO:teuthology.orchestra.run.trial195.stdout:Total 5.2 MB/s | 2.6 MB 00:00 2026-02-24T07:18:35.623 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:18:35.628 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:18:35.628 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:18:35.668 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:18:35.668 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:18:35.832 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:18:35.833 INFO:teuthology.orchestra.run.trial195.stdout: Installing : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:35.856 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:35.857 INFO:teuthology.orchestra.run.trial195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T07:18:35.857 INFO:teuthology.orchestra.run.trial195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T07:18:35.857 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T07:18:35.857 INFO:teuthology.orchestra.run.trial195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T07:18:35.857 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:36.196 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:36.196 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:36.196 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:18:36.196 INFO:teuthology.orchestra.run.trial195.stdout: rbd-mirror-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:36.197 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:36.197 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:36.225 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install rbd-nbd 2026-02-24T07:18:36.544 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:38 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:36.627 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:36.628 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:36.628 INFO:teuthology.orchestra.run.trial195.stdout: Package Architecture Version Repository Size 2026-02-24T07:18:36.628 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:36.628 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:18:36.628 INFO:teuthology.orchestra.run.trial195.stdout: rbd-nbd x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 166 k 2026-02-24T07:18:36.628 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:36.628 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:18:36.628 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:36.628 INFO:teuthology.orchestra.run.trial195.stdout:Install 1 Package 2026-02-24T07:18:36.628 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:36.629 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 166 k 2026-02-24T07:18:36.629 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 496 k 2026-02-24T07:18:36.629 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:18:37.074 INFO:teuthology.orchestra.run.trial195.stdout:rbd-nbd-20.3.0-5440.gff63f3d9.el9.x86_64.rpm 373 kB/s | 166 kB 00:00 2026-02-24T07:18:37.074 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:37.075 INFO:teuthology.orchestra.run.trial195.stdout:Total 372 kB/s | 166 kB 00:00 2026-02-24T07:18:37.075 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:18:37.079 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:18:37.079 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:18:37.111 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:18:37.111 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:18:37.168 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:18:37.185 INFO:teuthology.orchestra.run.trial195.stdout: Installing : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:37.272 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:37.335 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/1 2026-02-24T07:18:37.335 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:37.335 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:18:37.335 INFO:teuthology.orchestra.run.trial195.stdout: rbd-nbd-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:18:37.335 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:37.335 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:37.365 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-osd-crimson 2026-02-24T07:18:37.696 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:39 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:37.762 INFO:teuthology.orchestra.run.trial195.stdout:Package ceph-osd-crimson-2:20.3.0-5440.gff63f3d9.el9.x86_64 is already installed. 2026-02-24T07:18:37.779 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:37.780 INFO:teuthology.orchestra.run.trial195.stdout:Nothing to do. 2026-02-24T07:18:37.780 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:18:37.802 DEBUG:teuthology.orchestra.run.trial195:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-24T07:18:38.118 INFO:teuthology.orchestra.run.trial195.stdout:Last metadata expiration check: 0:01:40 ago on Tue 24 Feb 2026 07:16:58 AM UTC. 2026-02-24T07:18:38.201 INFO:teuthology.orchestra.run.trial195.stdout:Dependencies resolved. 2026-02-24T07:18:38.202 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:38.202 INFO:teuthology.orchestra.run.trial195.stdout: Package Arch Version Repo Size 2026-02-24T07:18:38.202 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:38.202 INFO:teuthology.orchestra.run.trial195.stdout:Installing: 2026-02-24T07:18:38.202 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 429 M 2026-02-24T07:18:38.202 INFO:teuthology.orchestra.run.trial195.stdout:Installing weak dependencies: 2026-02-24T07:18:38.202 INFO:teuthology.orchestra.run.trial195.stdout: ceph-debugsource x86_64 2:20.3.0-5440.gff63f3d9.el9 ceph 12 M 2026-02-24T07:18:38.202 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:38.202 INFO:teuthology.orchestra.run.trial195.stdout:Transaction Summary 2026-02-24T07:18:38.202 INFO:teuthology.orchestra.run.trial195.stdout:================================================================================ 2026-02-24T07:18:38.203 INFO:teuthology.orchestra.run.trial195.stdout:Install 2 Packages 2026-02-24T07:18:38.203 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:18:38.203 INFO:teuthology.orchestra.run.trial195.stdout:Total download size: 441 M 2026-02-24T07:18:38.203 INFO:teuthology.orchestra.run.trial195.stdout:Installed size: 2.7 G 2026-02-24T07:18:38.203 INFO:teuthology.orchestra.run.trial195.stdout:Downloading Packages: 2026-02-24T07:18:41.390 INFO:teuthology.orchestra.run.trial195.stdout:(1/2): ceph-debugsource-20.3.0-5440.gff63f3d9.e 3.8 MB/s | 12 MB 00:03 2026-02-24T07:18:51.172 INFO:teuthology.orchestra.run.trial022.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5440.g 14 MB/s | 429 MB 00:31 2026-02-24T07:18:51.174 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:18:51.174 INFO:teuthology.orchestra.run.trial022.stdout:Total 14 MB/s | 441 MB 00:31 2026-02-24T07:18:51.174 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction check 2026-02-24T07:18:51.179 INFO:teuthology.orchestra.run.trial022.stdout:Transaction check succeeded. 2026-02-24T07:18:51.179 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction test 2026-02-24T07:18:52.540 INFO:teuthology.orchestra.run.trial022.stdout:Transaction test succeeded. 2026-02-24T07:18:52.540 INFO:teuthology.orchestra.run.trial022.stdout:Running transaction 2026-02-24T07:18:56.115 INFO:teuthology.orchestra.run.trial022.stdout: Preparing : 1/1 2026-02-24T07:19:11.186 INFO:teuthology.orchestra.run.trial195.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5440.g 13 MB/s | 429 MB 00:32 2026-02-24T07:19:11.187 INFO:teuthology.orchestra.run.trial195.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:19:11.188 INFO:teuthology.orchestra.run.trial195.stdout:Total 13 MB/s | 441 MB 00:32 2026-02-24T07:19:11.188 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction check 2026-02-24T07:19:11.192 INFO:teuthology.orchestra.run.trial195.stdout:Transaction check succeeded. 2026-02-24T07:19:11.193 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction test 2026-02-24T07:19:12.557 INFO:teuthology.orchestra.run.trial195.stdout:Transaction test succeeded. 2026-02-24T07:19:12.558 INFO:teuthology.orchestra.run.trial195.stdout:Running transaction 2026-02-24T07:19:16.152 INFO:teuthology.orchestra.run.trial195.stdout: Preparing : 1/1 2026-02-24T07:19:18.183 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T07:19:18.201 INFO:teuthology.orchestra.run.trial022.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:19:20.143 INFO:teuthology.orchestra.run.trial022.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:19:20.143 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T07:19:20.207 INFO:teuthology.orchestra.run.trial022.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:19:20.207 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:19:20.208 INFO:teuthology.orchestra.run.trial022.stdout:Installed: 2026-02-24T07:19:20.208 INFO:teuthology.orchestra.run.trial022.stdout: ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:19:20.208 INFO:teuthology.orchestra.run.trial022.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:19:20.208 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:19:20.208 INFO:teuthology.orchestra.run.trial022.stdout:Complete! 2026-02-24T07:19:20.287 DEBUG:teuthology.parallel:result is None 2026-02-24T07:19:39.181 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T07:19:39.200 INFO:teuthology.orchestra.run.trial195.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:19:41.171 INFO:teuthology.orchestra.run.trial195.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:19:41.171 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 1/2 2026-02-24T07:19:41.235 INFO:teuthology.orchestra.run.trial195.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.e 2/2 2026-02-24T07:19:41.236 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:19:41.236 INFO:teuthology.orchestra.run.trial195.stdout:Installed: 2026-02-24T07:19:41.236 INFO:teuthology.orchestra.run.trial195.stdout: ceph-debugsource-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:19:41.236 INFO:teuthology.orchestra.run.trial195.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5440.gff63f3d9.el9.x86_64 2026-02-24T07:19:41.236 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:19:41.236 INFO:teuthology.orchestra.run.trial195.stdout:Complete! 2026-02-24T07:19:41.314 DEBUG:teuthology.parallel:result is None 2026-02-24T07:19:41.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:19:41.485 DEBUG:teuthology.orchestra.run.trial022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T07:19:41.506 INFO:teuthology.orchestra.run.trial022.stdout:20.3.0-5440.gff63f3d9.el9 2026-02-24T07:19:41.507 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5440.gff63f3d9.el9 2026-02-24T07:19:41.507 INFO:teuthology.task.install:The correct ceph version 20.3.0-5440.gff63f3d9 is installed. 2026-02-24T07:19:41.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:19:41.629 DEBUG:teuthology.orchestra.run.trial195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T07:19:41.650 INFO:teuthology.orchestra.run.trial195.stdout:20.3.0-5440.gff63f3d9.el9 2026-02-24T07:19:41.650 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5440.gff63f3d9.el9 2026-02-24T07:19:41.650 INFO:teuthology.task.install:The correct ceph version 20.3.0-5440.gff63f3d9 is installed. 2026-02-24T07:19:41.652 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T07:19:41.652 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:19:41.653 DEBUG:teuthology.orchestra.run.trial022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T07:19:41.678 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:19:41.678 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T07:19:41.715 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T07:19:41.716 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:19:41.716 DEBUG:teuthology.orchestra.run.trial022:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T07:19:41.742 DEBUG:teuthology.orchestra.run.trial022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T07:19:41.805 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:19:41.805 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T07:19:41.831 DEBUG:teuthology.orchestra.run.trial195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T07:19:41.895 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T07:19:41.896 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:19:41.896 DEBUG:teuthology.orchestra.run.trial022:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T07:19:41.921 DEBUG:teuthology.orchestra.run.trial022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T07:19:41.984 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:19:41.984 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T07:19:42.010 DEBUG:teuthology.orchestra.run.trial195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T07:19:42.073 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T07:19:42.074 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:19:42.074 DEBUG:teuthology.orchestra.run.trial022:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T07:19:42.099 DEBUG:teuthology.orchestra.run.trial022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T07:19:42.164 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:19:42.165 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T07:19:42.190 DEBUG:teuthology.orchestra.run.trial195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T07:19:42.254 INFO:teuthology.run_tasks:Running task pexec... 2026-02-24T07:19:42.273 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-24T07:19:42.274 DEBUG:teuthology.orchestra.run.trial022:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-24T07:19:42.275 DEBUG:teuthology.orchestra.run.trial195:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-24T07:19:42.278 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial022.front.sepia.ceph.com 2026-02-24T07:19:42.278 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-24T07:19:42.297 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial195.front.sepia.ceph.com 2026-02-24T07:19:42.297 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-24T07:19:42.328 DEBUG:teuthology.parallel:result is None 2026-02-24T07:19:42.348 DEBUG:teuthology.parallel:result is None 2026-02-24T07:19:42.348 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-24T07:19:42.471 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1, 'debug osd': 10}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd objectstore': 'seastore', 'osd shutdown pgref assert': True, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'osd_type': 'crimson', 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017'} 2026-02-24T07:19:42.471 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:19:42.475 INFO:tasks.cephadm:Cluster fsid is 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:19:42.475 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-24T07:19:42.475 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.22'} 2026-02-24T07:19:42.475 INFO:tasks.cephadm:First mon is mon.a on trial022 2026-02-24T07:19:42.475 INFO:tasks.cephadm:First mgr is x 2026-02-24T07:19:42.475 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-24T07:19:42.475 DEBUG:teuthology.orchestra.run.trial022:> sudo hostname $(hostname -s) 2026-02-24T07:19:42.499 DEBUG:teuthology.orchestra.run.trial195:> sudo hostname $(hostname -s) 2026-02-24T07:19:42.525 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-24T07:19:42.525 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:19:42.660 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/flavors/debug/', 'ref': 'wip-shraddhaag-enable-cephadm-tests', 'sha1': 'ff63f3d997e38f69382fd23ac0206f07f7b05017', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-24 05:52:36.050311', 'status': 'ready', 'flavor': 'debug', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '20.3.0-5440-gff63f3d9', 'package_manager_version': '20.3.0-5440.gff63f3d9', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3219/', 'root_build_cause': '', 'node_name': '10.20.192.97+toko07', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-24T07:19:42.799 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-shraddhaag-enable-cephadm-tests, sha1 ff63f3d997e38f69382fd23ac0206f07f7b05017 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=debug&sha1=ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:19:42.800 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm 2026-02-24T07:19:42.800 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm 2026-02-24T07:19:42.801 DEBUG:teuthology.orchestra.run.trial022:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T07:19:43.656 INFO:teuthology.orchestra.run.trial022.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076667 Feb 24 07:19 /home/ubuntu/cephtest/cephadm 2026-02-24T07:19:43.656 DEBUG:teuthology.orchestra.run.trial195:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-shraddhaag-enable-cephadm-tests/ff63f3d997e38f69382fd23ac0206f07f7b05017/centos/9/x86_64/flavors/debug/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-24T07:19:44.561 INFO:teuthology.orchestra.run.trial195.stdout:-rw-r--r--. 1 ubuntu ubuntu 1076667 Feb 24 07:19 /home/ubuntu/cephtest/cephadm 2026-02-24T07:19:44.562 DEBUG:teuthology.orchestra.run.trial022:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T07:19:44.581 DEBUG:teuthology.orchestra.run.trial195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-24T07:19:44.615 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 on all hosts... 2026-02-24T07:19:44.615 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 pull 2026-02-24T07:19:44.624 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 pull 2026-02-24T07:19:44.776 INFO:teuthology.orchestra.run.trial022.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T07:19:44.795 INFO:teuthology.orchestra.run.trial195.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T07:19:56.095 INFO:teuthology.orchestra.run.trial195.stdout:{ 2026-02-24T07:19:56.095 INFO:teuthology.orchestra.run.trial195.stdout: "ceph_version": "ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev)", 2026-02-24T07:19:56.095 INFO:teuthology.orchestra.run.trial195.stdout: "image_id": "3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85", 2026-02-24T07:19:56.095 INFO:teuthology.orchestra.run.trial195.stdout: "repo_digests": [ 2026-02-24T07:19:56.095 INFO:teuthology.orchestra.run.trial195.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148" 2026-02-24T07:19:56.096 INFO:teuthology.orchestra.run.trial195.stdout: ] 2026-02-24T07:19:56.096 INFO:teuthology.orchestra.run.trial195.stdout:} 2026-02-24T07:19:56.182 INFO:teuthology.orchestra.run.trial022.stdout:{ 2026-02-24T07:19:56.182 INFO:teuthology.orchestra.run.trial022.stdout: "ceph_version": "ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev)", 2026-02-24T07:19:56.182 INFO:teuthology.orchestra.run.trial022.stdout: "image_id": "3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85", 2026-02-24T07:19:56.182 INFO:teuthology.orchestra.run.trial022.stdout: "repo_digests": [ 2026-02-24T07:19:56.182 INFO:teuthology.orchestra.run.trial022.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148" 2026-02-24T07:19:56.182 INFO:teuthology.orchestra.run.trial022.stdout: ] 2026-02-24T07:19:56.182 INFO:teuthology.orchestra.run.trial022.stdout:} 2026-02-24T07:19:56.198 DEBUG:teuthology.orchestra.run.trial022:> sudo mkdir -p /etc/ceph 2026-02-24T07:19:56.273 DEBUG:teuthology.orchestra.run.trial195:> sudo mkdir -p /etc/ceph 2026-02-24T07:19:56.303 DEBUG:teuthology.orchestra.run.trial022:> sudo chmod 777 /etc/ceph 2026-02-24T07:19:56.327 DEBUG:teuthology.orchestra.run.trial195:> sudo chmod 777 /etc/ceph 2026-02-24T07:19:56.371 INFO:tasks.cephadm:Writing seed config... 2026-02-24T07:19:56.374 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-24T07:19:56.374 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-24T07:19:56.374 INFO:tasks.cephadm: override: [mgr] debug osd = 10 2026-02-24T07:19:56.374 INFO:tasks.cephadm: override: [client] debug ms = 1 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [global] enable experimental unrecoverable data corrupting features = crimson 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [global] ms client mode = crc 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [global] ms cluster mode = crc 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [global] ms mon client mode = crc 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [global] ms mon cluster mode = crc 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [global] ms mon service mode = crc 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [global] ms service mode = crc 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2026-02-24T07:19:56.375 INFO:tasks.cephadm: override: [mon] osd pool default crimson = True 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] crimson cpu num = 4 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] crimson osd obc lru size = 10 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug ms = 20 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug seastore = 20 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug seastore backref = 20 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug seastore cache = 20 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug seastore cleaner = 20 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug seastore device = 20 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug seastore epm = 20 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug seastore fixedkv tree = 20 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug seastore journal = 20 2026-02-24T07:19:56.376 INFO:tasks.cephadm: override: [osd] debug seastore lba = 20 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] debug seastore odata = 20 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] debug seastore omap = 20 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] debug seastore onode = 20 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] debug seastore t = 20 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] debug seastore tm = 20 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] osd blocked scrub grace period = 3600 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] osd class default list = * 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] osd class load list = * 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] osd objectstore = seastore 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] seastore cachepin size pershard = 64M 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] seastore cachepin type = 2Q 2026-02-24T07:19:56.377 INFO:tasks.cephadm: override: [osd] seastore max concurrent transactions = 8 2026-02-24T07:19:56.379 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:19:56.379 DEBUG:teuthology.orchestra.run.trial022:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-24T07:19:56.396 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 30400272-1151-11f1-be09-d404e6e7d460 enable experimental unrecoverable data corrupting features = crimson ms client mode = crc ms cluster mode = crc ms mon client mode = crc ms mon cluster mode = crc ms mon service mode = crc ms service mode = crc [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true crimson cpu num = 4 crimson osd obc lru size = 10 debug ms = 20 debug osd = 20 debug seastore = 20 debug seastore backref = 20 debug seastore cache = 20 debug seastore cleaner = 20 debug seastore device = 20 debug seastore epm = 20 debug seastore fixedkv tree = 20 debug seastore journal = 20 debug seastore lba = 20 debug seastore odata = 20 debug seastore omap = 20 debug seastore onode = 20 debug seastore t = 20 debug seastore tm = 20 osd blocked scrub grace period = 3600 osd class default list = * osd class load list = * osd objectstore = seastore seastore cachepin size pershard = 64M seastore cachepin type = 2Q seastore max concurrent transactions = 8 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 debug osd = 10 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False osd pool default crimson = True [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2026-02-24T07:19:56.396 DEBUG:teuthology.orchestra.run.trial022:mon.a> sudo journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@mon.a.service 2026-02-24T07:19:56.438 DEBUG:teuthology.orchestra.run.trial022:mgr.x> sudo journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@mgr.x.service 2026-02-24T07:19:56.480 INFO:tasks.cephadm:Bootstrapping... 2026-02-24T07:19:56.480 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 -v bootstrap --fsid 30400272-1151-11f1-be09-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.22 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-24T07:19:56.622 INFO:teuthology.orchestra.run.trial022.stdout:-------------------------------------------------------------------------------- 2026-02-24T07:19:56.622 INFO:teuthology.orchestra.run.trial022.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017', '-v', 'bootstrap', '--fsid', '30400272-1151-11f1-be09-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.22', '--skip-admin-label'] 2026-02-24T07:19:56.622 INFO:teuthology.orchestra.run.trial022.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-24T07:19:56.623 INFO:teuthology.orchestra.run.trial022.stdout:Verifying podman|docker is present... 2026-02-24T07:19:56.637 INFO:teuthology.orchestra.run.trial022.stdout:/bin/podman: stdout 5.8.0 2026-02-24T07:19:56.637 INFO:teuthology.orchestra.run.trial022.stdout:Verifying lvm2 is present... 2026-02-24T07:19:56.637 INFO:teuthology.orchestra.run.trial022.stdout:Verifying time synchronization is in place... 2026-02-24T07:19:56.643 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T07:19:56.643 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T07:19:56.649 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T07:19:56.649 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout inactive 2026-02-24T07:19:56.655 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout enabled 2026-02-24T07:19:56.661 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout active 2026-02-24T07:19:56.661 INFO:teuthology.orchestra.run.trial022.stdout:Unit chronyd.service is enabled and running 2026-02-24T07:19:56.661 INFO:teuthology.orchestra.run.trial022.stdout:Repeating the final host check... 2026-02-24T07:19:56.675 INFO:teuthology.orchestra.run.trial022.stdout:/bin/podman: stdout 5.8.0 2026-02-24T07:19:56.675 INFO:teuthology.orchestra.run.trial022.stdout:podman (/bin/podman) version 5.8.0 is present 2026-02-24T07:19:56.676 INFO:teuthology.orchestra.run.trial022.stdout:systemctl is present 2026-02-24T07:19:56.676 INFO:teuthology.orchestra.run.trial022.stdout:lvcreate is present 2026-02-24T07:19:56.680 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-24T07:19:56.681 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-24T07:19:56.686 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-24T07:19:56.686 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout inactive 2026-02-24T07:19:56.691 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout enabled 2026-02-24T07:19:56.697 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout active 2026-02-24T07:19:56.697 INFO:teuthology.orchestra.run.trial022.stdout:Unit chronyd.service is enabled and running 2026-02-24T07:19:56.697 INFO:teuthology.orchestra.run.trial022.stdout:Host looks OK 2026-02-24T07:19:56.697 INFO:teuthology.orchestra.run.trial022.stdout:Cluster fsid: 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:19:56.697 INFO:teuthology.orchestra.run.trial022.stdout:Acquiring lock 139746876304352 on /run/cephadm/30400272-1151-11f1-be09-d404e6e7d460.lock 2026-02-24T07:19:56.697 INFO:teuthology.orchestra.run.trial022.stdout:Lock 139746876304352 acquired on /run/cephadm/30400272-1151-11f1-be09-d404e6e7d460.lock 2026-02-24T07:19:56.697 INFO:teuthology.orchestra.run.trial022.stdout:Verifying IP 10.20.193.22 port 3300 ... 2026-02-24T07:19:56.698 INFO:teuthology.orchestra.run.trial022.stdout:Verifying IP 10.20.193.22 port 6789 ... 2026-02-24T07:19:56.698 INFO:teuthology.orchestra.run.trial022.stdout:Base mon IP(s) is [10.20.193.22:3300, 10.20.193.22:6789], mon addrv is [v2:10.20.193.22:3300,v1:10.20.193.22:6789] 2026-02-24T07:19:56.701 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.22 metric 102 2026-02-24T07:19:56.701 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.22 metric 102 2026-02-24T07:19:56.701 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-24T07:19:56.703 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-24T07:19:56.703 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-24T07:19:56.703 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-24T07:19:56.706 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-24T07:19:56.706 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-24T07:19:56.706 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T07:19:56.706 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-24T07:19:56.707 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout inet6 fe80::a2f1:5b6c:2ea3:36d4/64 scope link noprefixroute 2026-02-24T07:19:56.707 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T07:19:56.707 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-24T07:19:56.707 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:6350/64 scope link 2026-02-24T07:19:56.707 INFO:teuthology.orchestra.run.trial022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-24T07:19:56.707 INFO:teuthology.orchestra.run.trial022.stdout:Mon IP `10.20.193.22` is in CIDR network `10.20.192.0/20` 2026-02-24T07:19:56.707 INFO:teuthology.orchestra.run.trial022.stdout:Mon IP `10.20.193.22` is in CIDR network `10.20.192.0/20` 2026-02-24T07:19:56.707 INFO:teuthology.orchestra.run.trial022.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-24T07:19:56.707 INFO:teuthology.orchestra.run.trial022.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-24T07:19:56.708 INFO:teuthology.orchestra.run.trial022.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T07:19:56.936 INFO:teuthology.orchestra.run.trial022.stdout:/bin/podman: stdout 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 2026-02-24T07:19:56.936 INFO:teuthology.orchestra.run.trial022.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017... 2026-02-24T07:19:56.937 INFO:teuthology.orchestra.run.trial022.stdout:/bin/podman: stderr Getting image source signatures 2026-02-24T07:19:56.937 INFO:teuthology.orchestra.run.trial022.stdout:/bin/podman: stderr Copying blob sha256:34ff0ae581cc4b523b1cc31578790f86bdcdd88215c5534f4c04451410e82346 2026-02-24T07:19:56.937 INFO:teuthology.orchestra.run.trial022.stdout:/bin/podman: stderr Copying blob sha256:8e380faede39ebd4286247457b408d979ab568aafd8389c42ec304b8cfba4e92 2026-02-24T07:19:56.937 INFO:teuthology.orchestra.run.trial022.stdout:/bin/podman: stderr Copying config sha256:3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 2026-02-24T07:19:56.937 INFO:teuthology.orchestra.run.trial022.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-24T07:19:57.051 INFO:teuthology.orchestra.run.trial022.stdout:ceph: stdout ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev) 2026-02-24T07:19:57.051 INFO:teuthology.orchestra.run.trial022.stdout:Ceph version: ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev) 2026-02-24T07:19:57.051 INFO:teuthology.orchestra.run.trial022.stdout:Extracting ceph user uid/gid from container image... 2026-02-24T07:19:57.162 INFO:teuthology.orchestra.run.trial022.stdout:stat: stdout 167 167 2026-02-24T07:19:57.163 INFO:teuthology.orchestra.run.trial022.stdout:Creating initial keys... 2026-02-24T07:19:57.283 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph-authtool: stdout AQAdUZ1pn9wSEBAARtWmk4qAOry40t4ZbWjC4w== 2026-02-24T07:19:57.398 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph-authtool: stdout AQAdUZ1pv0D9FhAALPCWbc/ssinej1rSiWU5BA== 2026-02-24T07:19:57.528 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph-authtool: stdout AQAdUZ1pV56sHhAARbdgVNrGXwlnSZa7HWD54w== 2026-02-24T07:19:57.528 INFO:teuthology.orchestra.run.trial022.stdout:Creating initial monmap... 2026-02-24T07:19:57.664 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T07:19:57.664 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-24T07:19:57.664 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:19:57.664 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T07:19:57.664 INFO:teuthology.orchestra.run.trial022.stdout:monmaptool for a [v2:10.20.193.22:3300,v1:10.20.193.22:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-24T07:19:57.664 INFO:teuthology.orchestra.run.trial022.stdout:setting min_mon_release = tentacle 2026-02-24T07:19:57.665 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/monmaptool: set fsid to 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:19:57.665 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-24T07:19:57.665 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:19:57.665 INFO:teuthology.orchestra.run.trial022.stdout:Creating mon... 2026-02-24T07:19:57.801 INFO:teuthology.orchestra.run.trial022.stdout:create mon.a on 2026-02-24T07:19:57.969 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-24T07:19:58.073 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-24T07:19:58.179 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-30400272-1151-11f1-be09-d404e6e7d460.target → /etc/systemd/system/ceph-30400272-1151-11f1-be09-d404e6e7d460.target. 2026-02-24T07:19:58.179 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-30400272-1151-11f1-be09-d404e6e7d460.target → /etc/systemd/system/ceph-30400272-1151-11f1-be09-d404e6e7d460.target. 2026-02-24T07:19:58.317 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-30400272-1151-11f1-be09-d404e6e7d460@mon.a 2026-02-24T07:19:58.317 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-30400272-1151-11f1-be09-d404e6e7d460@mon.a.service: Unit ceph-30400272-1151-11f1-be09-d404e6e7d460@mon.a.service not loaded. 2026-02-24T07:19:58.437 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-30400272-1151-11f1-be09-d404e6e7d460.target.wants/ceph-30400272-1151-11f1-be09-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-30400272-1151-11f1-be09-d404e6e7d460@.service. 2026-02-24T07:19:58.581 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T07:19:58.581 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout disabled 2026-02-24T07:19:58.587 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T07:19:58.587 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout inactive 2026-02-24T07:19:58.587 INFO:teuthology.orchestra.run.trial022.stdout:firewalld.service is not enabled 2026-02-24T07:19:58.588 INFO:teuthology.orchestra.run.trial022.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T07:19:58.588 INFO:teuthology.orchestra.run.trial022.stdout:Waiting for mon to start... 2026-02-24T07:19:58.588 INFO:teuthology.orchestra.run.trial022.stdout:Waiting for mon... 2026-02-24T07:19:58.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout cluster: 2026-02-24T07:19:58.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout id: 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:19:58.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-24T07:19:58.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:19:58.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout services: 2026-02-24T07:19:58.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.129731s) [leader: a] 2026-02-24T07:19:58.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-24T07:19:58.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-24T07:19:58.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:19:58.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout data: 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout pgs: 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.681+0000 7fc476ff0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.682+0000 7fc476ff0640 1 Processor -- start 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.682+0000 7fc476ff0640 1 -- start start 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.682+0000 7fc476ff0640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc47011cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.682+0000 7fc476ff0640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc47011d3e0 con 0x7fc47011ca00 2026-02-24T07:19:58.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.682+0000 7fc474d65640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc47011cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.683+0000 7fc474d65640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc47011cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35364/0 (socket says 10.20.193.22:35364) 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.683+0000 7fc474d65640 1 -- 10.20.193.22:0/4145303132 learned_addr learned my addr 10.20.193.22:0/4145303132 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.683+0000 7fc474d65640 1 -- 10.20.193.22:0/4145303132 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47011d520 con 0x7fc47011ca00 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc474d65640 1 --2- 10.20.193.22:0/4145303132 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc47011cdf0 crc :-1 s=READY pgs=1 gs=1 cs=0 l=1 c_cookie=4972438443337722191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4501a66b4aa4294f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc4677fe640 1 -- 10.20.193.22:0/4145303132 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc460009d40 con 0x7fc47011ca00 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc4677fe640 1 -- 10.20.193.22:0/4145303132 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc46000e230 con 0x7fc47011ca00 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc4677fe640 1 -- 10.20.193.22:0/4145303132 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc460009ea0 con 0x7fc47011ca00 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc476ff0640 1 -- 10.20.193.22:0/4145303132 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 msgr2=0x7fc47011cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc476ff0640 1 --2- 10.20.193.22:0/4145303132 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc47011cdf0 crc :-1 s=READY pgs=1 gs=1 cs=0 l=1 c_cookie=4972438443337722191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc476ff0640 1 -- 10.20.193.22:0/4145303132 shutdown_connections 2026-02-24T07:19:58.748 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc476ff0640 1 --2- 10.20.193.22:0/4145303132 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc47011cdf0 unknown :-1 s=CLOSED pgs=1 gs=1 cs=0 l=1 c_cookie=4972438443337722191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc476ff0640 1 -- 10.20.193.22:0/4145303132 >> 10.20.193.22:0/4145303132 conn(0x7fc470057f30 msgr2=0x7fc470058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc476ff0640 1 -- 10.20.193.22:0/4145303132 shutdown_connections 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.684+0000 7fc476ff0640 1 -- 10.20.193.22:0/4145303132 wait complete. 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc476ff0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc476ff0640 1 Processor -- start 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc476ff0640 1 -- start start 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc476ff0640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc470108fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc476ff0640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc470109510 con 0x7fc47011ca00 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc474d65640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc470108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc474d65640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc470108fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35370/0 (socket says 10.20.193.22:35370) 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc474d65640 1 -- 10.20.193.22:0/3449068717 learned_addr learned my addr 10.20.193.22:0/3449068717 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:19:58.749 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc474d65640 1 -- 10.20.193.22:0/3449068717 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc470109650 con 0x7fc47011ca00 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc474d65640 1 --2- 10.20.193.22:0/3449068717 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc470108fb0 crc :-1 s=READY pgs=2 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc465ffb640 1 -- 10.20.193.22:0/3449068717 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc460009ea0 con 0x7fc47011ca00 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc465ffb640 1 -- 10.20.193.22:0/3449068717 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc460015420 con 0x7fc47011ca00 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc476ff0640 1 -- 10.20.193.22:0/3449068717 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4701098a0 con 0x7fc47011ca00 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc465ffb640 1 -- 10.20.193.22:0/3449068717 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc4600156d0 con 0x7fc47011ca00 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc476ff0640 1 -- 10.20.193.22:0/3449068717 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47010a210 con 0x7fc47011ca00 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc465ffb640 1 -- 10.20.193.22:0/3449068717 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (crc 0 0 0) 0x7fc460015c90 con 0x7fc47011ca00 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.685+0000 7fc465ffb640 1 -- 10.20.193.22:0/3449068717 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7fc4600138b0 con 0x7fc47011ca00 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.686+0000 7fc476ff0640 1 -- 10.20.193.22:0/3449068717 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc47011e6a0 con 0x7fc47011ca00 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.687+0000 7fc465ffb640 1 -- 10.20.193.22:0/3449068717 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (crc 0 0 0) 0x7fc460009430 con 0x7fc47011ca00 2026-02-24T07:19:58.750 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.719+0000 7fc476ff0640 1 -- 10.20.193.22:0/3449068717 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fc47010a4e0 con 0x7fc47011ca00 2026-02-24T07:19:58.751 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.719+0000 7fc465ffb640 1 -- 10.20.193.22:0/3449068717 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+329 (crc 0 0 0) 0x7fc460013a70 con 0x7fc47011ca00 2026-02-24T07:19:58.751 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.719+0000 7fc476ff0640 1 -- 10.20.193.22:0/3449068717 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 msgr2=0x7fc470108fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:19:58.751 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.719+0000 7fc476ff0640 1 --2- 10.20.193.22:0/3449068717 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc470108fb0 crc :-1 s=READY pgs=2 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:58.751 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.719+0000 7fc476ff0640 1 -- 10.20.193.22:0/3449068717 shutdown_connections 2026-02-24T07:19:58.751 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.720+0000 7fc476ff0640 1 --2- 10.20.193.22:0/3449068717 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc47011ca00 0x7fc470108fb0 unknown :-1 s=CLOSED pgs=2 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:58.751 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.720+0000 7fc476ff0640 1 -- 10.20.193.22:0/3449068717 >> 10.20.193.22:0/3449068717 conn(0x7fc470057f30 msgr2=0x7fc4700ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:19:58.751 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.720+0000 7fc476ff0640 1 -- 10.20.193.22:0/3449068717 shutdown_connections 2026-02-24T07:19:58.751 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.720+0000 7fc476ff0640 1 -- 10.20.193.22:0/3449068717 wait complete. 2026-02-24T07:19:58.751 INFO:teuthology.orchestra.run.trial022.stdout:mon is available 2026-02-24T07:19:58.751 INFO:teuthology.orchestra.run.trial022.stdout:Assimilating anything we can from ceph.conf... 2026-02-24T07:19:58.892 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:19:58.892 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T07:19:58.893 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout fsid = 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:19:58.893 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T07:19:58.893 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.22:3300,v1:10.20.193.22:6789] 2026-02-24T07:19:58.893 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T07:19:58.893 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T07:19:58.893 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T07:19:58.893 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T07:19:58.893 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:19:58.893 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T07:19:58.893 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.831+0000 7f9ff2734640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.833+0000 7f9ff2734640 1 Processor -- start 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.833+0000 7f9ff2734640 1 -- start start 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.833+0000 7f9ff2734640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec05bd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.833+0000 7f9ff2734640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec05c290 con 0x7f9fec05b960 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9febfff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec05bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:19:58.894 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9febfff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec05bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35386/0 (socket says 10.20.193.22:35386) 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9febfff640 1 -- 10.20.193.22:0/1017609741 learned_addr learned my addr 10.20.193.22:0/1017609741 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9febfff640 1 -- 10.20.193.22:0/1017609741 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec05c3d0 con 0x7f9fec05b960 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9febfff640 1 --2- 10.20.193.22:0/1017609741 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec05bd50 crc :-1 s=READY pgs=3 gs=1 cs=0 l=1 c_cookie=7234598043092821985 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64667496f348a7e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9feaffd640 1 -- 10.20.193.22:0/1017609741 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f9fd8009d40 con 0x7f9fec05b960 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9feaffd640 1 -- 10.20.193.22:0/1017609741 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9fd800e230 con 0x7f9fec05b960 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9feaffd640 1 -- 10.20.193.22:0/1017609741 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f9fd8009ea0 con 0x7f9fec05b960 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9ff2734640 1 -- 10.20.193.22:0/1017609741 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 msgr2=0x7f9fec05bd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9ff2734640 1 --2- 10.20.193.22:0/1017609741 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec05bd50 crc :-1 s=READY pgs=3 gs=1 cs=0 l=1 c_cookie=7234598043092821985 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9ff2734640 1 -- 10.20.193.22:0/1017609741 shutdown_connections 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9ff2734640 1 --2- 10.20.193.22:0/1017609741 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec05bd50 unknown :-1 s=CLOSED pgs=3 gs=1 cs=0 l=1 c_cookie=7234598043092821985 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9ff2734640 1 -- 10.20.193.22:0/1017609741 >> 10.20.193.22:0/1017609741 conn(0x7f9fec059500 msgr2=0x7f9fec059900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:19:58.895 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9ff2734640 1 -- 10.20.193.22:0/1017609741 shutdown_connections 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.834+0000 7f9ff2734640 1 -- 10.20.193.22:0/1017609741 wait complete. 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9ff2734640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9ff2734640 1 Processor -- start 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9ff2734640 1 -- start start 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9ff2734640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec129460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9ff2734640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1299c0 con 0x7f9fec05b960 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9febfff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec129460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9febfff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec129460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35392/0 (socket says 10.20.193.22:35392) 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9febfff640 1 -- 10.20.193.22:0/4188223081 learned_addr learned my addr 10.20.193.22:0/4188223081 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9febfff640 1 -- 10.20.193.22:0/4188223081 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec129b00 con 0x7f9fec05b960 2026-02-24T07:19:58.896 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9febfff640 1 --2- 10.20.193.22:0/4188223081 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec129460 crc :-1 s=READY pgs=4 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9fe97fa640 1 -- 10.20.193.22:0/4188223081 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f9fd8009ea0 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9fe97fa640 1 -- 10.20.193.22:0/4188223081 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9fd8015420 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9ff2734640 1 -- 10.20.193.22:0/4188223081 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fec129d50 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9fe97fa640 1 -- 10.20.193.22:0/4188223081 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f9fd80156d0 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9ff2734640 1 -- 10.20.193.22:0/4188223081 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fec12a6c0 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9fe97fa640 1 -- 10.20.193.22:0/4188223081 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (crc 0 0 0) 0x7f9fd8015ce0 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.835+0000 7f9fe97fa640 1 -- 10.20.193.22:0/4188223081 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7f9fd8013900 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.836+0000 7f9ff2734640 1 -- 10.20.193.22:0/4188223081 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fec05bd30 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.837+0000 7f9fe97fa640 1 -- 10.20.193.22:0/4188223081 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (crc 0 0 0) 0x7f9fd8013ac0 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.865+0000 7f9ff2734640 1 -- 10.20.193.22:0/4188223081 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f9fec12b150 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.867+0000 7f9fe97fa640 1 -- 10.20.193.22:0/4188223081 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+374 (crc 0 0 0) 0x7f9fd8013ce0 con 0x7f9fec05b960 2026-02-24T07:19:58.897 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.868+0000 7f9ff2734640 1 -- 10.20.193.22:0/4188223081 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 msgr2=0x7f9fec129460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:19:58.898 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.868+0000 7f9ff2734640 1 --2- 10.20.193.22:0/4188223081 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec129460 crc :-1 s=READY pgs=4 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:58.898 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.868+0000 7f9ff2734640 1 -- 10.20.193.22:0/4188223081 shutdown_connections 2026-02-24T07:19:58.898 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.868+0000 7f9ff2734640 1 --2- 10.20.193.22:0/4188223081 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9fec05b960 0x7f9fec129460 unknown :-1 s=CLOSED pgs=4 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:58.898 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.868+0000 7f9ff2734640 1 -- 10.20.193.22:0/4188223081 >> 10.20.193.22:0/4188223081 conn(0x7f9fec059500 msgr2=0x7f9fec11fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:19:58.898 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.868+0000 7f9ff2734640 1 -- 10.20.193.22:0/4188223081 shutdown_connections 2026-02-24T07:19:58.898 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.868+0000 7f9ff2734640 1 -- 10.20.193.22:0/4188223081 wait complete. 2026-02-24T07:19:58.898 INFO:teuthology.orchestra.run.trial022.stdout:Generating new minimal ceph.conf... 2026-02-24T07:19:59.043 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.975+0000 7f7268484640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:59.043 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f7268484640 1 Processor -- start 2026-02-24T07:19:59.043 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f7268484640 1 -- start start 2026-02-24T07:19:59.043 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f7268484640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f726011cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:19:59.043 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f7268484640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f726011d3e0 con 0x7f726011ca00 2026-02-24T07:19:59.043 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f72661f9640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f726011cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f72661f9640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f726011cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35394/0 (socket says 10.20.193.22:35394) 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f72661f9640 1 -- 10.20.193.22:0/3122946872 learned_addr learned my addr 10.20.193.22:0/3122946872 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f72661f9640 1 -- 10.20.193.22:0/3122946872 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726011d520 con 0x7f726011ca00 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f72661f9640 1 --2- 10.20.193.22:0/3122946872 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f726011cdf0 crc :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=17732774010551649993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6177802a535c6c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f72651f7640 1 -- 10.20.193.22:0/3122946872 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f7250009d40 con 0x7f726011ca00 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f72651f7640 1 -- 10.20.193.22:0/3122946872 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(28 keys) ==== 1123+0+0 (crc 0 0 0) 0x7f725000e700 con 0x7f726011ca00 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.977+0000 7f72651f7640 1 -- 10.20.193.22:0/3122946872 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f725000d5f0 con 0x7f726011ca00 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 -- 10.20.193.22:0/3122946872 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 msgr2=0x7f726011cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 --2- 10.20.193.22:0/3122946872 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f726011cdf0 crc :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=17732774010551649993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 -- 10.20.193.22:0/3122946872 shutdown_connections 2026-02-24T07:19:59.044 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 --2- 10.20.193.22:0/3122946872 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f726011cdf0 unknown :-1 s=CLOSED pgs=5 gs=1 cs=0 l=1 c_cookie=17732774010551649993 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 -- 10.20.193.22:0/3122946872 >> 10.20.193.22:0/3122946872 conn(0x7f7260057f30 msgr2=0x7f7260058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 -- 10.20.193.22:0/3122946872 shutdown_connections 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 -- 10.20.193.22:0/3122946872 wait complete. 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 Processor -- start 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 -- start start 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f7260109260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f72601097c0 con 0x7f726011ca00 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f72661f9640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f7260109260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f72661f9640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f7260109260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35396/0 (socket says 10.20.193.22:35396) 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f72661f9640 1 -- 10.20.193.22:0/319363514 learned_addr learned my addr 10.20.193.22:0/319363514 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:19:59.045 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f72661f9640 1 -- 10.20.193.22:0/319363514 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7260109900 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f72661f9640 1 --2- 10.20.193.22:0/319363514 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f7260109260 crc :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f72477fe640 1 -- 10.20.193.22:0/319363514 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f725000d890 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f72477fe640 1 -- 10.20.193.22:0/319363514 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(28 keys) ==== 1123+0+0 (crc 0 0 0) 0x7f725000dec0 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 -- 10.20.193.22:0/319363514 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7260109b50 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f72477fe640 1 -- 10.20.193.22:0/319363514 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f72500133a0 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.978+0000 7f7268484640 1 -- 10.20.193.22:0/319363514 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726010a440 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.979+0000 7f72477fe640 1 -- 10.20.193.22:0/319363514 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (crc 0 0 0) 0x7f7250011040 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.979+0000 7f72477fe640 1 -- 10.20.193.22:0/319363514 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7f7250011650 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.979+0000 7f7268484640 1 -- 10.20.193.22:0/319363514 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726011cdd0 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:58.980+0000 7f72477fe640 1 -- 10.20.193.22:0/319363514 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (crc 0 0 0) 0x7f7250014910 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.010+0000 7f7268484640 1 -- 10.20.193.22:0/319363514 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f726010a710 con 0x7f726011ca00 2026-02-24T07:19:59.046 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.010+0000 7f72477fe640 1 -- 10.20.193.22:0/319363514 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (crc 0 0 0) 0x7f7250012de0 con 0x7f726011ca00 2026-02-24T07:19:59.047 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.010+0000 7f7268484640 1 -- 10.20.193.22:0/319363514 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 msgr2=0x7f7260109260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:19:59.047 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.010+0000 7f7268484640 1 --2- 10.20.193.22:0/319363514 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f7260109260 crc :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.047 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.010+0000 7f7268484640 1 -- 10.20.193.22:0/319363514 shutdown_connections 2026-02-24T07:19:59.047 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.010+0000 7f7268484640 1 --2- 10.20.193.22:0/319363514 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f726011ca00 0x7f7260109260 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.047 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.010+0000 7f7268484640 1 -- 10.20.193.22:0/319363514 >> 10.20.193.22:0/319363514 conn(0x7f7260057f30 msgr2=0x7f72600ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:19:59.047 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.010+0000 7f7268484640 1 -- 10.20.193.22:0/319363514 shutdown_connections 2026-02-24T07:19:59.047 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.010+0000 7f7268484640 1 -- 10.20.193.22:0/319363514 wait complete. 2026-02-24T07:19:59.047 INFO:teuthology.orchestra.run.trial022.stdout:Restarting the monitor... 2026-02-24T07:19:59.237 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a[38671]: 2026-02-24T07:19:59.114+0000 7fc8b7fc4640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T07:19:59.405 INFO:teuthology.orchestra.run.trial022.stdout:Waiting for mon to start after restart... 2026-02-24T07:19:59.405 INFO:teuthology.orchestra.run.trial022.stdout:Waiting for mon... 2026-02-24T07:19:59.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 podman[38953]: 2026-02-24 07:19:59.236111512 +0000 UTC m=+0.133430338 container died b273b900573656ff45aa53ad8b5a23bdc9a6470b1b930c6221c14c3952528075 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017) 2026-02-24T07:19:59.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 podman[38953]: 2026-02-24 07:19:59.244387788 +0000 UTC m=+0.141706594 container remove b273b900573656ff45aa53ad8b5a23bdc9a6470b1b930c6221c14c3952528075 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T07:19:59.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 bash[38953]: ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a 2026-02-24T07:19:59.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 systemd[1]: ceph-30400272-1151-11f1-be09-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-24T07:19:59.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 systemd[1]: Stopped Ceph mon.a for 30400272-1151-11f1-be09-d404e6e7d460. 2026-02-24T07:19:59.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 systemd[1]: Starting Ceph mon.a for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:19:59.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 podman[39081]: 2026-02-24 07:19:59.37301903 +0000 UTC m=+0.014901359 container create 82efd26da9053150db6762804f0cff346746f20237076c1fa6d33039d8eb67f7 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.build-date=20260223, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T07:19:59.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 podman[39081]: 2026-02-24 07:19:59.397825095 +0000 UTC m=+0.039707424 container init 82efd26da9053150db6762804f0cff346746f20237076c1fa6d33039d8eb67f7 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 podman[39081]: 2026-02-24 07:19:59.400265573 +0000 UTC m=+0.042147912 container start 82efd26da9053150db6762804f0cff346746f20237076c1fa6d33039d8eb67f7 (image=quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, OSD_FLAVOR=default) 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 bash[39081]: 82efd26da9053150db6762804f0cff346746f20237076c1fa6d33039d8eb67f7 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 podman[39081]: 2026-02-24 07:19:59.367118532 +0000 UTC m=+0.009000871 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 systemd[1]: Started Ceph mon.a for 30400272-1151-11f1-be09-d404e6e7d460. 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: set uid:gid to 167:167 (ceph:ceph) 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: ceph version 20.3.0-5440-gff63f3d9 (ff63f3d997e38f69382fd23ac0206f07f7b05017) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: pidfile_write: ignore empty --pid-file 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: load: jerasure load: lrc 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: RocksDB version: 7.9.2 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Git sha 0 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Compile date 2026-02-24 05:12:44 2026-02-24T07:19:59.494 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: DB SUMMARY 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: DB Session ID: Q4G0UW8M2SIVUS8U7Y0O 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: CURRENT file: CURRENT 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: IDENTITY file: IDENTITY 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 92479 ; 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.error_if_exists: 0 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.create_if_missing: 0 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.paranoid_checks: 1 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-24T07:19:59.495 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.env: 0xed5d60 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.fs: PosixFileSystem 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.info_log: 0x19a0ec0 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_file_opening_threads: 16 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.statistics: (nil) 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.use_fsync: 0 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_log_file_size: 0 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.keep_log_file_num: 1000 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.recycle_log_file_num: 0 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.allow_fallocate: 1 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.allow_mmap_reads: 0 2026-02-24T07:19:59.496 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.allow_mmap_writes: 0 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.use_direct_reads: 0 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.create_missing_column_families: 0 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.db_log_dir: 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.wal_dir: 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.advise_random_on_open: 1 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.db_write_buffer_size: 0 2026-02-24T07:19:59.497 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.write_buffer_manager: 0x199c140 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.rate_limiter: (nil) 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.wal_recovery_mode: 2 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.enable_thread_tracking: 0 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.enable_pipelined_write: 0 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.unordered_write: 0 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-24T07:19:59.498 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.row_cache: None 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.wal_filter: None 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.allow_ingest_behind: 0 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.two_write_queues: 0 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.manual_wal_flush: 0 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.wal_compression: 0 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.atomic_flush: 0 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.log_readahead_size: 0 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-24T07:19:59.499 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.best_efforts_recovery: 0 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.allow_data_in_errors: 0 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.db_host_id: __hostname__ 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_background_jobs: 2 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_background_compactions: -1 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_subcompactions: 1 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_total_wal_size: 0 2026-02-24T07:19:59.500 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_open_files: -1 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bytes_per_sync: 0 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_readahead_size: 0 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_background_flushes: -1 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Compression algorithms supported: 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: kZSTD supported: 0 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: kXpressCompression supported: 0 2026-02-24T07:19:59.501 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: kBZip2Compression supported: 0 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: kLZ4Compression supported: 1 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: kZlibCompression supported: 1 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: kLZ4HCCompression supported: 1 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: kSnappyCompression supported: 1 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.merge_operator: 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_filter: None 2026-02-24T07:19:59.502 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_filter_factory: None 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.sst_partitioner_factory: None 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x19a1600) 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout: cache_index_and_filter_blocks: 1 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout: pin_top_level_index_and_filter: 1 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout: index_type: 0 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout: data_block_index_type: 0 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout: index_shortening: 1 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-24T07:19:59.503 INFO:journalctl@ceph.mon.a.trial022.stdout: checksum: 4 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: no_block_cache: 0 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: block_cache: 0x196fa50 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: block_cache_name: BinnedLRUCache 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: block_cache_options: 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: capacity : 536870912 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: num_shard_bits : 4 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: strict_capacity_limit : 0 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: high_pri_pool_ratio: 0.000 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: block_cache_compressed: (nil) 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: persistent_cache: (nil) 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: block_size: 4096 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: block_size_deviation: 10 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: block_restart_interval: 16 2026-02-24T07:19:59.504 INFO:journalctl@ceph.mon.a.trial022.stdout: index_block_restart_interval: 1 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: metadata_block_size: 4096 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: partition_filters: 0 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: use_delta_encoding: 1 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: filter_policy: bloomfilter 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: whole_key_filtering: 1 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: verify_compression: 0 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: read_amp_bytes_per_bit: 0 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: format_version: 5 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: enable_index_compression: 1 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: block_align: 0 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: max_auto_readahead_size: 262144 2026-02-24T07:19:59.505 INFO:journalctl@ceph.mon.a.trial022.stdout: prepopulate_block_cache: 0 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout: initial_auto_readahead_size: 8192 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout: num_file_reads_for_auto_readahead: 2 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.write_buffer_size: 33554432 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_write_buffer_number: 2 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compression: NoCompression 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bottommost_compression: Disabled 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.prefix_extractor: nullptr 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.num_levels: 7 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-24T07:19:59.506 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compression_opts.level: 32767 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compression_opts.strategy: 0 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-24T07:19:59.507 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compression_opts.enabled: false 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.target_file_size_base: 67108864 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-24T07:19:59.508 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.arena_block_size: 1048576 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.disable_auto_compactions: 0 2026-02-24T07:19:59.509 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.inplace_update_support: 0 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-24T07:19:59.510 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.bloom_locality: 0 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.max_successive_merges: 0 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.paranoid_file_checks: 0 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.force_consistency_checks: 1 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.report_bg_io_stats: 0 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.ttl: 2592000 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.enable_blob_files: false 2026-02-24T07:19:59.511 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.min_blob_size: 0 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.blob_file_size: 268435456 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.blob_file_starting_level: 0 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 55473434-16a7-4762-855c-07137fb27d8e 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771917599416607, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-24T07:19:59.512 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771917599417393, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 87925, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 295, "table_properties": {"data_size": 85925, "index_size": 257, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13798, "raw_average_key_size": 51, "raw_value_size": 78575, "raw_average_value_size": 295, "num_data_blocks": 9, "num_entries": 266, "num_filter_entries": 266, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771917599, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "55473434-16a7-4762-855c-07137fb27d8e", "db_session_id": "Q4G0UW8M2SIVUS8U7Y0O", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771917599417455, "job": 1, "event": "recovery_finished"} 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x19bce00 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: DB pointer 0x27ae000 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout: ** DB Stats ** 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-24T07:19:59.513 INFO:journalctl@ceph.mon.a.trial022.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: ** Compaction Stats [default] ** 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: L0 2/0 87.73 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: Sum 2/0 87.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T07:19:59.514 INFO:journalctl@ceph.mon.a.trial022.stdout: 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: ** Compaction Stats [default] ** 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 162.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-24T07:19:59.515 INFO:journalctl@ceph.mon.a.trial022.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout: Cumulative compaction: 0.00 GB write, 28.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout: Interval compaction: 0.00 GB write, 28.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout: Block cache BinnedLRUCache@0x196fa50#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout: 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: starting mon.a rank 0 at public addrs [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] at bind addrs [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: mon.a@-1(???) e1 preinit fsid 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: mon.a@-1(???).mds e1 new map 2026-02-24T07:19:59.516 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: mon.a@-1(???).mds e1 print_map 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout: e1 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout: btime 2026-02-24T07:19:58:590590+0000 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout: legacy client fscid: -1 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout: 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout: No filesystems configured 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-24T07:19:59.517 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a[39104]: 2026-02-24T07:19:59.420+0000 7f3cb3858c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: monmap epoch 1 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: fsid 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: last_changed 2026-02-24T07:19:57.637230+0000 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: created 2026-02-24T07:19:57.637230+0000 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: min_mon_release 20 (tentacle) 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: election_strategy: 1 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: 0: [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] mon.a 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: fsmap 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: osdmap e1: 0 total, 0 up, 0 in 2026-02-24T07:19:59.518 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:19:59 trial022 ceph-mon[39108]: mgrmap e1: no daemons active 2026-02-24T07:19:59.563 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout cluster: 2026-02-24T07:19:59.563 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout id: 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:19:59.563 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-24T07:19:59.563 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:19:59.563 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout services: 2026-02-24T07:19:59.563 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.11651s) [leader: a] 2026-02-24T07:19:59.563 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-24T07:19:59.563 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-24T07:19:59.563 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:19:59.563 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout data: 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout pgs: 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.503+0000 7fee86e2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.504+0000 7fee86e2f640 1 Processor -- start 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.504+0000 7fee86e2f640 1 -- start start 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.504+0000 7fee86e2f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee8005d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.504+0000 7fee86e2f640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee8005ea00 con 0x7fee8005cfe0 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.505+0000 7fee84ba4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee8005d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:19:59.564 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.505+0000 7fee84ba4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee8005d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35404/0 (socket says 10.20.193.22:35404) 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.505+0000 7fee84ba4640 1 -- 10.20.193.22:0/3709236686 learned_addr learned my addr 10.20.193.22:0/3709236686 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.505+0000 7fee84ba4640 1 -- 10.20.193.22:0/3709236686 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8005d910 con 0x7fee8005cfe0 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee84ba4640 1 --2- 10.20.193.22:0/3709236686 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee8005d3d0 crc :-1 s=READY pgs=1 gs=1 cs=0 l=1 c_cookie=11773696742304043003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36492ceb234cffb server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee777fe640 1 -- 10.20.193.22:0/3709236686 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fee70009d40 con 0x7fee8005cfe0 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee777fe640 1 -- 10.20.193.22:0/3709236686 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(28 keys) ==== 1123+0+0 (crc 0 0 0) 0x7fee7000e700 con 0x7fee8005cfe0 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee777fe640 1 -- 10.20.193.22:0/3709236686 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fee7000d5f0 con 0x7fee8005cfe0 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee86e2f640 1 -- 10.20.193.22:0/3709236686 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 msgr2=0x7fee8005d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee86e2f640 1 --2- 10.20.193.22:0/3709236686 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee8005d3d0 crc :-1 s=READY pgs=1 gs=1 cs=0 l=1 c_cookie=11773696742304043003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee86e2f640 1 -- 10.20.193.22:0/3709236686 shutdown_connections 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee86e2f640 1 --2- 10.20.193.22:0/3709236686 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee8005d3d0 unknown :-1 s=CLOSED pgs=1 gs=1 cs=0 l=1 c_cookie=11773696742304043003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee86e2f640 1 -- 10.20.193.22:0/3709236686 >> 10.20.193.22:0/3709236686 conn(0x7fee8005aab0 msgr2=0x7fee8005aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee86e2f640 1 -- 10.20.193.22:0/3709236686 shutdown_connections 2026-02-24T07:19:59.565 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee86e2f640 1 -- 10.20.193.22:0/3709236686 wait complete. 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.506+0000 7fee86e2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee86e2f640 1 Processor -- start 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee86e2f640 1 -- start start 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee86e2f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee80129290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee86e2f640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee801297f0 con 0x7fee8005cfe0 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee84ba4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee80129290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee84ba4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee80129290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35414/0 (socket says 10.20.193.22:35414) 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee84ba4640 1 -- 10.20.193.22:0/1383393476 learned_addr learned my addr 10.20.193.22:0/1383393476 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee84ba4640 1 -- 10.20.193.22:0/1383393476 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee80129930 con 0x7fee8005cfe0 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee84ba4640 1 --2- 10.20.193.22:0/1383393476 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee80129290 crc :-1 s=READY pgs=2 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee75ffb640 1 -- 10.20.193.22:0/1383393476 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fee7000ed00 con 0x7fee8005cfe0 2026-02-24T07:19:59.566 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee86e2f640 1 -- 10.20.193.22:0/1383393476 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee80129b80 con 0x7fee8005cfe0 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee75ffb640 1 -- 10.20.193.22:0/1383393476 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(28 keys) ==== 1123+0+0 (crc 0 0 0) 0x7fee700096d0 con 0x7fee8005cfe0 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee75ffb640 1 -- 10.20.193.22:0/1383393476 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fee700133a0 con 0x7fee8005cfe0 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee86e2f640 1 -- 10.20.193.22:0/1383393476 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8012a470 con 0x7fee8005cfe0 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee75ffb640 1 -- 10.20.193.22:0/1383393476 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (crc 0 0 0) 0x7fee70011040 con 0x7fee8005cfe0 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.507+0000 7fee75ffb640 1 -- 10.20.193.22:0/1383393476 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7fee70010640 con 0x7fee8005cfe0 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.508+0000 7fee86e2f640 1 -- 10.20.193.22:0/1383393476 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee8005d3b0 con 0x7fee8005cfe0 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.509+0000 7fee75ffb640 1 -- 10.20.193.22:0/1383393476 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (crc 0 0 0) 0x7fee70012d90 con 0x7fee8005cfe0 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.538+0000 7fee86e2f640 1 -- 10.20.193.22:0/1383393476 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fee8013cc10 con 0x7fee8005cfe0 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.538+0000 7fee75ffb640 1 -- 10.20.193.22:0/1383393476 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+328 (crc 0 0 0) 0x7fee7000d8e0 con 0x7fee8005cfe0 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.538+0000 7fee86e2f640 1 -- 10.20.193.22:0/1383393476 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 msgr2=0x7fee80129290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.538+0000 7fee86e2f640 1 --2- 10.20.193.22:0/1383393476 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee80129290 crc :-1 s=READY pgs=2 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.567 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.538+0000 7fee86e2f640 1 -- 10.20.193.22:0/1383393476 shutdown_connections 2026-02-24T07:19:59.568 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.538+0000 7fee86e2f640 1 --2- 10.20.193.22:0/1383393476 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fee8005cfe0 0x7fee80129290 unknown :-1 s=CLOSED pgs=2 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.568 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.538+0000 7fee86e2f640 1 -- 10.20.193.22:0/1383393476 >> 10.20.193.22:0/1383393476 conn(0x7fee8005aab0 msgr2=0x7fee8011f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:19:59.568 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.538+0000 7fee86e2f640 1 -- 10.20.193.22:0/1383393476 shutdown_connections 2026-02-24T07:19:59.568 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.538+0000 7fee86e2f640 1 -- 10.20.193.22:0/1383393476 wait complete. 2026-02-24T07:19:59.568 INFO:teuthology.orchestra.run.trial022.stdout:mon is available 2026-02-24T07:19:59.568 INFO:teuthology.orchestra.run.trial022.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-24T07:19:59.714 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.653+0000 7fe8c672c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:59.715 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.657+0000 7fe8c672c640 1 Processor -- start 2026-02-24T07:19:59.715 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.657+0000 7fe8c672c640 1 -- start start 2026-02-24T07:19:59.715 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.657+0000 7fe8c672c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c005bdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:19:59.715 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.657+0000 7fe8c672c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c005c330 con 0x7fe8c005ba00 2026-02-24T07:19:59.715 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.657+0000 7fe8bffff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c005bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:19:59.715 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.657+0000 7fe8bffff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c005bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35428/0 (socket says 10.20.193.22:35428) 2026-02-24T07:19:59.715 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.657+0000 7fe8bffff640 1 -- 10.20.193.22:0/1071385817 learned_addr learned my addr 10.20.193.22:0/1071385817 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:19:59.715 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.657+0000 7fe8bffff640 1 -- 10.20.193.22:0/1071385817 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c005c470 con 0x7fe8c005ba00 2026-02-24T07:19:59.715 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.657+0000 7fe8bffff640 1 --2- 10.20.193.22:0/1071385817 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c005bdf0 crc :-1 s=READY pgs=3 gs=1 cs=0 l=1 c_cookie=202824470634320986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d093c80bea545a server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.657+0000 7fe8beffd640 1 -- 10.20.193.22:0/1071385817 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe8ac009d40 con 0x7fe8c005ba00 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8beffd640 1 -- 10.20.193.22:0/1071385817 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(28 keys) ==== 1123+0+0 (crc 0 0 0) 0x7fe8ac00e700 con 0x7fe8c005ba00 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8beffd640 1 -- 10.20.193.22:0/1071385817 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe8ac00d5f0 con 0x7fe8c005ba00 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 -- 10.20.193.22:0/1071385817 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 msgr2=0x7fe8c005bdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 --2- 10.20.193.22:0/1071385817 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c005bdf0 crc :-1 s=READY pgs=3 gs=1 cs=0 l=1 c_cookie=202824470634320986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 -- 10.20.193.22:0/1071385817 shutdown_connections 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 --2- 10.20.193.22:0/1071385817 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c005bdf0 unknown :-1 s=CLOSED pgs=3 gs=1 cs=0 l=1 c_cookie=202824470634320986 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 -- 10.20.193.22:0/1071385817 >> 10.20.193.22:0/1071385817 conn(0x7fe8c0059540 msgr2=0x7fe8c0059940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 -- 10.20.193.22:0/1071385817 shutdown_connections 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 -- 10.20.193.22:0/1071385817 wait complete. 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:19:59.716 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 Processor -- start 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 -- start start 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c0129280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8c672c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01297e0 con 0x7fe8c005ba00 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.658+0000 7fe8bffff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c0129280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8bffff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c0129280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35436/0 (socket says 10.20.193.22:35436) 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8bffff640 1 -- 10.20.193.22:0/1870456967 learned_addr learned my addr 10.20.193.22:0/1870456967 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8bffff640 1 -- 10.20.193.22:0/1870456967 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c0129920 con 0x7fe8c005ba00 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8bffff640 1 --2- 10.20.193.22:0/1870456967 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c0129280 crc :-1 s=READY pgs=4 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8bd7fa640 1 -- 10.20.193.22:0/1870456967 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe8ac00ed00 con 0x7fe8c005ba00 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8bd7fa640 1 -- 10.20.193.22:0/1870456967 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(28 keys) ==== 1123+0+0 (crc 0 0 0) 0x7fe8ac0096d0 con 0x7fe8c005ba00 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8c672c640 1 -- 10.20.193.22:0/1870456967 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c0129b70 con 0x7fe8c005ba00 2026-02-24T07:19:59.717 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8bd7fa640 1 -- 10.20.193.22:0/1870456967 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe8ac0133a0 con 0x7fe8c005ba00 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8c672c640 1 -- 10.20.193.22:0/1870456967 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c012a460 con 0x7fe8c005ba00 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8bd7fa640 1 -- 10.20.193.22:0/1870456967 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (crc 0 0 0) 0x7fe8ac011040 con 0x7fe8c005ba00 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8bd7fa640 1 -- 10.20.193.22:0/1870456967 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7fe8ac010640 con 0x7fe8c005ba00 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.659+0000 7fe8c672c640 1 -- 10.20.193.22:0/1870456967 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c005bdd0 con 0x7fe8c005ba00 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.660+0000 7fe8bd7fa640 1 -- 10.20.193.22:0/1870456967 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (crc 0 0 0) 0x7fe8ac012d40 con 0x7fe8c005ba00 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.689+0000 7fe8c672c640 1 -- 10.20.193.22:0/1870456967 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fe8c013cdc0 con 0x7fe8c005ba00 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.690+0000 7fe8bd7fa640 1 -- 10.20.193.22:0/1870456967 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 128+0+0 (crc 0 0 0) 0x7fe8ac00d8e0 con 0x7fe8c005ba00 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.691+0000 7fe8bd7fa640 1 -- 10.20.193.22:0/1870456967 <== mon.0 v2:10.20.193.22:3300/0 8 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7fe8ac00db00 con 0x7fe8c005ba00 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.691+0000 7fe8c672c640 1 -- 10.20.193.22:0/1870456967 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 msgr2=0x7fe8c0129280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.691+0000 7fe8c672c640 1 --2- 10.20.193.22:0/1870456967 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c0129280 crc :-1 s=READY pgs=4 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.691+0000 7fe8c672c640 1 -- 10.20.193.22:0/1870456967 shutdown_connections 2026-02-24T07:19:59.718 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.691+0000 7fe8c672c640 1 --2- 10.20.193.22:0/1870456967 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8c005ba00 0x7fe8c0129280 unknown :-1 s=CLOSED pgs=4 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:19:59.719 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.691+0000 7fe8c672c640 1 -- 10.20.193.22:0/1870456967 >> 10.20.193.22:0/1870456967 conn(0x7fe8c0059540 msgr2=0x7fe8c011f940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:19:59.719 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.691+0000 7fe8c672c640 1 -- 10.20.193.22:0/1870456967 shutdown_connections 2026-02-24T07:19:59.719 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:19:59.691+0000 7fe8c672c640 1 -- 10.20.193.22:0/1870456967 wait complete. 2026-02-24T07:19:59.719 INFO:teuthology.orchestra.run.trial022.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-24T07:19:59.719 INFO:teuthology.orchestra.run.trial022.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-24T07:19:59.719 INFO:teuthology.orchestra.run.trial022.stdout:Creating mgr... 2026-02-24T07:19:59.719 INFO:teuthology.orchestra.run.trial022.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-24T07:19:59.719 INFO:teuthology.orchestra.run.trial022.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-24T07:19:59.850 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-30400272-1151-11f1-be09-d404e6e7d460@mgr.x 2026-02-24T07:19:59.850 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-30400272-1151-11f1-be09-d404e6e7d460@mgr.x.service: Unit ceph-30400272-1151-11f1-be09-d404e6e7d460@mgr.x.service not loaded. 2026-02-24T07:19:59.960 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-30400272-1151-11f1-be09-d404e6e7d460.target.wants/ceph-30400272-1151-11f1-be09-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-30400272-1151-11f1-be09-d404e6e7d460@.service. 2026-02-24T07:20:00.107 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T07:20:00.107 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout disabled 2026-02-24T07:20:00.108 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:00 trial022 systemd[1]: Started Ceph mgr.x for 30400272-1151-11f1-be09-d404e6e7d460. 2026-02-24T07:20:00.113 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T07:20:00.113 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout inactive 2026-02-24T07:20:00.113 INFO:teuthology.orchestra.run.trial022.stdout:firewalld.service is not enabled 2026-02-24T07:20:00.113 INFO:teuthology.orchestra.run.trial022.stdout:Not possible to enable service . firewalld.service is not available 2026-02-24T07:20:00.121 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T07:20:00.121 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout disabled 2026-02-24T07:20:00.127 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T07:20:00.127 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout inactive 2026-02-24T07:20:00.127 INFO:teuthology.orchestra.run.trial022.stdout:firewalld.service is not enabled 2026-02-24T07:20:00.127 INFO:teuthology.orchestra.run.trial022.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-24T07:20:00.127 INFO:teuthology.orchestra.run.trial022.stdout:Waiting for mgr to start... 2026-02-24T07:20:00.127 INFO:teuthology.orchestra.run.trial022.stdout:Waiting for mgr... 2026-02-24T07:20:00.291 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:20:00.292 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:20:00.292 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "fsid": "30400272-1151-11f1-be09-d404e6e7d460", 2026-02-24T07:20:00.292 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T07:20:00.292 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T07:20:00.292 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T07:20:00.292 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T07:20:00.292 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:00.292 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T07:20:00.292 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 0 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:00.293 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T07:20:00.294 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T07:19:58:590590+0000", 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:00.295 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T07:19:58.591036+0000", 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:20:00.296 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.226+0000 7fcf0b5bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.228+0000 7fcf0b5bc640 1 Processor -- start 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.228+0000 7fcf0b5bc640 1 -- start start 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.228+0000 7fcf0b5bc640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf0405bd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.228+0000 7fcf0b5bc640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0405c290 con 0x7fcf0405b960 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.228+0000 7fcf09331640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf0405bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.228+0000 7fcf09331640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf0405bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35466/0 (socket says 10.20.193.22:35466) 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.228+0000 7fcf09331640 1 -- 10.20.193.22:0/2372564355 learned_addr learned my addr 10.20.193.22:0/2372564355 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcf09331640 1 -- 10.20.193.22:0/2372564355 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0405c3d0 con 0x7fcf0405b960 2026-02-24T07:20:00.297 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcf09331640 1 --2- 10.20.193.22:0/2372564355 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf0405bd50 crc :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=9447609616762485744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831ca6e40fb13bf0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcef3fff640 1 -- 10.20.193.22:0/2372564355 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fcef4009d40 con 0x7fcf0405b960 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcef3fff640 1 -- 10.20.193.22:0/2372564355 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7fcef400e720 con 0x7fcf0405b960 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcef3fff640 1 -- 10.20.193.22:0/2372564355 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fcef400d660 con 0x7fcf0405b960 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2372564355 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 msgr2=0x7fcf0405bd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcf0b5bc640 1 --2- 10.20.193.22:0/2372564355 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf0405bd50 crc :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=9447609616762485744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2372564355 shutdown_connections 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcf0b5bc640 1 --2- 10.20.193.22:0/2372564355 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf0405bd50 unknown :-1 s=CLOSED pgs=7 gs=1 cs=0 l=1 c_cookie=9447609616762485744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2372564355 >> 10.20.193.22:0/2372564355 conn(0x7fcf04059500 msgr2=0x7fcf04059900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2372564355 shutdown_connections 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2372564355 wait complete. 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.229+0000 7fcf0b5bc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:00.298 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf0b5bc640 1 Processor -- start 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf0b5bc640 1 -- start start 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf0b5bc640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf04129260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf0b5bc640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041297c0 con 0x7fcf0405b960 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf09331640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf04129260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf09331640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf04129260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:35476/0 (socket says 10.20.193.22:35476) 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf09331640 1 -- 10.20.193.22:0/2812670330 learned_addr learned my addr 10.20.193.22:0/2812670330 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf09331640 1 -- 10.20.193.22:0/2812670330 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf04129900 con 0x7fcf0405b960 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf09331640 1 --2- 10.20.193.22:0/2812670330 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf04129260 crc :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcef27fc640 1 -- 10.20.193.22:0/2812670330 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fcef400ed70 con 0x7fcf0405b960 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcef27fc640 1 -- 10.20.193.22:0/2812670330 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7fcef400ddf0 con 0x7fcf0405b960 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2812670330 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf04129b50 con 0x7fcf0405b960 2026-02-24T07:20:00.299 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcef27fc640 1 -- 10.20.193.22:0/2812670330 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fcef4013570 con 0x7fcf0405b960 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2812670330 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf0412a440 con 0x7fcf0405b960 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcef27fc640 1 -- 10.20.193.22:0/2812670330 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (crc 0 0 0) 0x7fcef4011040 con 0x7fcf0405b960 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcef27fc640 1 -- 10.20.193.22:0/2812670330 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7fcef4011650 con 0x7fcf0405b960 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.230+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2812670330 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf0405bd30 con 0x7fcf0405b960 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.231+0000 7fcef27fc640 1 -- 10.20.193.22:0/2812670330 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (crc 0 0 0) 0x7fcef4012de0 con 0x7fcf0405b960 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.260+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2812670330 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcf0413cee0 con 0x7fcf0405b960 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.260+0000 7fcef27fc640 1 -- 10.20.193.22:0/2812670330 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1271 (crc 0 0 0) 0x7fcef4014ab0 con 0x7fcf0405b960 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.261+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2812670330 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 msgr2=0x7fcf04129260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.261+0000 7fcf0b5bc640 1 --2- 10.20.193.22:0/2812670330 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf04129260 crc :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.261+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2812670330 shutdown_connections 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.261+0000 7fcf0b5bc640 1 --2- 10.20.193.22:0/2812670330 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcf0405b960 0x7fcf04129260 unknown :-1 s=CLOSED pgs=8 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.261+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2812670330 >> 10.20.193.22:0/2812670330 conn(0x7fcf04059500 msgr2=0x7fcf040ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:00.300 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.261+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2812670330 shutdown_connections 2026-02-24T07:20:00.301 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:00.261+0000 7fcf0b5bc640 1 -- 10.20.193.22:0/2812670330 wait complete. 2026-02-24T07:20:00.301 INFO:teuthology.orchestra.run.trial022.stdout:mgr not available, waiting (1/15)... 2026-02-24T07:20:00.475 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:20:00.106+0000 7fec2e724fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:00.475 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:20:00.108+0000 7fec2e724fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:00.475 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:20:00.108+0000 7fec2e724fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:00.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:00 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1383393476' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-24T07:20:00.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:00 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1870456967' entity='client.admin' 2026-02-24T07:20:00.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:00 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2812670330' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T07:20:01.491 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:01 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T07:20:01.491 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:01 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T07:20:01.492 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:01 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: from numpy import show_config as show_numpy_config 2026-02-24T07:20:02.463 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:20:02.463 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:20:02.463 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "fsid": "30400272-1151-11f1-be09-d404e6e7d460", 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 0 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T07:20:02.464 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T07:20:02.465 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T07:20:02.466 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T07:19:58:590590+0000", 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T07:20:02.467 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T07:19:58.591036+0000", 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.380+0000 7faa9a17d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:02.468 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa9a17d640 1 Processor -- start 2026-02-24T07:20:02.469 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa9a17d640 1 -- start start 2026-02-24T07:20:02.469 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa9a17d640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa9411cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:02.469 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa9a17d640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa9411d3e0 con 0x7faa9411ca00 2026-02-24T07:20:02.469 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa937fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa9411cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:02.469 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa937fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa9411cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52502/0 (socket says 10.20.193.22:52502) 2026-02-24T07:20:02.469 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa937fe640 1 -- 10.20.193.22:0/3525560143 learned_addr learned my addr 10.20.193.22:0/3525560143 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:02.469 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa937fe640 1 -- 10.20.193.22:0/3525560143 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9411d520 con 0x7faa9411ca00 2026-02-24T07:20:02.469 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa937fe640 1 --2- 10.20.193.22:0/3525560143 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa9411cdf0 crc :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=1958133689226867730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2cb0373917b412 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:02.469 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa927fc640 1 -- 10.20.193.22:0/3525560143 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7faa80009d40 con 0x7faa9411ca00 2026-02-24T07:20:02.469 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa927fc640 1 -- 10.20.193.22:0/3525560143 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7faa8000e720 con 0x7faa9411ca00 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.382+0000 7faa927fc640 1 -- 10.20.193.22:0/3525560143 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7faa8000d660 con 0x7faa9411ca00 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 -- 10.20.193.22:0/3525560143 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 msgr2=0x7faa9411cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 --2- 10.20.193.22:0/3525560143 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa9411cdf0 crc :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=1958133689226867730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 -- 10.20.193.22:0/3525560143 shutdown_connections 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 --2- 10.20.193.22:0/3525560143 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa9411cdf0 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=1958133689226867730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 -- 10.20.193.22:0/3525560143 >> 10.20.193.22:0/3525560143 conn(0x7faa94057f30 msgr2=0x7faa94058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 -- 10.20.193.22:0/3525560143 shutdown_connections 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 -- 10.20.193.22:0/3525560143 wait complete. 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 Processor -- start 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 -- start start 2026-02-24T07:20:02.470 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa94109250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa9a17d640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa941097b0 con 0x7faa9411ca00 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa937fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa94109250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa937fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa94109250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52506/0 (socket says 10.20.193.22:52506) 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa937fe640 1 -- 10.20.193.22:0/3082503589 learned_addr learned my addr 10.20.193.22:0/3082503589 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa937fe640 1 -- 10.20.193.22:0/3082503589 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa941098f0 con 0x7faa9411ca00 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa937fe640 1 --2- 10.20.193.22:0/3082503589 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa94109250 crc :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.383+0000 7faa90ff9640 1 -- 10.20.193.22:0/3082503589 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7faa8000d640 con 0x7faa9411ca00 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.384+0000 7faa90ff9640 1 -- 10.20.193.22:0/3082503589 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7faa8000de40 con 0x7faa9411ca00 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.384+0000 7faa9a17d640 1 -- 10.20.193.22:0/3082503589 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa94109b40 con 0x7faa9411ca00 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.384+0000 7faa90ff9640 1 -- 10.20.193.22:0/3082503589 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7faa80013500 con 0x7faa9411ca00 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.384+0000 7faa9a17d640 1 -- 10.20.193.22:0/3082503589 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9410a430 con 0x7faa9411ca00 2026-02-24T07:20:02.471 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.384+0000 7faa90ff9640 1 -- 10.20.193.22:0/3082503589 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (crc 0 0 0) 0x7faa80011040 con 0x7faa9411ca00 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.384+0000 7faa90ff9640 1 -- 10.20.193.22:0/3082503589 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7faa80011650 con 0x7faa9411ca00 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.384+0000 7faa9a17d640 1 -- 10.20.193.22:0/3082503589 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9411cdd0 con 0x7faa9411ca00 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.385+0000 7faa90ff9640 1 -- 10.20.193.22:0/3082503589 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (crc 0 0 0) 0x7faa800149f0 con 0x7faa9411ca00 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.414+0000 7faa9a17d640 1 -- 10.20.193.22:0/3082503589 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faa9410a700 con 0x7faa9411ca00 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.415+0000 7faa90ff9640 1 -- 10.20.193.22:0/3082503589 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1271 (crc 0 0 0) 0x7faa80013b10 con 0x7faa9411ca00 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.415+0000 7faa9a17d640 1 -- 10.20.193.22:0/3082503589 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 msgr2=0x7faa94109250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.415+0000 7faa9a17d640 1 --2- 10.20.193.22:0/3082503589 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa94109250 crc :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.415+0000 7faa9a17d640 1 -- 10.20.193.22:0/3082503589 shutdown_connections 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.415+0000 7faa9a17d640 1 --2- 10.20.193.22:0/3082503589 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7faa9411ca00 0x7faa94109250 unknown :-1 s=CLOSED pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.415+0000 7faa9a17d640 1 -- 10.20.193.22:0/3082503589 >> 10.20.193.22:0/3082503589 conn(0x7faa94057f30 msgr2=0x7faa940ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.415+0000 7faa9a17d640 1 -- 10.20.193.22:0/3082503589 shutdown_connections 2026-02-24T07:20:02.472 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:02.415+0000 7faa9a17d640 1 -- 10.20.193.22:0/3082503589 wait complete. 2026-02-24T07:20:02.473 INFO:teuthology.orchestra.run.trial022.stdout:mgr not available, waiting (2/15)... 2026-02-24T07:20:02.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:02 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3082503589' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T07:20:03.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: Activating manager daemon x 2026-02-24T07:20:03.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: mgrmap e2: x(active, starting, since 0.00244882s) 2026-02-24T07:20:03.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: from='mgr.14102 10.20.193.22:0/3799650541' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T07:20:03.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: from='mgr.14102 10.20.193.22:0/3799650541' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T07:20:03.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: from='mgr.14102 10.20.193.22:0/3799650541' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T07:20:03.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: from='mgr.14102 10.20.193.22:0/3799650541' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T07:20:03.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: from='mgr.14102 10.20.193.22:0/3799650541' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T07:20:03.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: Manager daemon x is now available 2026-02-24T07:20:03.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: from='mgr.14102 10.20.193.22:0/3799650541' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T07:20:03.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: from='mgr.14102 10.20.193.22:0/3799650541' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T07:20:03.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: from='mgr.14102 10.20.193.22:0/3799650541' entity='mgr.x' 2026-02-24T07:20:03.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: from='mgr.14102 10.20.193.22:0/3799650541' entity='mgr.x' 2026-02-24T07:20:03.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:03 trial022 ceph-mon[39108]: from='mgr.14102 10.20.193.22:0/3799650541' entity='mgr.x' 2026-02-24T07:20:04.737 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:20:04.738 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:20:04.738 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "fsid": "30400272-1151-11f1-be09-d404e6e7d460", 2026-02-24T07:20:04.738 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "health": { 2026-02-24T07:20:04.738 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-24T07:20:04.738 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-24T07:20:04.738 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-24T07:20:04.738 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:04.738 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-24T07:20:04.738 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 0 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "a" 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:04.739 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-24T07:20:04.740 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "btime": "2026-02-24T07:19:58:590590+0000", 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:04.741 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout ], 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "modified": "2026-02-24T07:19:58.591036+0000", 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-24T07:20:04.742 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout }, 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.553+0000 7f0449d15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.554+0000 7f0449d15640 1 Processor -- start 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.554+0000 7f0449d15640 1 -- start start 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.554+0000 7f0449d15640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405be30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.554+0000 7f0449d15640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f044405c370 con 0x7f044405ba40 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.554+0000 7f04437fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405be30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.554+0000 7f04437fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405be30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52604/0 (socket says 10.20.193.22:52604) 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.554+0000 7f04437fe640 1 -- 10.20.193.22:0/1553208251 learned_addr learned my addr 10.20.193.22:0/1553208251 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:04.743 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f04437fe640 1 -- 10.20.193.22:0/1553208251 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044405c4b0 con 0x7f044405ba40 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f04437fe640 1 --2- 10.20.193.22:0/1553208251 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405be30 crc :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=2580338858982237561 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cf348561c5e579 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f04427fc640 1 -- 10.20.193.22:0/1553208251 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0430009d40 con 0x7f044405ba40 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f04427fc640 1 -- 10.20.193.22:0/1553208251 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f043000e720 con 0x7f044405ba40 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f04427fc640 1 -- 10.20.193.22:0/1553208251 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f043000d660 con 0x7f044405ba40 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f0449d15640 1 -- 10.20.193.22:0/1553208251 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 msgr2=0x7f044405be30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f0449d15640 1 --2- 10.20.193.22:0/1553208251 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405be30 crc :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=2580338858982237561 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f0449d15640 1 -- 10.20.193.22:0/1553208251 shutdown_connections 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f0449d15640 1 --2- 10.20.193.22:0/1553208251 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405be30 unknown :-1 s=CLOSED pgs=18 gs=1 cs=0 l=1 c_cookie=2580338858982237561 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f0449d15640 1 -- 10.20.193.22:0/1553208251 >> 10.20.193.22:0/1553208251 conn(0x7f0444059500 msgr2=0x7f0444059900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f0449d15640 1 -- 10.20.193.22:0/1553208251 shutdown_connections 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f0449d15640 1 -- 10.20.193.22:0/1553208251 wait complete. 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f0449d15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:04.744 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.555+0000 7f0449d15640 1 Processor -- start 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f0449d15640 1 -- start start 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f0449d15640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405e1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f0449d15640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f044405e700 con 0x7f044405ba40 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f04437fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f04437fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52618/0 (socket says 10.20.193.22:52618) 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f04437fe640 1 -- 10.20.193.22:0/132022526 learned_addr learned my addr 10.20.193.22:0/132022526 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f04437fe640 1 -- 10.20.193.22:0/132022526 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044405e840 con 0x7f044405ba40 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f04437fe640 1 --2- 10.20.193.22:0/132022526 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405e1a0 crc :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f0440ff9640 1 -- 10.20.193.22:0/132022526 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f043000d640 con 0x7f044405ba40 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f0449d15640 1 -- 10.20.193.22:0/132022526 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044405cb20 con 0x7f044405ba40 2026-02-24T07:20:04.745 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f0440ff9640 1 -- 10.20.193.22:0/132022526 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f043000de40 con 0x7f044405ba40 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f0440ff9640 1 -- 10.20.193.22:0/132022526 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0430013500 con 0x7f044405ba40 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f0449d15640 1 -- 10.20.193.22:0/132022526 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044405d010 con 0x7f044405ba40 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.556+0000 7f0449d15640 1 -- 10.20.193.22:0/132022526 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044405ea30 con 0x7f044405ba40 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.557+0000 7f0440ff9640 1 -- 10.20.193.22:0/132022526 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 3) ==== 52697+0+0 (crc 0 0 0) 0x7f0430011040 con 0x7f044405ba40 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.557+0000 7f0440ff9640 1 --2- 10.20.193.22:0/132022526 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f041803f630 0x7f041805fae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.557+0000 7f0440ff9640 1 -- 10.20.193.22:0/132022526 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7f0430051f50 con 0x7f044405ba40 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.557+0000 7f0442ffd640 1 --2- 10.20.193.22:0/132022526 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f041803f630 0x7f041805fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.557+0000 7f0442ffd640 1 --2- 10.20.193.22:0/132022526 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f041803f630 0x7f041805fae0 crc :-1 s=READY pgs=6 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.559+0000 7f0440ff9640 1 -- 10.20.193.22:0/132022526 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f043000c150 con 0x7f044405ba40 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.706+0000 7f0449d15640 1 -- 10.20.193.22:0/132022526 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f044405be10 con 0x7f044405ba40 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.707+0000 7f0440ff9640 1 -- 10.20.193.22:0/132022526 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1270 (crc 0 0 0) 0x7f044405be10 con 0x7f044405ba40 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.707+0000 7f0449d15640 1 -- 10.20.193.22:0/132022526 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f041803f630 msgr2=0x7f041805fae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:04.746 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.707+0000 7f0449d15640 1 --2- 10.20.193.22:0/132022526 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f041803f630 0x7f041805fae0 crc :-1 s=READY pgs=6 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.707+0000 7f0449d15640 1 -- 10.20.193.22:0/132022526 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 msgr2=0x7f044405e1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:04.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.707+0000 7f0449d15640 1 --2- 10.20.193.22:0/132022526 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405e1a0 crc :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.708+0000 7f0449d15640 1 -- 10.20.193.22:0/132022526 shutdown_connections 2026-02-24T07:20:04.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.708+0000 7f0449d15640 1 --2- 10.20.193.22:0/132022526 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f041803f630 0x7f041805fae0 unknown :-1 s=CLOSED pgs=6 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.708+0000 7f0449d15640 1 --2- 10.20.193.22:0/132022526 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f044405ba40 0x7f044405e1a0 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.708+0000 7f0449d15640 1 -- 10.20.193.22:0/132022526 >> 10.20.193.22:0/132022526 conn(0x7f0444059500 msgr2=0x7f04440ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:04.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.708+0000 7f0449d15640 1 -- 10.20.193.22:0/132022526 shutdown_connections 2026-02-24T07:20:04.747 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.708+0000 7f0449d15640 1 -- 10.20.193.22:0/132022526 wait complete. 2026-02-24T07:20:04.747 INFO:teuthology.orchestra.run.trial022.stdout:mgr is available 2026-02-24T07:20:04.957 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:20:04.957 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout [global] 2026-02-24T07:20:04.957 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout fsid = 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:20:04.957 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-24T07:20:04.957 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.22:3300,v1:10.20.193.22:6789] 2026-02-24T07:20:04.957 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-24T07:20:04.957 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-24T07:20:04.957 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-24T07:20:04.957 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout [osd] 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.822+0000 7fe44149d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.824+0000 7fe44149d640 1 Processor -- start 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.824+0000 7fe44149d640 1 -- start start 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.824+0000 7fe44149d640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c0570c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.824+0000 7fe44149d640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c057600 con 0x7fe43c056cd0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.824+0000 7fe43affd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c0570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.824+0000 7fe43affd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c0570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52624/0 (socket says 10.20.193.22:52624) 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.824+0000 7fe43affd640 1 -- 10.20.193.22:0/2695306473 learned_addr learned my addr 10.20.193.22:0/2695306473 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe43affd640 1 -- 10.20.193.22:0/2695306473 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c057740 con 0x7fe43c056cd0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe43affd640 1 --2- 10.20.193.22:0/2695306473 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c0570c0 crc :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=1631495013394738196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a43c121636ec14 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe439ffb640 1 -- 10.20.193.22:0/2695306473 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe430009d40 con 0x7fe43c056cd0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe439ffb640 1 -- 10.20.193.22:0/2695306473 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7fe43000e720 con 0x7fe43c056cd0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe439ffb640 1 -- 10.20.193.22:0/2695306473 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe43000d660 con 0x7fe43c056cd0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe44149d640 1 -- 10.20.193.22:0/2695306473 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 msgr2=0x7fe43c0570c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe44149d640 1 --2- 10.20.193.22:0/2695306473 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c0570c0 crc :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=1631495013394738196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe44149d640 1 -- 10.20.193.22:0/2695306473 shutdown_connections 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe44149d640 1 --2- 10.20.193.22:0/2695306473 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c0570c0 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=1631495013394738196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe44149d640 1 -- 10.20.193.22:0/2695306473 >> 10.20.193.22:0/2695306473 conn(0x7fe43c059da0 msgr2=0x7fe43c05a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe44149d640 1 -- 10.20.193.22:0/2695306473 shutdown_connections 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe44149d640 1 -- 10.20.193.22:0/2695306473 wait complete. 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.825+0000 7fe44149d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe44149d640 1 Processor -- start 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe44149d640 1 -- start start 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe44149d640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c1292c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe44149d640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c129820 con 0x7fe43c056cd0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe43affd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c1292c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe43affd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c1292c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52636/0 (socket says 10.20.193.22:52636) 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe43affd640 1 -- 10.20.193.22:0/3604997262 learned_addr learned my addr 10.20.193.22:0/3604997262 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe43affd640 1 -- 10.20.193.22:0/3604997262 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c129960 con 0x7fe43c056cd0 2026-02-24T07:20:04.958 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe43affd640 1 --2- 10.20.193.22:0/3604997262 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c1292c0 crc :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe41bfff640 1 -- 10.20.193.22:0/3604997262 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe43000d640 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe41bfff640 1 -- 10.20.193.22:0/3604997262 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7fe43000de40 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe44149d640 1 -- 10.20.193.22:0/3604997262 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43c129bb0 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe41bfff640 1 -- 10.20.193.22:0/3604997262 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe430013500 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.826+0000 7fe44149d640 1 -- 10.20.193.22:0/3604997262 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43c12a4a0 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.827+0000 7fe44149d640 1 -- 10.20.193.22:0/3604997262 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe43c0570a0 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.827+0000 7fe41bfff640 1 -- 10.20.193.22:0/3604997262 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 3) ==== 52697+0+0 (crc 0 0 0) 0x7fe430011040 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.827+0000 7fe41bfff640 1 --2- 10.20.193.22:0/3604997262 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7fe41003f630 0x7fe41005fae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.827+0000 7fe41bfff640 1 -- 10.20.193.22:0/3604997262 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7fe430051f90 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.827+0000 7fe43a7fc640 1 --2- 10.20.193.22:0/3604997262 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7fe41003f630 0x7fe41005fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.827+0000 7fe43a7fc640 1 --2- 10.20.193.22:0/3604997262 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7fe41003f630 0x7fe41005fae0 crc :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.829+0000 7fe41bfff640 1 -- 10.20.193.22:0/3604997262 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fe430013ae0 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.853+0000 7fe41bfff640 1 -- 10.20.193.22:0/3604997262 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mgrmap(e 4) ==== 52803+0+0 (crc 0 0 0) 0x7fe4300149f0 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.934+0000 7fe44149d640 1 -- 10.20.193.22:0/3604997262 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe43c13cf80 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.934+0000 7fe41bfff640 1 -- 10.20.193.22:0/3604997262 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+374 (crc 0 0 0) 0x7fe43000d950 con 0x7fe43c056cd0 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.935+0000 7fe44149d640 1 -- 10.20.193.22:0/3604997262 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7fe41003f630 msgr2=0x7fe41005fae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.935+0000 7fe44149d640 1 --2- 10.20.193.22:0/3604997262 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7fe41003f630 0x7fe41005fae0 crc :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.935+0000 7fe44149d640 1 -- 10.20.193.22:0/3604997262 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 msgr2=0x7fe43c1292c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.935+0000 7fe44149d640 1 --2- 10.20.193.22:0/3604997262 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c1292c0 crc :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.935+0000 7fe44149d640 1 -- 10.20.193.22:0/3604997262 shutdown_connections 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.935+0000 7fe44149d640 1 --2- 10.20.193.22:0/3604997262 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7fe41003f630 0x7fe41005fae0 unknown :-1 s=CLOSED pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.935+0000 7fe44149d640 1 --2- 10.20.193.22:0/3604997262 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe43c056cd0 0x7fe43c1292c0 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.935+0000 7fe44149d640 1 -- 10.20.193.22:0/3604997262 >> 10.20.193.22:0/3604997262 conn(0x7fe43c059da0 msgr2=0x7fe43c11f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.935+0000 7fe44149d640 1 -- 10.20.193.22:0/3604997262 shutdown_connections 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:04.935+0000 7fe44149d640 1 -- 10.20.193.22:0/3604997262 wait complete. 2026-02-24T07:20:04.959 INFO:teuthology.orchestra.run.trial022.stdout:Enabling cephadm module... 2026-02-24T07:20:05.006 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:04 trial022 ceph-mon[39108]: mgrmap e3: x(active, since 1.00521s) 2026-02-24T07:20:05.006 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:04 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/132022526' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-24T07:20:05.886 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.049+0000 7f668ef83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:05.886 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.051+0000 7f668ef83640 1 Processor -- start 2026-02-24T07:20:05.886 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.051+0000 7f668ef83640 1 -- start start 2026-02-24T07:20:05.886 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ef83640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f668811ce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:05.886 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ef83640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f668811d400 con 0x7f668811ca20 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ccf8640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f668811ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ccf8640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f668811ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52640/0 (socket says 10.20.193.22:52640) 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ccf8640 1 -- 10.20.193.22:0/1572712597 learned_addr learned my addr 10.20.193.22:0/1572712597 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ccf8640 1 -- 10.20.193.22:0/1572712597 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668811d540 con 0x7f668811ca20 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ccf8640 1 --2- 10.20.193.22:0/1572712597 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f668811ce10 crc :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=8210010549536405426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71efd118a753b7b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f667f7fe640 1 -- 10.20.193.22:0/1572712597 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f6678009d40 con 0x7f668811ca20 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f667f7fe640 1 -- 10.20.193.22:0/1572712597 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f667800e720 con 0x7f668811ca20 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f667f7fe640 1 -- 10.20.193.22:0/1572712597 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f667800d660 con 0x7f668811ca20 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ef83640 1 -- 10.20.193.22:0/1572712597 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 msgr2=0x7f668811ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ef83640 1 --2- 10.20.193.22:0/1572712597 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f668811ce10 crc :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=8210010549536405426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ef83640 1 -- 10.20.193.22:0/1572712597 shutdown_connections 2026-02-24T07:20:05.887 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ef83640 1 --2- 10.20.193.22:0/1572712597 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f668811ce10 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=8210010549536405426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ef83640 1 -- 10.20.193.22:0/1572712597 >> 10.20.193.22:0/1572712597 conn(0x7f6688057ef0 msgr2=0x7f66880582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ef83640 1 -- 10.20.193.22:0/1572712597 shutdown_connections 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.052+0000 7f668ef83640 1 -- 10.20.193.22:0/1572712597 wait complete. 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ef83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ef83640 1 Processor -- start 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ef83640 1 -- start start 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ef83640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f6688109250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ef83640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f66881097b0 con 0x7f668811ca20 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ccf8640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f6688109250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ccf8640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f6688109250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52652/0 (socket says 10.20.193.22:52652) 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ccf8640 1 -- 10.20.193.22:0/2287417556 learned_addr learned my addr 10.20.193.22:0/2287417556 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:05.888 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ccf8640 1 -- 10.20.193.22:0/2287417556 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66881098f0 con 0x7f668811ca20 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ccf8640 1 --2- 10.20.193.22:0/2287417556 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f6688109250 crc :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f667dffb640 1 -- 10.20.193.22:0/2287417556 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f667800d640 con 0x7f668811ca20 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f667dffb640 1 -- 10.20.193.22:0/2287417556 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f667800de40 con 0x7f668811ca20 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ef83640 1 -- 10.20.193.22:0/2287417556 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6688109b40 con 0x7f668811ca20 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f667dffb640 1 -- 10.20.193.22:0/2287417556 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f6678013500 con 0x7f668811ca20 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.053+0000 7f668ef83640 1 -- 10.20.193.22:0/2287417556 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f668810a430 con 0x7f668811ca20 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.054+0000 7f668ef83640 1 -- 10.20.193.22:0/2287417556 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f668811cdf0 con 0x7f668811ca20 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.054+0000 7f667dffb640 1 -- 10.20.193.22:0/2287417556 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 4) ==== 52803+0+0 (crc 0 0 0) 0x7f6678011040 con 0x7f668811ca20 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.054+0000 7f667dffb640 1 --2- 10.20.193.22:0/2287417556 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f666403f750 0x7f666405fc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.054+0000 7f667dffb640 1 -- 10.20.193.22:0/2287417556 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7f66780521c0 con 0x7f668811ca20 2026-02-24T07:20:05.889 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.054+0000 7f667ffff640 1 --2- 10.20.193.22:0/2287417556 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f666403f750 0x7f666405fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.054+0000 7f667ffff640 1 --2- 10.20.193.22:0/2287417556 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f666403f750 0x7f666405fc00 crc :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.056+0000 7f667dffb640 1 -- 10.20.193.22:0/2287417556 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f667800c9a0 con 0x7f668811ca20 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.189+0000 7f668ef83640 1 -- 10.20.193.22:0/2287417556 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f668810aec0 con 0x7f668811ca20 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.857+0000 7f667dffb640 1 -- 10.20.193.22:0/2287417556 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (crc 0 0 0) 0x7f6678026700 con 0x7f668811ca20 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.858+0000 7f667dffb640 1 -- 10.20.193.22:0/2287417556 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mgrmap(e 5) ==== 52814+0+0 (crc 0 0 0) 0x7f66780033c0 con 0x7f668811ca20 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.859+0000 7f668ef83640 1 -- 10.20.193.22:0/2287417556 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f666403f750 msgr2=0x7f666405fc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.859+0000 7f668ef83640 1 --2- 10.20.193.22:0/2287417556 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f666403f750 0x7f666405fc00 crc :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.859+0000 7f668ef83640 1 -- 10.20.193.22:0/2287417556 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 msgr2=0x7f6688109250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.859+0000 7f668ef83640 1 --2- 10.20.193.22:0/2287417556 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f6688109250 crc :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.859+0000 7f668ef83640 1 -- 10.20.193.22:0/2287417556 shutdown_connections 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.859+0000 7f668ef83640 1 --2- 10.20.193.22:0/2287417556 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f666403f750 0x7f666405fc00 unknown :-1 s=CLOSED pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.859+0000 7f668ef83640 1 --2- 10.20.193.22:0/2287417556 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f668811ca20 0x7f6688109250 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:05.890 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.859+0000 7f668ef83640 1 -- 10.20.193.22:0/2287417556 >> 10.20.193.22:0/2287417556 conn(0x7f6688057ef0 msgr2=0x7f66880ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:05.891 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.859+0000 7f668ef83640 1 -- 10.20.193.22:0/2287417556 shutdown_connections 2026-02-24T07:20:05.891 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.859+0000 7f668ef83640 1 -- 10.20.193.22:0/2287417556 wait complete. 2026-02-24T07:20:06.122 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:05 trial022 ceph-mon[39108]: mgrmap e4: x(active, since 2s) 2026-02-24T07:20:06.122 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:05 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3604997262' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-24T07:20:06.123 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:05 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2287417556' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-24T07:20:06.123 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:05 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ignoring --setuser ceph since I am not root 2026-02-24T07:20:06.123 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:05 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ignoring --setgroup ceph since I am not root 2026-02-24T07:20:06.123 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:05 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:20:05.891+0000 7fb099f59fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:06.123 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:05 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:20:05.893+0000 7fb099f59fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:06.123 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:05 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:20:05.893+0000 7fb099f59fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:06.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:20:06.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-24T07:20:06.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T07:20:06.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.980+0000 7f3936b35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.981+0000 7f3936b35640 1 Processor -- start 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.981+0000 7f3936b35640 1 -- start start 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f3936b35640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f393011cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f3936b35640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f393011d3e0 con 0x7f393011ca00 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f39348aa640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f393011cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f39348aa640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f393011cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52686/0 (socket says 10.20.193.22:52686) 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f39348aa640 1 -- 10.20.193.22:0/2443860591 learned_addr learned my addr 10.20.193.22:0/2443860591 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:06.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f39348aa640 1 -- 10.20.193.22:0/2443860591 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393011d520 con 0x7f393011ca00 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f39348aa640 1 --2- 10.20.193.22:0/2443860591 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f393011cdf0 crc :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=13789849367520640131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5f62f021367c83 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f39277fe640 1 -- 10.20.193.22:0/2443860591 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f3920009d40 con 0x7f393011ca00 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f39277fe640 1 -- 10.20.193.22:0/2443860591 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f392000e720 con 0x7f393011ca00 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f39277fe640 1 -- 10.20.193.22:0/2443860591 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f392000d660 con 0x7f393011ca00 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f3936b35640 1 -- 10.20.193.22:0/2443860591 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 msgr2=0x7f393011cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f3936b35640 1 --2- 10.20.193.22:0/2443860591 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f393011cdf0 crc :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=13789849367520640131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f3936b35640 1 -- 10.20.193.22:0/2443860591 shutdown_connections 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f3936b35640 1 --2- 10.20.193.22:0/2443860591 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f393011cdf0 unknown :-1 s=CLOSED pgs=26 gs=1 cs=0 l=1 c_cookie=13789849367520640131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f3936b35640 1 -- 10.20.193.22:0/2443860591 >> 10.20.193.22:0/2443860591 conn(0x7f3930057f30 msgr2=0x7f3930058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f3936b35640 1 -- 10.20.193.22:0/2443860591 shutdown_connections 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f3936b35640 1 -- 10.20.193.22:0/2443860591 wait complete. 2026-02-24T07:20:06.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.982+0000 7f3936b35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f3936b35640 1 Processor -- start 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f3936b35640 1 -- start start 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f3936b35640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f3930109250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f3936b35640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f39301097b0 con 0x7f393011ca00 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f39348aa640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f3930109250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f39348aa640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f3930109250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52694/0 (socket says 10.20.193.22:52694) 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f39348aa640 1 -- 10.20.193.22:0/3712284948 learned_addr learned my addr 10.20.193.22:0/3712284948 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f39348aa640 1 -- 10.20.193.22:0/3712284948 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39301098f0 con 0x7f393011ca00 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f39348aa640 1 --2- 10.20.193.22:0/3712284948 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f3930109250 crc :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f3925ffb640 1 -- 10.20.193.22:0/3712284948 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f392000d640 con 0x7f393011ca00 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f3936b35640 1 -- 10.20.193.22:0/3712284948 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3930109b40 con 0x7f393011ca00 2026-02-24T07:20:06.152 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f3925ffb640 1 -- 10.20.193.22:0/3712284948 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f392000de40 con 0x7f393011ca00 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f3925ffb640 1 -- 10.20.193.22:0/3712284948 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f3920013500 con 0x7f393011ca00 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.983+0000 7f3936b35640 1 -- 10.20.193.22:0/3712284948 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f393010a430 con 0x7f393011ca00 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.984+0000 7f3936b35640 1 -- 10.20.193.22:0/3712284948 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f393011cdd0 con 0x7f393011ca00 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.984+0000 7f3925ffb640 1 -- 10.20.193.22:0/3712284948 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 5) ==== 52814+0+0 (crc 0 0 0) 0x7f3920011040 con 0x7f393011ca00 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.984+0000 7f3925ffb640 1 --2- 10.20.193.22:0/3712284948 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f390c03f7a0 0x7f390c05fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.984+0000 7f3927fff640 1 -- 10.20.193.22:0/3712284948 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f390c03f7a0 msgr2=0x7f390c05fc50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/1400318633 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.984+0000 7f3925ffb640 1 -- 10.20.193.22:0/3712284948 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7f39200521d0 con 0x7f393011ca00 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.984+0000 7f3927fff640 1 --2- 10.20.193.22:0/3712284948 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f390c03f7a0 0x7f390c05fc50 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:05.986+0000 7f3925ffb640 1 -- 10.20.193.22:0/3712284948 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f3920013ae0 con 0x7f393011ca00 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.120+0000 7f3936b35640 1 -- 10.20.193.22:0/3712284948 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f393013eeb0 con 0x7f393011ca00 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.121+0000 7f3925ffb640 1 -- 10.20.193.22:0/3712284948 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (crc 0 0 0) 0x7f392000f760 con 0x7f393011ca00 2026-02-24T07:20:06.153 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.123+0000 7f3936b35640 1 -- 10.20.193.22:0/3712284948 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f390c03f7a0 msgr2=0x7f390c05fc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.123+0000 7f3936b35640 1 --2- 10.20.193.22:0/3712284948 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f390c03f7a0 0x7f390c05fc50 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.123+0000 7f3936b35640 1 -- 10.20.193.22:0/3712284948 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 msgr2=0x7f3930109250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.123+0000 7f3936b35640 1 --2- 10.20.193.22:0/3712284948 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f3930109250 crc :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.123+0000 7f3936b35640 1 -- 10.20.193.22:0/3712284948 shutdown_connections 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.123+0000 7f3936b35640 1 --2- 10.20.193.22:0/3712284948 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f390c03f7a0 0x7f390c05fc50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.123+0000 7f3936b35640 1 --2- 10.20.193.22:0/3712284948 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f393011ca00 0x7f3930109250 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.123+0000 7f3936b35640 1 -- 10.20.193.22:0/3712284948 >> 10.20.193.22:0/3712284948 conn(0x7f3930057f30 msgr2=0x7f39300ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.123+0000 7f3936b35640 1 -- 10.20.193.22:0/3712284948 shutdown_connections 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.123+0000 7f3936b35640 1 -- 10.20.193.22:0/3712284948 wait complete. 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:Waiting for the mgr to restart... 2026-02-24T07:20:06.154 INFO:teuthology.orchestra.run.trial022.stdout:Waiting for mgr epoch 5... 2026-02-24T07:20:07.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:06 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2287417556' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-24T07:20:07.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:06 trial022 ceph-mon[39108]: mgrmap e5: x(active, since 3s) 2026-02-24T07:20:07.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:06 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3712284948' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-24T07:20:07.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:06 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T07:20:07.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:06 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T07:20:07.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:06 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: from numpy import show_config as show_numpy_config 2026-02-24T07:20:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:08 trial022 ceph-mon[39108]: Active manager daemon x restarted 2026-02-24T07:20:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:08 trial022 ceph-mon[39108]: Activating manager daemon x 2026-02-24T07:20:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:08 trial022 ceph-mon[39108]: osdmap e2: 0 total, 0 up, 0 in 2026-02-24T07:20:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:08 trial022 ceph-mon[39108]: mgrmap e6: x(active, starting, since 0.00273898s) 2026-02-24T07:20:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:08 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T07:20:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:08 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T07:20:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:08 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T07:20:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:08 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T07:20:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:08 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T07:20:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:08 trial022 ceph-mon[39108]: Manager daemon x is now available 2026-02-24T07:20:09.654 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:20:09.654 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-24T07:20:09.654 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.237+0000 7f96be1ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.239+0000 7f96be1ec640 1 Processor -- start 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.239+0000 7f96be1ec640 1 -- start start 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96be1ec640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b811cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96be1ec640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f96b811d3e0 con 0x7f96b811ca00 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96b77fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b811cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96b77fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b811cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52708/0 (socket says 10.20.193.22:52708) 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96b77fe640 1 -- 10.20.193.22:0/1661182272 learned_addr learned my addr 10.20.193.22:0/1661182272 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96b77fe640 1 -- 10.20.193.22:0/1661182272 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b811d520 con 0x7f96b811ca00 2026-02-24T07:20:09.655 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96b77fe640 1 --2- 10.20.193.22:0/1661182272 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b811cdf0 crc :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=10857390043304524015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ad32b82f0778ef server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96b67fc640 1 -- 10.20.193.22:0/1661182272 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f96a4009d40 con 0x7f96b811ca00 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96b67fc640 1 -- 10.20.193.22:0/1661182272 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f96a400e720 con 0x7f96b811ca00 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96b67fc640 1 -- 10.20.193.22:0/1661182272 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f96a400d660 con 0x7f96b811ca00 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96be1ec640 1 -- 10.20.193.22:0/1661182272 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 msgr2=0x7f96b811cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96be1ec640 1 --2- 10.20.193.22:0/1661182272 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b811cdf0 crc :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=10857390043304524015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96be1ec640 1 -- 10.20.193.22:0/1661182272 shutdown_connections 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96be1ec640 1 --2- 10.20.193.22:0/1661182272 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b811cdf0 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=10857390043304524015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96be1ec640 1 -- 10.20.193.22:0/1661182272 >> 10.20.193.22:0/1661182272 conn(0x7f96b8057f30 msgr2=0x7f96b8058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96be1ec640 1 -- 10.20.193.22:0/1661182272 shutdown_connections 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.240+0000 7f96be1ec640 1 -- 10.20.193.22:0/1661182272 wait complete. 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96be1ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:09.656 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96be1ec640 1 Processor -- start 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96be1ec640 1 -- start start 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96be1ec640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b8109250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96be1ec640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f96b81097b0 con 0x7f96b811ca00 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96b77fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b8109250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96b77fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b8109250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52712/0 (socket says 10.20.193.22:52712) 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96b77fe640 1 -- 10.20.193.22:0/3323400124 learned_addr learned my addr 10.20.193.22:0/3323400124 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96b77fe640 1 -- 10.20.193.22:0/3323400124 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b81098f0 con 0x7f96b811ca00 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96b77fe640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b8109250 crc :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f96a400d640 con 0x7f96b811ca00 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96be1ec640 1 -- 10.20.193.22:0/3323400124 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b8109b40 con 0x7f96b811ca00 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f96a400de40 con 0x7f96b811ca00 2026-02-24T07:20:09.657 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f96a4013500 con 0x7f96b811ca00 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.241+0000 7f96be1ec640 1 -- 10.20.193.22:0/3323400124 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b810a430 con 0x7f96b811ca00 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.242+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 5) ==== 52814+0+0 (crc 0 0 0) 0x7f96a4011040 con 0x7f96b811ca00 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.242+0000 7f96b4ff9640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 0x7f968c05fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.242+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 --> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f968c060360 con 0x7f968c03f7a0 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.242+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (crc 0 0 0) 0x7f96a40521d0 con 0x7f96b811ca00 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.242+0000 7f96b6ffd640 1 -- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 msgr2=0x7f968c05fc50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/1400318633 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.242+0000 7f96b6ffd640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 0x7f968c05fc50 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.443+0000 7f96b6ffd640 1 -- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 msgr2=0x7f968c05fc50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/1400318633 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.443+0000 7f96b6ffd640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 0x7f968c05fc50 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.844+0000 7f96b6ffd640 1 -- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 msgr2=0x7f968c05fc50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/1400318633 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:06.844+0000 7f96b6ffd640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 0x7f968c05fc50 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T07:20:09.658 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:07.646+0000 7f96b6ffd640 1 -- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 msgr2=0x7f968c05fc50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/1400318633 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:07.646+0000 7f96b6ffd640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 0x7f968c05fc50 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:08.619+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mgrmap(e 6) ==== 52581+0+0 (crc 0 0 0) 0x7f96a40149f0 con 0x7f96b811ca00 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:08.620+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 msgr2=0x7f968c05fc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:08.620+0000 7f96b4ff9640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 0x7f968c05fc50 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.621+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mgrmap(e 7) ==== 52708+0+0 (crc 0 0 0) 0x7f96a4011ae0 con 0x7f96b811ca00 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.621+0000 7f96b4ff9640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f968c060fd0 0x7f968c0813b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.621+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 --> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f968c060360 con 0x7f968c060fd0 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.621+0000 7f96b6ffd640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f968c060fd0 0x7f968c0813b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.622+0000 7f96b6ffd640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f968c060fd0 0x7f968c0813b0 crc :-1 s=READY pgs=1 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.622+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 <== mgr.14120 v2:10.20.193.22:6800/2169717366 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9559 (crc 0 0 0) 0x7f968c060360 con 0x7f968c060fd0 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.625+0000 7f96be1ec640 1 -- 10.20.193.22:0/3323400124 --> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f96b80532d0 con 0x7f968c060fd0 2026-02-24T07:20:09.659 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96b4ff9640 1 -- 10.20.193.22:0/3323400124 <== mgr.14120 v2:10.20.193.22:6800/2169717366 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (crc 0 0 0) 0x7f96b80532d0 con 0x7f968c060fd0 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 -- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f968c060fd0 msgr2=0x7f968c0813b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f968c060fd0 0x7f968c0813b0 crc :-1 s=READY pgs=1 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 -- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 msgr2=0x7f96b8109250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b8109250 crc :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 -- 10.20.193.22:0/3323400124 shutdown_connections 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f968c060fd0 0x7f968c0813b0 unknown :-1 s=CLOSED pgs=1 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:6800/1400318633,v1:10.20.193.22:6801/1400318633] conn(0x7f968c03f7a0 0x7f968c05fc50 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 --2- 10.20.193.22:0/3323400124 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f96b811ca00 0x7f96b8109250 unknown :-1 s=CLOSED pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 -- 10.20.193.22:0/3323400124 >> 10.20.193.22:0/3323400124 conn(0x7f96b8057f30 msgr2=0x7f96b80ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 -- 10.20.193.22:0/3323400124 shutdown_connections 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.626+0000 7f96be1ec640 1 -- 10.20.193.22:0/3323400124 wait complete. 2026-02-24T07:20:09.660 INFO:teuthology.orchestra.run.trial022.stdout:mgr epoch 5 is available 2026-02-24T07:20:09.661 INFO:teuthology.orchestra.run.trial022.stdout:Verifying orchestrator module is enabled... 2026-02-24T07:20:10.675 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:10.675 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:10.675 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: Found migration_current of "None". Setting to last migration. 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: mgrmap e7: x(active, since 1.00431s) 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T07:20:10.676 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:10.677 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:10.677 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: [24/Feb/2026:07:20:09] ENGINE Bus STARTING 2026-02-24T07:20:10.677 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2195926110' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-24T07:20:10.677 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:10 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:10.704 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.747+0000 7f47088fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:10.704 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.750+0000 7f47088fa640 1 Processor -- start 2026-02-24T07:20:10.704 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.750+0000 7f47088fa640 1 -- start start 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.750+0000 7f47088fa640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f470011ce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.750+0000 7f47088fa640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f470011d400 con 0x7f470011ca20 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.750+0000 7f470666f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f470011ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.750+0000 7f470666f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f470011ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52794/0 (socket says 10.20.193.22:52794) 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.750+0000 7f470666f640 1 -- 10.20.193.22:0/145733520 learned_addr learned my addr 10.20.193.22:0/145733520 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.750+0000 7f470666f640 1 -- 10.20.193.22:0/145733520 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470011d540 con 0x7f470011ca20 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f470666f640 1 --2- 10.20.193.22:0/145733520 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f470011ce10 crc :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=9800749560591483308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880341cc7b9f01ac server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f470566d640 1 -- 10.20.193.22:0/145733520 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f46f8009d40 con 0x7f470011ca20 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f470566d640 1 -- 10.20.193.22:0/145733520 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f46f800e720 con 0x7f470011ca20 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f470566d640 1 -- 10.20.193.22:0/145733520 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f46f800d660 con 0x7f470011ca20 2026-02-24T07:20:10.705 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f47088fa640 1 -- 10.20.193.22:0/145733520 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 msgr2=0x7f470011ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:10.706 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f47088fa640 1 --2- 10.20.193.22:0/145733520 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f470011ce10 crc :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=9800749560591483308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.706 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f47088fa640 1 -- 10.20.193.22:0/145733520 shutdown_connections 2026-02-24T07:20:10.706 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f47088fa640 1 --2- 10.20.193.22:0/145733520 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f470011ce10 unknown :-1 s=CLOSED pgs=37 gs=1 cs=0 l=1 c_cookie=9800749560591483308 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.706 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f47088fa640 1 -- 10.20.193.22:0/145733520 >> 10.20.193.22:0/145733520 conn(0x7f4700057ef0 msgr2=0x7f47000582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:10.706 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f47088fa640 1 -- 10.20.193.22:0/145733520 shutdown_connections 2026-02-24T07:20:10.706 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f47088fa640 1 -- 10.20.193.22:0/145733520 wait complete. 2026-02-24T07:20:10.706 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.751+0000 7f47088fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:10.706 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f47088fa640 1 Processor -- start 2026-02-24T07:20:10.706 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f47088fa640 1 -- start start 2026-02-24T07:20:10.706 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f47088fa640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f4700109250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f47088fa640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f47001097b0 con 0x7f470011ca20 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f470666f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f4700109250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f470666f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f4700109250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52806/0 (socket says 10.20.193.22:52806) 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f470666f640 1 -- 10.20.193.22:0/2195926110 learned_addr learned my addr 10.20.193.22:0/2195926110 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f470666f640 1 -- 10.20.193.22:0/2195926110 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47001098f0 con 0x7f470011ca20 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f470666f640 1 --2- 10.20.193.22:0/2195926110 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f4700109250 crc :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f46eb7fe640 1 -- 10.20.193.22:0/2195926110 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f46f800d640 con 0x7f470011ca20 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f47088fa640 1 -- 10.20.193.22:0/2195926110 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4700109b40 con 0x7f470011ca20 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f46eb7fe640 1 -- 10.20.193.22:0/2195926110 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f46f800de40 con 0x7f470011ca20 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f46eb7fe640 1 -- 10.20.193.22:0/2195926110 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f46f8013500 con 0x7f470011ca20 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.752+0000 7f47088fa640 1 -- 10.20.193.22:0/2195926110 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470010a430 con 0x7f470011ca20 2026-02-24T07:20:10.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.753+0000 7f47088fa640 1 -- 10.20.193.22:0/2195926110 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470011cdf0 con 0x7f470011ca20 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.753+0000 7f46eb7fe640 1 -- 10.20.193.22:0/2195926110 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 7) ==== 52708+0+0 (crc 0 0 0) 0x7f46f8011040 con 0x7f470011ca20 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.753+0000 7f46eb7fe640 1 --2- 10.20.193.22:0/2195926110 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f46dc03f6d0 0x7f46dc05fb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.753+0000 7f46eb7fe640 1 -- 10.20.193.22:0/2195926110 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f46f8051fc0 con 0x7f470011ca20 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.753+0000 7f4705e6e640 1 --2- 10.20.193.22:0/2195926110 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f46dc03f6d0 0x7f46dc05fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.753+0000 7f4705e6e640 1 --2- 10.20.193.22:0/2195926110 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f46dc03f6d0 0x7f46dc05fb80 crc :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.755+0000 7f46eb7fe640 1 -- 10.20.193.22:0/2195926110 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f46f8013a90 con 0x7f470011ca20 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:09.888+0000 7f47088fa640 1 -- 10.20.193.22:0/2195926110 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "orchestrator"} v 0) -- 0x7f470013eed0 con 0x7f470011ca20 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.672+0000 7f46eb7fe640 1 -- 10.20.193.22:0/2195926110 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "orchestrator"}]=0 module 'orchestrator' is already enabled (always-on) v8) ==== 143+0+0 (crc 0 0 0) 0x7f46f800f760 con 0x7f470011ca20 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.674+0000 7f46eb7fe640 1 -- 10.20.193.22:0/2195926110 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7f46f80149f0 con 0x7f470011ca20 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.675+0000 7f47088fa640 1 -- 10.20.193.22:0/2195926110 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f46dc03f6d0 msgr2=0x7f46dc05fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:10.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.675+0000 7f47088fa640 1 --2- 10.20.193.22:0/2195926110 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f46dc03f6d0 0x7f46dc05fb80 crc :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.675+0000 7f47088fa640 1 -- 10.20.193.22:0/2195926110 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 msgr2=0x7f4700109250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:10.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.675+0000 7f47088fa640 1 --2- 10.20.193.22:0/2195926110 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f4700109250 crc :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.676+0000 7f47088fa640 1 -- 10.20.193.22:0/2195926110 shutdown_connections 2026-02-24T07:20:10.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.676+0000 7f47088fa640 1 --2- 10.20.193.22:0/2195926110 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f46dc03f6d0 0x7f46dc05fb80 unknown :-1 s=CLOSED pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.676+0000 7f47088fa640 1 --2- 10.20.193.22:0/2195926110 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f470011ca20 0x7f4700109250 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.676+0000 7f47088fa640 1 -- 10.20.193.22:0/2195926110 >> 10.20.193.22:0/2195926110 conn(0x7f4700057ef0 msgr2=0x7f47000ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:10.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.676+0000 7f47088fa640 1 -- 10.20.193.22:0/2195926110 shutdown_connections 2026-02-24T07:20:10.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.676+0000 7f47088fa640 1 -- 10.20.193.22:0/2195926110 wait complete. 2026-02-24T07:20:10.709 INFO:teuthology.orchestra.run.trial022.stdout:Setting orchestrator backend to cephadm... 2026-02-24T07:20:10.944 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.791+0000 7f4b3962a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:10.944 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.794+0000 7f4b3962a640 1 Processor -- start 2026-02-24T07:20:10.944 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.794+0000 7f4b3962a640 1 -- start start 2026-02-24T07:20:10.944 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.794+0000 7f4b3962a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b3405d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.794+0000 7f4b3962a640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3405ea00 con 0x7f4b3405cfe0 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.794+0000 7f4b32ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b3405d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.794+0000 7f4b32ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b3405d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52814/0 (socket says 10.20.193.22:52814) 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.794+0000 7f4b32ffd640 1 -- 10.20.193.22:0/3926675876 learned_addr learned my addr 10.20.193.22:0/3926675876 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b32ffd640 1 -- 10.20.193.22:0/3926675876 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3405d910 con 0x7f4b3405cfe0 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b32ffd640 1 --2- 10.20.193.22:0/3926675876 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b3405d3d0 crc :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=1979968842469166222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7a432c01b74c8e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b31ffb640 1 -- 10.20.193.22:0/3926675876 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f4b28009d40 con 0x7f4b3405cfe0 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b31ffb640 1 -- 10.20.193.22:0/3926675876 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f4b2800e720 con 0x7f4b3405cfe0 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b31ffb640 1 -- 10.20.193.22:0/3926675876 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f4b2800d660 con 0x7f4b3405cfe0 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b3962a640 1 -- 10.20.193.22:0/3926675876 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 msgr2=0x7f4b3405d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:10.945 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b3962a640 1 --2- 10.20.193.22:0/3926675876 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b3405d3d0 crc :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=1979968842469166222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b3962a640 1 -- 10.20.193.22:0/3926675876 shutdown_connections 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b3962a640 1 --2- 10.20.193.22:0/3926675876 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b3405d3d0 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=1979968842469166222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b3962a640 1 -- 10.20.193.22:0/3926675876 >> 10.20.193.22:0/3926675876 conn(0x7f4b3405aa30 msgr2=0x7f4b3405ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b3962a640 1 -- 10.20.193.22:0/3926675876 shutdown_connections 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b3962a640 1 -- 10.20.193.22:0/3926675876 wait complete. 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.795+0000 7f4b3962a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b3962a640 1 Processor -- start 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b3962a640 1 -- start start 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b3962a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b34129260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b3962a640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4b341297c0 con 0x7f4b3405cfe0 2026-02-24T07:20:10.946 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b32ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b34129260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b32ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b34129260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52830/0 (socket says 10.20.193.22:52830) 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b32ffd640 1 -- 10.20.193.22:0/849548318 learned_addr learned my addr 10.20.193.22:0/849548318 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b32ffd640 1 -- 10.20.193.22:0/849548318 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b34129900 con 0x7f4b3405cfe0 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b32ffd640 1 --2- 10.20.193.22:0/849548318 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b34129260 crc :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b13fff640 1 -- 10.20.193.22:0/849548318 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f4b2800d640 con 0x7f4b3405cfe0 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b3962a640 1 -- 10.20.193.22:0/849548318 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b34129b50 con 0x7f4b3405cfe0 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b13fff640 1 -- 10.20.193.22:0/849548318 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f4b2800de40 con 0x7f4b3405cfe0 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b13fff640 1 -- 10.20.193.22:0/849548318 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f4b28013500 con 0x7f4b3405cfe0 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.796+0000 7f4b3962a640 1 -- 10.20.193.22:0/849548318 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3412a440 con 0x7f4b3405cfe0 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.797+0000 7f4b3962a640 1 -- 10.20.193.22:0/849548318 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3405d3b0 con 0x7f4b3405cfe0 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.797+0000 7f4b13fff640 1 -- 10.20.193.22:0/849548318 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7f4b28011040 con 0x7f4b3405cfe0 2026-02-24T07:20:10.947 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.797+0000 7f4b13fff640 1 --2- 10.20.193.22:0/849548318 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f4b0803f7a0 0x7f4b0805fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.797+0000 7f4b13fff640 1 -- 10.20.193.22:0/849548318 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f4b280522b0 con 0x7f4b3405cfe0 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.797+0000 7f4b327fc640 1 --2- 10.20.193.22:0/849548318 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f4b0803f7a0 0x7f4b0805fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.797+0000 7f4b327fc640 1 --2- 10.20.193.22:0/849548318 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f4b0803f7a0 0x7f4b0805fc50 crc :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.799+0000 7f4b13fff640 1 -- 10.20.193.22:0/849548318 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f4b28013ae0 con 0x7f4b3405cfe0 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.912+0000 7f4b3962a640 1 -- 10.20.193.22:0/849548318 --> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f4b340fff20 con 0x7f4b0803f7a0 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.916+0000 7f4b13fff640 1 -- 10.20.193.22:0/849548318 <== mgr.14120 v2:10.20.193.22:6800/2169717366 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x7f4b340fff20 con 0x7f4b0803f7a0 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.917+0000 7f4b3962a640 1 -- 10.20.193.22:0/849548318 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f4b0803f7a0 msgr2=0x7f4b0805fc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.917+0000 7f4b3962a640 1 --2- 10.20.193.22:0/849548318 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f4b0803f7a0 0x7f4b0805fc50 crc :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.917+0000 7f4b3962a640 1 -- 10.20.193.22:0/849548318 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 msgr2=0x7f4b34129260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.917+0000 7f4b3962a640 1 --2- 10.20.193.22:0/849548318 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b34129260 crc :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.917+0000 7f4b3962a640 1 -- 10.20.193.22:0/849548318 shutdown_connections 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.917+0000 7f4b3962a640 1 --2- 10.20.193.22:0/849548318 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f4b0803f7a0 0x7f4b0805fc50 unknown :-1 s=CLOSED pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.948 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.917+0000 7f4b3962a640 1 --2- 10.20.193.22:0/849548318 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4b3405cfe0 0x7f4b34129260 unknown :-1 s=CLOSED pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:10.949 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.917+0000 7f4b3962a640 1 -- 10.20.193.22:0/849548318 >> 10.20.193.22:0/849548318 conn(0x7f4b3405aa30 msgr2=0x7f4b340ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:10.949 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.917+0000 7f4b3962a640 1 -- 10.20.193.22:0/849548318 shutdown_connections 2026-02-24T07:20:10.949 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:10.917+0000 7f4b3962a640 1 -- 10.20.193.22:0/849548318 wait complete. 2026-02-24T07:20:11.164 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-24T07:20:11.164 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.026+0000 7f1872f7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:11.164 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.028+0000 7f1872f7d640 1 Processor -- start 2026-02-24T07:20:11.164 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.028+0000 7f1872f7d640 1 -- start start 2026-02-24T07:20:11.164 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.028+0000 7f1872f7d640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c11cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.028+0000 7f1872f7d640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f186c11d3e0 con 0x7f186c11ca00 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.028+0000 7f1870cf2640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c11cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.028+0000 7f1870cf2640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c11cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52836/0 (socket says 10.20.193.22:52836) 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.028+0000 7f1870cf2640 1 -- 10.20.193.22:0/765375872 learned_addr learned my addr 10.20.193.22:0/765375872 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.028+0000 7f1870cf2640 1 -- 10.20.193.22:0/765375872 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c11d520 con 0x7f186c11ca00 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1870cf2640 1 --2- 10.20.193.22:0/765375872 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c11cdf0 crc :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=10406705021770600732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906c0b1488e9111c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f18637fe640 1 -- 10.20.193.22:0/765375872 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f185c009d40 con 0x7f186c11ca00 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f18637fe640 1 -- 10.20.193.22:0/765375872 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f185c00e720 con 0x7f186c11ca00 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f18637fe640 1 -- 10.20.193.22:0/765375872 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f185c00d660 con 0x7f186c11ca00 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 -- 10.20.193.22:0/765375872 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 msgr2=0x7f186c11cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 --2- 10.20.193.22:0/765375872 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c11cdf0 crc :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=10406705021770600732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.165 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 -- 10.20.193.22:0/765375872 shutdown_connections 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 --2- 10.20.193.22:0/765375872 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c11cdf0 unknown :-1 s=CLOSED pgs=41 gs=1 cs=0 l=1 c_cookie=10406705021770600732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 -- 10.20.193.22:0/765375872 >> 10.20.193.22:0/765375872 conn(0x7f186c057f30 msgr2=0x7f186c058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 -- 10.20.193.22:0/765375872 shutdown_connections 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 -- 10.20.193.22:0/765375872 wait complete. 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 Processor -- start 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 -- start start 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c109250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1872f7d640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1097b0 con 0x7f186c11ca00 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.029+0000 7f1870cf2640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c109250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1870cf2640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c109250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52846/0 (socket says 10.20.193.22:52846) 2026-02-24T07:20:11.166 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1870cf2640 1 -- 10.20.193.22:0/3928247053 learned_addr learned my addr 10.20.193.22:0/3928247053 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1870cf2640 1 -- 10.20.193.22:0/3928247053 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c1098f0 con 0x7f186c11ca00 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1870cf2640 1 --2- 10.20.193.22:0/3928247053 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c109250 crc :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1861ffb640 1 -- 10.20.193.22:0/3928247053 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f185c00d640 con 0x7f186c11ca00 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1861ffb640 1 -- 10.20.193.22:0/3928247053 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f185c00de40 con 0x7f186c11ca00 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1872f7d640 1 -- 10.20.193.22:0/3928247053 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186c109b40 con 0x7f186c11ca00 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1861ffb640 1 -- 10.20.193.22:0/3928247053 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f185c013500 con 0x7f186c11ca00 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1872f7d640 1 -- 10.20.193.22:0/3928247053 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c10a430 con 0x7f186c11ca00 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1872f7d640 1 -- 10.20.193.22:0/3928247053 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f186c11cdd0 con 0x7f186c11ca00 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.030+0000 7f1861ffb640 1 -- 10.20.193.22:0/3928247053 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7f185c011040 con 0x7f186c11ca00 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.031+0000 7f1861ffb640 1 --2- 10.20.193.22:0/3928247053 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f184803f7f0 0x7f184805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.031+0000 7f1861ffb640 1 -- 10.20.193.22:0/3928247053 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f185c0521d0 con 0x7f186c11ca00 2026-02-24T07:20:11.167 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.031+0000 7f1863fff640 1 --2- 10.20.193.22:0/3928247053 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f184803f7f0 0x7f184805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.031+0000 7f1863fff640 1 --2- 10.20.193.22:0/3928247053 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f184803f7f0 0x7f184805fca0 crc :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.033+0000 7f1861ffb640 1 -- 10.20.193.22:0/3928247053 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f185c013a90 con 0x7f186c11ca00 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.136+0000 7f1872f7d640 1 -- 10.20.193.22:0/3928247053 --> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f186c0fff20 con 0x7f184803f7f0 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.136+0000 7f1861ffb640 1 -- 10.20.193.22:0/3928247053 <== mgr.14120 v2:10.20.193.22:6800/2169717366 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (crc 0 0 0) 0x7f186c0fff20 con 0x7f184803f7f0 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.137+0000 7f1872f7d640 1 -- 10.20.193.22:0/3928247053 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f184803f7f0 msgr2=0x7f184805fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.137+0000 7f1872f7d640 1 --2- 10.20.193.22:0/3928247053 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f184803f7f0 0x7f184805fca0 crc :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.137+0000 7f1872f7d640 1 -- 10.20.193.22:0/3928247053 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 msgr2=0x7f186c109250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.137+0000 7f1872f7d640 1 --2- 10.20.193.22:0/3928247053 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c109250 crc :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.137+0000 7f1872f7d640 1 -- 10.20.193.22:0/3928247053 shutdown_connections 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.137+0000 7f1872f7d640 1 --2- 10.20.193.22:0/3928247053 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f184803f7f0 0x7f184805fca0 unknown :-1 s=CLOSED pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.137+0000 7f1872f7d640 1 --2- 10.20.193.22:0/3928247053 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f186c11ca00 0x7f186c109250 unknown :-1 s=CLOSED pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.168 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.137+0000 7f1872f7d640 1 -- 10.20.193.22:0/3928247053 >> 10.20.193.22:0/3928247053 conn(0x7f186c057f30 msgr2=0x7f186c0ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:11.169 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.137+0000 7f1872f7d640 1 -- 10.20.193.22:0/3928247053 shutdown_connections 2026-02-24T07:20:11.169 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.137+0000 7f1872f7d640 1 -- 10.20.193.22:0/3928247053 wait complete. 2026-02-24T07:20:11.169 INFO:teuthology.orchestra.run.trial022.stdout:Generating ssh key... 2026-02-24T07:20:11.405 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.244+0000 7f3ece521640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:11.405 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.246+0000 7f3ece521640 1 Processor -- start 2026-02-24T07:20:11.405 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.246+0000 7f3ece521640 1 -- start start 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.246+0000 7f3ece521640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec811cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.246+0000 7f3ece521640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec811d3e0 con 0x7f3ec811ca00 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.246+0000 7f3ec7fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec811cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.246+0000 7f3ec7fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec811cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52858/0 (socket says 10.20.193.22:52858) 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.246+0000 7f3ec7fff640 1 -- 10.20.193.22:0/2772268321 learned_addr learned my addr 10.20.193.22:0/2772268321 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ec7fff640 1 -- 10.20.193.22:0/2772268321 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec811d520 con 0x7f3ec811ca00 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ec7fff640 1 --2- 10.20.193.22:0/2772268321 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec811cdf0 crc :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=14290631140037693468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c652854e8e15101c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ec6ffd640 1 -- 10.20.193.22:0/2772268321 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f3eb4009d40 con 0x7f3ec811ca00 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ec6ffd640 1 -- 10.20.193.22:0/2772268321 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f3eb400e720 con 0x7f3ec811ca00 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ec6ffd640 1 -- 10.20.193.22:0/2772268321 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f3eb400d660 con 0x7f3ec811ca00 2026-02-24T07:20:11.406 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ece521640 1 -- 10.20.193.22:0/2772268321 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 msgr2=0x7f3ec811cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:11.407 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ece521640 1 --2- 10.20.193.22:0/2772268321 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec811cdf0 crc :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=14290631140037693468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.407 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ece521640 1 -- 10.20.193.22:0/2772268321 shutdown_connections 2026-02-24T07:20:11.407 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ece521640 1 --2- 10.20.193.22:0/2772268321 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec811cdf0 unknown :-1 s=CLOSED pgs=43 gs=1 cs=0 l=1 c_cookie=14290631140037693468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.407 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ece521640 1 -- 10.20.193.22:0/2772268321 >> 10.20.193.22:0/2772268321 conn(0x7f3ec8057f30 msgr2=0x7f3ec8058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:11.407 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ece521640 1 -- 10.20.193.22:0/2772268321 shutdown_connections 2026-02-24T07:20:11.407 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ece521640 1 -- 10.20.193.22:0/2772268321 wait complete. 2026-02-24T07:20:11.407 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ece521640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:11.407 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.247+0000 7f3ece521640 1 Processor -- start 2026-02-24T07:20:11.407 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ece521640 1 -- start start 2026-02-24T07:20:11.407 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ece521640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec8109250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ece521640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec81097b0 con 0x7f3ec811ca00 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ec7fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec8109250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ec7fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec8109250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52864/0 (socket says 10.20.193.22:52864) 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ec7fff640 1 -- 10.20.193.22:0/1317210216 learned_addr learned my addr 10.20.193.22:0/1317210216 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ec7fff640 1 -- 10.20.193.22:0/1317210216 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec81098f0 con 0x7f3ec811ca00 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ec7fff640 1 --2- 10.20.193.22:0/1317210216 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec8109250 crc :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ec57fa640 1 -- 10.20.193.22:0/1317210216 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f3eb400d640 con 0x7f3ec811ca00 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ec57fa640 1 -- 10.20.193.22:0/1317210216 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f3eb400de40 con 0x7f3ec811ca00 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ece521640 1 -- 10.20.193.22:0/1317210216 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec8109b40 con 0x7f3ec811ca00 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ec57fa640 1 -- 10.20.193.22:0/1317210216 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f3eb4013500 con 0x7f3ec811ca00 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ece521640 1 -- 10.20.193.22:0/1317210216 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec810a430 con 0x7f3ec811ca00 2026-02-24T07:20:11.408 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.248+0000 7f3ece521640 1 -- 10.20.193.22:0/1317210216 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec811cdd0 con 0x7f3ec811ca00 2026-02-24T07:20:11.409 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.249+0000 7f3ec57fa640 1 -- 10.20.193.22:0/1317210216 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7f3eb4011040 con 0x7f3ec811ca00 2026-02-24T07:20:11.409 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.249+0000 7f3ec57fa640 1 --2- 10.20.193.22:0/1317210216 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f3e9c03f7f0 0x7f3e9c05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:11.409 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.249+0000 7f3ec57fa640 1 -- 10.20.193.22:0/1317210216 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f3eb40521d0 con 0x7f3ec811ca00 2026-02-24T07:20:11.409 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.249+0000 7f3ec77fe640 1 --2- 10.20.193.22:0/1317210216 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f3e9c03f7f0 0x7f3e9c05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:11.409 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.249+0000 7f3ec77fe640 1 --2- 10.20.193.22:0/1317210216 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f3e9c03f7f0 0x7f3e9c05fca0 crc :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:11.409 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.251+0000 7f3ec57fa640 1 -- 10.20.193.22:0/1317210216 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f3eb4013a90 con 0x7f3ec811ca00 2026-02-24T07:20:11.409 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.356+0000 7f3ece521640 1 -- 10.20.193.22:0/1317210216 --> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f3ec80fff20 con 0x7f3e9c03f7f0 2026-02-24T07:20:11.409 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.378+0000 7f3ec57fa640 1 -- 10.20.193.22:0/1317210216 <== mgr.14120 v2:10.20.193.22:6800/2169717366 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x7f3ec80fff20 con 0x7f3e9c03f7f0 2026-02-24T07:20:11.409 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.379+0000 7f3ece521640 1 -- 10.20.193.22:0/1317210216 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f3e9c03f7f0 msgr2=0x7f3e9c05fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:11.410 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.379+0000 7f3ece521640 1 --2- 10.20.193.22:0/1317210216 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f3e9c03f7f0 0x7f3e9c05fca0 crc :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.410 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.379+0000 7f3ece521640 1 -- 10.20.193.22:0/1317210216 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 msgr2=0x7f3ec8109250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:11.410 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.379+0000 7f3ece521640 1 --2- 10.20.193.22:0/1317210216 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec8109250 crc :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.410 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.379+0000 7f3ece521640 1 -- 10.20.193.22:0/1317210216 shutdown_connections 2026-02-24T07:20:11.410 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.379+0000 7f3ece521640 1 --2- 10.20.193.22:0/1317210216 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f3e9c03f7f0 0x7f3e9c05fca0 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.410 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.379+0000 7f3ece521640 1 --2- 10.20.193.22:0/1317210216 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3ec811ca00 0x7f3ec8109250 unknown :-1 s=CLOSED pgs=44 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.410 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.379+0000 7f3ece521640 1 -- 10.20.193.22:0/1317210216 >> 10.20.193.22:0/1317210216 conn(0x7f3ec8057f30 msgr2=0x7f3ec80ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:11.410 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.379+0000 7f3ece521640 1 -- 10.20.193.22:0/1317210216 shutdown_connections 2026-02-24T07:20:11.410 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.379+0000 7f3ece521640 1 -- 10.20.193.22:0/1317210216 wait complete. 2026-02-24T07:20:11.439 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: Generating public/private ed25519 key pair. 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: Your identification has been saved in /tmp/tmpz0cgqqg3/key 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: Your public key has been saved in /tmp/tmpz0cgqqg3/key.pub 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: The key fingerprint is: 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: SHA256:DdhkJseJZ8ecL0eH/Yaz7CLDeRhi1XSkLflQFCWJKy4 ceph-30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: The key's randomart image is: 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: +--[ED25519 256]--+ 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: | .o=+ . **+.| 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: | .O= = ===. | 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: | .oo. ==+.o | 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: | o+ =+o o| 2026-02-24T07:20:11.440 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: | So.+ ..+ | 2026-02-24T07:20:11.441 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: | E o o | 2026-02-24T07:20:11.441 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: | . + + . | 2026-02-24T07:20:11.441 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: | * o . | 2026-02-24T07:20:11.441 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: | + . | 2026-02-24T07:20:11.441 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:11 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: +----[SHA256]-----+ 2026-02-24T07:20:11.626 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJoUmQXuRMLhM4tr38N7h23w4q8GeJoP/9kPxPX8Inxh ceph-30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:20:11.626 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.487+0000 7f1183abf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:11.626 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.490+0000 7f1183abf640 1 Processor -- start 2026-02-24T07:20:11.626 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.490+0000 7f1183abf640 1 -- start start 2026-02-24T07:20:11.626 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.490+0000 7f1183abf640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c11cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:11.626 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.490+0000 7f1183abf640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f117c11d3e0 con 0x7f117c11ca00 2026-02-24T07:20:11.626 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.490+0000 7f1181834640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c11cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.490+0000 7f1181834640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c11cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52872/0 (socket says 10.20.193.22:52872) 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.490+0000 7f1181834640 1 -- 10.20.193.22:0/1185914709 learned_addr learned my addr 10.20.193.22:0/1185914709 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.490+0000 7f1181834640 1 -- 10.20.193.22:0/1185914709 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c11d520 con 0x7f117c11ca00 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.490+0000 7f1181834640 1 --2- 10.20.193.22:0/1185914709 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c11cdf0 crc :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=5648542584496008808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e63a78da78d2e68 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.490+0000 7f1180832640 1 -- 10.20.193.22:0/1185914709 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f116c009d40 con 0x7f117c11ca00 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1180832640 1 -- 10.20.193.22:0/1185914709 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f116c00e720 con 0x7f117c11ca00 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1180832640 1 -- 10.20.193.22:0/1185914709 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f116c00d660 con 0x7f117c11ca00 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 -- 10.20.193.22:0/1185914709 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 msgr2=0x7f117c11cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 --2- 10.20.193.22:0/1185914709 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c11cdf0 crc :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=5648542584496008808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 -- 10.20.193.22:0/1185914709 shutdown_connections 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 --2- 10.20.193.22:0/1185914709 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c11cdf0 unknown :-1 s=CLOSED pgs=45 gs=1 cs=0 l=1 c_cookie=5648542584496008808 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.627 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 -- 10.20.193.22:0/1185914709 >> 10.20.193.22:0/1185914709 conn(0x7f117c057f30 msgr2=0x7f117c058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 -- 10.20.193.22:0/1185914709 shutdown_connections 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 -- 10.20.193.22:0/1185914709 wait complete. 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 Processor -- start 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 -- start start 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c109250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1183abf640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f117c1097b0 con 0x7f117c11ca00 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1181834640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c109250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1181834640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c109250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52880/0 (socket says 10.20.193.22:52880) 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.491+0000 7f1181834640 1 -- 10.20.193.22:0/2745694065 learned_addr learned my addr 10.20.193.22:0/2745694065 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f1181834640 1 -- 10.20.193.22:0/2745694065 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c1098f0 con 0x7f117c11ca00 2026-02-24T07:20:11.628 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f1181834640 1 --2- 10.20.193.22:0/2745694065 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c109250 crc :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f116affd640 1 -- 10.20.193.22:0/2745694065 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f116c00d640 con 0x7f117c11ca00 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f116affd640 1 -- 10.20.193.22:0/2745694065 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f116c00de40 con 0x7f117c11ca00 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f116affd640 1 -- 10.20.193.22:0/2745694065 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f116c013500 con 0x7f117c11ca00 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f1183abf640 1 -- 10.20.193.22:0/2745694065 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f117c109b40 con 0x7f117c11ca00 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f1183abf640 1 -- 10.20.193.22:0/2745694065 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f117c10a430 con 0x7f117c11ca00 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f1183abf640 1 -- 10.20.193.22:0/2745694065 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117c11cdd0 con 0x7f117c11ca00 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f116affd640 1 -- 10.20.193.22:0/2745694065 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7f116c011040 con 0x7f117c11ca00 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f116affd640 1 --2- 10.20.193.22:0/2745694065 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f115803f7f0 0x7f115805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.492+0000 7f116affd640 1 -- 10.20.193.22:0/2745694065 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f116c0521d0 con 0x7f117c11ca00 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.493+0000 7f1181033640 1 --2- 10.20.193.22:0/2745694065 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f115803f7f0 0x7f115805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.493+0000 7f1181033640 1 --2- 10.20.193.22:0/2745694065 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f115803f7f0 0x7f115805fca0 crc :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:11.629 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.494+0000 7f116affd640 1 -- 10.20.193.22:0/2745694065 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f116c013a90 con 0x7f117c11ca00 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.599+0000 7f1183abf640 1 -- 10.20.193.22:0/2745694065 --> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f117c0fff20 con 0x7f115803f7f0 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.600+0000 7f116affd640 1 -- 10.20.193.22:0/2745694065 <== mgr.14120 v2:10.20.193.22:6800/2169717366 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+123 (crc 0 0 0) 0x7f117c0fff20 con 0x7f115803f7f0 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.601+0000 7f1183abf640 1 -- 10.20.193.22:0/2745694065 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f115803f7f0 msgr2=0x7f115805fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.601+0000 7f1183abf640 1 --2- 10.20.193.22:0/2745694065 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f115803f7f0 0x7f115805fca0 crc :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.601+0000 7f1183abf640 1 -- 10.20.193.22:0/2745694065 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 msgr2=0x7f117c109250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.601+0000 7f1183abf640 1 --2- 10.20.193.22:0/2745694065 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c109250 crc :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.601+0000 7f1183abf640 1 -- 10.20.193.22:0/2745694065 shutdown_connections 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.601+0000 7f1183abf640 1 --2- 10.20.193.22:0/2745694065 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f115803f7f0 0x7f115805fca0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.601+0000 7f1183abf640 1 --2- 10.20.193.22:0/2745694065 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f117c11ca00 0x7f117c109250 unknown :-1 s=CLOSED pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.601+0000 7f1183abf640 1 -- 10.20.193.22:0/2745694065 >> 10.20.193.22:0/2745694065 conn(0x7f117c057f30 msgr2=0x7f117c0ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:11.630 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.601+0000 7f1183abf640 1 -- 10.20.193.22:0/2745694065 shutdown_connections 2026-02-24T07:20:11.631 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.601+0000 7f1183abf640 1 -- 10.20.193.22:0/2745694065 wait complete. 2026-02-24T07:20:11.631 INFO:teuthology.orchestra.run.trial022.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-24T07:20:11.631 INFO:teuthology.orchestra.run.trial022.stdout:Adding key to root@localhost authorized_keys... 2026-02-24T07:20:11.631 INFO:teuthology.orchestra.run.trial022.stdout:Adding host trial022... 2026-02-24T07:20:11.715 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:11 trial022 ceph-mon[39108]: [24/Feb/2026:07:20:09] ENGINE Serving on http://10.20.193.22:8765 2026-02-24T07:20:11.715 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:11 trial022 ceph-mon[39108]: [24/Feb/2026:07:20:10] ENGINE Serving on https://10.20.193.22:7150 2026-02-24T07:20:11.715 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:11 trial022 ceph-mon[39108]: [24/Feb/2026:07:20:10] ENGINE Bus STARTED 2026-02-24T07:20:11.715 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:11 trial022 ceph-mon[39108]: [24/Feb/2026:07:20:10] ENGINE Client ('10.20.193.22', 44688) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T07:20:11.715 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:11 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2195926110' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-24T07:20:11.716 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:11 trial022 ceph-mon[39108]: mgrmap e8: x(active, since 2s) 2026-02-24T07:20:11.716 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:11 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:11.716 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:11 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:11.716 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:11 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:11.716 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:11 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:12.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:12 trial022 ceph-mon[39108]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:12.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:12 trial022 ceph-mon[39108]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:12.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:12 trial022 ceph-mon[39108]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:12.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:12 trial022 ceph-mon[39108]: Generating ssh key... 2026-02-24T07:20:12.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:12 trial022 ceph-mon[39108]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:12.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:12 trial022 ceph-mon[39108]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial022", "addr": "10.20.193.22", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:13.424 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout Added host 'trial022' with addr '10.20.193.22' 2026-02-24T07:20:13.424 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.709+0000 7f095605e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:13.424 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f095605e640 1 Processor -- start 2026-02-24T07:20:13.424 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f095605e640 1 -- start start 2026-02-24T07:20:13.424 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f095605e640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f095011ce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:13.424 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f095605e640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f095011d400 con 0x7f095011ca20 2026-02-24T07:20:13.424 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f094f7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f095011ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f094f7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f095011ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52896/0 (socket says 10.20.193.22:52896) 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f094f7fe640 1 -- 10.20.193.22:0/3835157689 learned_addr learned my addr 10.20.193.22:0/3835157689 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f094f7fe640 1 -- 10.20.193.22:0/3835157689 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095011d540 con 0x7f095011ca20 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f094f7fe640 1 --2- 10.20.193.22:0/3835157689 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f095011ce10 crc :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=12416221746031998242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4f47e4e0b7b522 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f094e7fc640 1 -- 10.20.193.22:0/3835157689 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0940009d40 con 0x7f095011ca20 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f094e7fc640 1 -- 10.20.193.22:0/3835157689 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f094000e720 con 0x7f095011ca20 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.713+0000 7f094e7fc640 1 -- 10.20.193.22:0/3835157689 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f094000d660 con 0x7f095011ca20 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 -- 10.20.193.22:0/3835157689 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 msgr2=0x7f095011ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 --2- 10.20.193.22:0/3835157689 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f095011ce10 crc :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=12416221746031998242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 -- 10.20.193.22:0/3835157689 shutdown_connections 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 --2- 10.20.193.22:0/3835157689 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f095011ce10 unknown :-1 s=CLOSED pgs=47 gs=1 cs=0 l=1 c_cookie=12416221746031998242 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.425 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 -- 10.20.193.22:0/3835157689 >> 10.20.193.22:0/3835157689 conn(0x7f0950057ef0 msgr2=0x7f09500582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 -- 10.20.193.22:0/3835157689 shutdown_connections 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 -- 10.20.193.22:0/3835157689 wait complete. 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 Processor -- start 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 -- start start 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f0950109250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f095605e640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f09501097b0 con 0x7f095011ca20 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f094f7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f0950109250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f094f7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f0950109250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52908/0 (socket says 10.20.193.22:52908) 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.715+0000 7f094f7fe640 1 -- 10.20.193.22:0/2621565278 learned_addr learned my addr 10.20.193.22:0/2621565278 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f094f7fe640 1 -- 10.20.193.22:0/2621565278 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09501098f0 con 0x7f095011ca20 2026-02-24T07:20:13.426 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f094f7fe640 1 --2- 10.20.193.22:0/2621565278 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f0950109250 crc :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f094cff9640 1 -- 10.20.193.22:0/2621565278 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f094000ed70 con 0x7f095011ca20 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f094cff9640 1 -- 10.20.193.22:0/2621565278 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7f094000ddf0 con 0x7f095011ca20 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f095605e640 1 -- 10.20.193.22:0/2621565278 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0950109b40 con 0x7f095011ca20 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f094cff9640 1 -- 10.20.193.22:0/2621565278 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0940013570 con 0x7f095011ca20 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f095605e640 1 -- 10.20.193.22:0/2621565278 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095010a430 con 0x7f095011ca20 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f095605e640 1 -- 10.20.193.22:0/2621565278 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f095011cdf0 con 0x7f095011ca20 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f094cff9640 1 -- 10.20.193.22:0/2621565278 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7f0940011040 con 0x7f095011ca20 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f094cff9640 1 --2- 10.20.193.22:0/2621565278 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f092403f7f0 0x7f092405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f094cff9640 1 -- 10.20.193.22:0/2621565278 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f0940052260 con 0x7f095011ca20 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.716+0000 7f094effd640 1 --2- 10.20.193.22:0/2621565278 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f092403f7f0 0x7f092405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.717+0000 7f094effd640 1 --2- 10.20.193.22:0/2621565278 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f092403f7f0 0x7f092405fca0 crc :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:13.427 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.718+0000 7f094cff9640 1 -- 10.20.193.22:0/2621565278 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f094000fcd0 con 0x7f095011ca20 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:11.824+0000 7f095605e640 1 -- 10.20.193.22:0/2621565278 --> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial022", "addr": "10.20.193.22", "target": ["mon-mgr", ""]}) -- 0x7f095010af30 con 0x7f092403f7f0 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.373+0000 7f094cff9640 1 -- 10.20.193.22:0/2621565278 <== mgr.14120 v2:10.20.193.22:6800/2169717366 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (crc 0 0 0) 0x7f095010af30 con 0x7f092403f7f0 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.376+0000 7f095605e640 1 -- 10.20.193.22:0/2621565278 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f092403f7f0 msgr2=0x7f092405fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.376+0000 7f095605e640 1 --2- 10.20.193.22:0/2621565278 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f092403f7f0 0x7f092405fca0 crc :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.376+0000 7f095605e640 1 -- 10.20.193.22:0/2621565278 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 msgr2=0x7f0950109250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.376+0000 7f095605e640 1 --2- 10.20.193.22:0/2621565278 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f0950109250 crc :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.376+0000 7f095605e640 1 -- 10.20.193.22:0/2621565278 shutdown_connections 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.376+0000 7f095605e640 1 --2- 10.20.193.22:0/2621565278 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f092403f7f0 0x7f092405fca0 unknown :-1 s=CLOSED pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.376+0000 7f095605e640 1 --2- 10.20.193.22:0/2621565278 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f095011ca20 0x7f0950109250 unknown :-1 s=CLOSED pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.376+0000 7f095605e640 1 -- 10.20.193.22:0/2621565278 >> 10.20.193.22:0/2621565278 conn(0x7f0950057ef0 msgr2=0x7f09500ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.376+0000 7f095605e640 1 -- 10.20.193.22:0/2621565278 shutdown_connections 2026-02-24T07:20:13.428 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.376+0000 7f095605e640 1 -- 10.20.193.22:0/2621565278 wait complete. 2026-02-24T07:20:13.429 INFO:teuthology.orchestra.run.trial022.stdout:Deploying unmanaged mon service... 2026-02-24T07:20:13.674 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-24T07:20:13.675 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.523+0000 7fbee7ee2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:13.675 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.526+0000 7fbee7ee2640 1 Processor -- start 2026-02-24T07:20:13.675 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.526+0000 7fbee7ee2640 1 -- start start 2026-02-24T07:20:13.675 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.526+0000 7fbee7ee2640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee005be30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:13.675 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.526+0000 7fbee7ee2640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbee005c370 con 0x7fbee005ba40 2026-02-24T07:20:13.675 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.526+0000 7fbee5c57640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee005be30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:13.675 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.526+0000 7fbee5c57640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee005be30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:43926/0 (socket says 10.20.193.22:43926) 2026-02-24T07:20:13.675 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.526+0000 7fbee5c57640 1 -- 10.20.193.22:0/3178976403 learned_addr learned my addr 10.20.193.22:0/3178976403 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee5c57640 1 -- 10.20.193.22:0/3178976403 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee005c4b0 con 0x7fbee005ba40 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee5c57640 1 --2- 10.20.193.22:0/3178976403 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee005be30 crc :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=5649973678797972038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e68bd20430f6246 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee4c55640 1 -- 10.20.193.22:0/3178976403 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fbed0009d40 con 0x7fbee005ba40 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee4c55640 1 -- 10.20.193.22:0/3178976403 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7fbed000e720 con 0x7fbee005ba40 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee4c55640 1 -- 10.20.193.22:0/3178976403 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fbed000d660 con 0x7fbee005ba40 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee7ee2640 1 -- 10.20.193.22:0/3178976403 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 msgr2=0x7fbee005be30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee7ee2640 1 --2- 10.20.193.22:0/3178976403 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee005be30 crc :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=5649973678797972038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee7ee2640 1 -- 10.20.193.22:0/3178976403 shutdown_connections 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee7ee2640 1 --2- 10.20.193.22:0/3178976403 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee005be30 unknown :-1 s=CLOSED pgs=49 gs=1 cs=0 l=1 c_cookie=5649973678797972038 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee7ee2640 1 -- 10.20.193.22:0/3178976403 >> 10.20.193.22:0/3178976403 conn(0x7fbee00594e0 msgr2=0x7fbee00598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee7ee2640 1 -- 10.20.193.22:0/3178976403 shutdown_connections 2026-02-24T07:20:13.676 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee7ee2640 1 -- 10.20.193.22:0/3178976403 wait complete. 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.527+0000 7fbee7ee2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee7ee2640 1 Processor -- start 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee7ee2640 1 -- start start 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee7ee2640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee0129220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee7ee2640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0129780 con 0x7fbee005ba40 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee5c57640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee0129220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee5c57640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee0129220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:43930/0 (socket says 10.20.193.22:43930) 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee5c57640 1 -- 10.20.193.22:0/465577696 learned_addr learned my addr 10.20.193.22:0/465577696 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee5c57640 1 -- 10.20.193.22:0/465577696 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee01298c0 con 0x7fbee005ba40 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee5c57640 1 --2- 10.20.193.22:0/465577696 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee0129220 crc :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:13.677 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbeceffd640 1 -- 10.20.193.22:0/465577696 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fbed000d640 con 0x7fbee005ba40 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee7ee2640 1 -- 10.20.193.22:0/465577696 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee0129b10 con 0x7fbee005ba40 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbeceffd640 1 -- 10.20.193.22:0/465577696 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7fbed000de40 con 0x7fbee005ba40 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbeceffd640 1 -- 10.20.193.22:0/465577696 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fbed0013500 con 0x7fbee005ba40 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.528+0000 7fbee7ee2640 1 -- 10.20.193.22:0/465577696 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee012a400 con 0x7fbee005ba40 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.529+0000 7fbee7ee2640 1 -- 10.20.193.22:0/465577696 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee005be10 con 0x7fbee005ba40 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.529+0000 7fbeceffd640 1 -- 10.20.193.22:0/465577696 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7fbed0011040 con 0x7fbee005ba40 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.529+0000 7fbeceffd640 1 --2- 10.20.193.22:0/465577696 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fbebc03f7f0 0x7fbebc05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.529+0000 7fbeceffd640 1 -- 10.20.193.22:0/465577696 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7fbed00521d0 con 0x7fbee005ba40 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.529+0000 7fbee5456640 1 --2- 10.20.193.22:0/465577696 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fbebc03f7f0 0x7fbebc05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.529+0000 7fbee5456640 1 --2- 10.20.193.22:0/465577696 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fbebc03f7f0 0x7fbebc05fca0 crc :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.531+0000 7fbeceffd640 1 -- 10.20.193.22:0/465577696 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fbed0013a90 con 0x7fbee005ba40 2026-02-24T07:20:13.678 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.643+0000 7fbee7ee2640 1 -- 10.20.193.22:0/465577696 --> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fbee013cff0 con 0x7fbebc03f7f0 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.647+0000 7fbeceffd640 1 -- 10.20.193.22:0/465577696 <== mgr.14120 v2:10.20.193.22:6800/2169717366 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (crc 0 0 0) 0x7fbee013cff0 con 0x7fbebc03f7f0 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.648+0000 7fbee7ee2640 1 -- 10.20.193.22:0/465577696 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fbebc03f7f0 msgr2=0x7fbebc05fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.648+0000 7fbee7ee2640 1 --2- 10.20.193.22:0/465577696 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fbebc03f7f0 0x7fbebc05fca0 crc :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.648+0000 7fbee7ee2640 1 -- 10.20.193.22:0/465577696 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 msgr2=0x7fbee0129220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.648+0000 7fbee7ee2640 1 --2- 10.20.193.22:0/465577696 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee0129220 crc :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.648+0000 7fbee7ee2640 1 -- 10.20.193.22:0/465577696 shutdown_connections 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.648+0000 7fbee7ee2640 1 --2- 10.20.193.22:0/465577696 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fbebc03f7f0 0x7fbebc05fca0 unknown :-1 s=CLOSED pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.648+0000 7fbee7ee2640 1 --2- 10.20.193.22:0/465577696 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbee005ba40 0x7fbee0129220 unknown :-1 s=CLOSED pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.648+0000 7fbee7ee2640 1 -- 10.20.193.22:0/465577696 >> 10.20.193.22:0/465577696 conn(0x7fbee00594e0 msgr2=0x7fbee00ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.648+0000 7fbee7ee2640 1 -- 10.20.193.22:0/465577696 shutdown_connections 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.648+0000 7fbee7ee2640 1 -- 10.20.193.22:0/465577696 wait complete. 2026-02-24T07:20:13.679 INFO:teuthology.orchestra.run.trial022.stdout:Deploying unmanaged mgr service... 2026-02-24T07:20:13.898 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:13 trial022 ceph-mon[39108]: Deploying cephadm binary to trial022 2026-02-24T07:20:13.898 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:13 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:13.898 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:13 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:13.899 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:13 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:13.915 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-24T07:20:13.915 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.756+0000 7fc75a7b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:13.916 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc75a7b6640 1 Processor -- start 2026-02-24T07:20:13.916 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc75a7b6640 1 -- start start 2026-02-24T07:20:13.916 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc75a7b6640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc7540570c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:13.916 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc75a7b6640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc754057600 con 0x7fc754056cd0 2026-02-24T07:20:13.916 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc753fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc7540570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:13.916 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc753fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc7540570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:43942/0 (socket says 10.20.193.22:43942) 2026-02-24T07:20:13.916 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc753fff640 1 -- 10.20.193.22:0/3134879888 learned_addr learned my addr 10.20.193.22:0/3134879888 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:13.916 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc753fff640 1 -- 10.20.193.22:0/3134879888 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc754057740 con 0x7fc754056cd0 2026-02-24T07:20:13.916 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc753fff640 1 --2- 10.20.193.22:0/3134879888 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc7540570c0 crc :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=7669788569682333436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7090115e444efc server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:13.916 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc752ffd640 1 -- 10.20.193.22:0/3134879888 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc740009d40 con 0x7fc754056cd0 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc752ffd640 1 -- 10.20.193.22:0/3134879888 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7fc74000e720 con 0x7fc754056cd0 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.760+0000 7fc752ffd640 1 -- 10.20.193.22:0/3134879888 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc74000d660 con 0x7fc754056cd0 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3134879888 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 msgr2=0x7fc7540570c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 --2- 10.20.193.22:0/3134879888 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc7540570c0 crc :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=7669788569682333436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3134879888 shutdown_connections 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 --2- 10.20.193.22:0/3134879888 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc7540570c0 unknown :-1 s=CLOSED pgs=51 gs=1 cs=0 l=1 c_cookie=7669788569682333436 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3134879888 >> 10.20.193.22:0/3134879888 conn(0x7fc754059d80 msgr2=0x7fc75405a180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3134879888 shutdown_connections 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3134879888 wait complete. 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:13.917 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 Processor -- start 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 -- start start 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc754129220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc754129780 con 0x7fc754056cd0 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc753fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc754129220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc753fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc754129220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:43948/0 (socket says 10.20.193.22:43948) 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc753fff640 1 -- 10.20.193.22:0/3180186727 learned_addr learned my addr 10.20.193.22:0/3180186727 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc753fff640 1 -- 10.20.193.22:0/3180186727 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7541298c0 con 0x7fc754056cd0 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc753fff640 1 --2- 10.20.193.22:0/3180186727 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc754129220 crc :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc7517fa640 1 -- 10.20.193.22:0/3180186727 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc74000ed70 con 0x7fc754056cd0 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3180186727 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc754129b10 con 0x7fc754056cd0 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc7517fa640 1 -- 10.20.193.22:0/3180186727 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1159+0+0 (crc 0 0 0) 0x7fc74000ddf0 con 0x7fc754056cd0 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc7517fa640 1 -- 10.20.193.22:0/3180186727 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc740013570 con 0x7fc754056cd0 2026-02-24T07:20:13.918 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.761+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3180186727 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75412a400 con 0x7fc754056cd0 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.762+0000 7fc7517fa640 1 -- 10.20.193.22:0/3180186727 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7fc740011040 con 0x7fc754056cd0 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.762+0000 7fc7517fa640 1 --2- 10.20.193.22:0/3180186727 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fc72803f7f0 0x7fc72805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.762+0000 7fc7517fa640 1 -- 10.20.193.22:0/3180186727 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7fc740053320 con 0x7fc754056cd0 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.762+0000 7fc7537fe640 1 --2- 10.20.193.22:0/3180186727 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fc72803f7f0 0x7fc72805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.764+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3180186727 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7540570a0 con 0x7fc754056cd0 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.765+0000 7fc7537fe640 1 --2- 10.20.193.22:0/3180186727 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fc72803f7f0 0x7fc72805fca0 crc :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.767+0000 7fc7517fa640 1 -- 10.20.193.22:0/3180186727 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fc740012750 con 0x7fc754056cd0 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.882+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3180186727 --> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fc75413cee0 con 0x7fc72803f7f0 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.882+0000 7fc7517fa640 1 -- 10.20.193.22:0/3180186727 <== mon.0 v2:10.20.193.22:3300/0 7 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fc740052d30 con 0x7fc754056cd0 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.886+0000 7fc7517fa640 1 -- 10.20.193.22:0/3180186727 <== mgr.14120 v2:10.20.193.22:6800/2169717366 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (crc 0 0 0) 0x7fc75413cee0 con 0x7fc72803f7f0 2026-02-24T07:20:13.919 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.888+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3180186727 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fc72803f7f0 msgr2=0x7fc72805fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:13.920 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.888+0000 7fc75a7b6640 1 --2- 10.20.193.22:0/3180186727 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fc72803f7f0 0x7fc72805fca0 crc :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.920 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.888+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3180186727 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 msgr2=0x7fc754129220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:13.920 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.888+0000 7fc75a7b6640 1 --2- 10.20.193.22:0/3180186727 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc754129220 crc :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.920 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.888+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3180186727 shutdown_connections 2026-02-24T07:20:13.920 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.888+0000 7fc75a7b6640 1 --2- 10.20.193.22:0/3180186727 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7fc72803f7f0 0x7fc72805fca0 unknown :-1 s=CLOSED pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.920 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.888+0000 7fc75a7b6640 1 --2- 10.20.193.22:0/3180186727 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc754056cd0 0x7fc754129220 unknown :-1 s=CLOSED pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:13.920 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.888+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3180186727 >> 10.20.193.22:0/3180186727 conn(0x7fc754059d80 msgr2=0x7fc75411f820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:13.920 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.888+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3180186727 shutdown_connections 2026-02-24T07:20:13.920 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:13.888+0000 7fc75a7b6640 1 -- 10.20.193.22:0/3180186727 wait complete. 2026-02-24T07:20:14.146 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.001+0000 7f5633e06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:14.146 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5633e06640 1 Processor -- start 2026-02-24T07:20:14.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5633e06640 1 -- start start 2026-02-24T07:20:14.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5633e06640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c11cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:14.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5633e06640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f562c11d3e0 con 0x7f562c11ca00 2026-02-24T07:20:14.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5631b7b640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c11cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:14.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5631b7b640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c11cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:43958/0 (socket says 10.20.193.22:43958) 2026-02-24T07:20:14.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5631b7b640 1 -- 10.20.193.22:0/3646561127 learned_addr learned my addr 10.20.193.22:0/3646561127 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:14.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5631b7b640 1 -- 10.20.193.22:0/3646561127 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c11d520 con 0x7f562c11ca00 2026-02-24T07:20:14.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5631b7b640 1 --2- 10.20.193.22:0/3646561127 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c11cdf0 crc :-1 s=READY pgs=53 gs=1 cs=0 l=1 c_cookie=6841789099375993182 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef2eaefc072215e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:14.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5630b79640 1 -- 10.20.193.22:0/3646561127 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f561c009d40 con 0x7f562c11ca00 2026-02-24T07:20:14.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5630b79640 1 -- 10.20.193.22:0/3646561127 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f561c00e740 con 0x7f562c11ca00 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.005+0000 7f5630b79640 1 -- 10.20.193.22:0/3646561127 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f561c00d6d0 con 0x7f562c11ca00 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 -- 10.20.193.22:0/3646561127 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 msgr2=0x7f562c11cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 --2- 10.20.193.22:0/3646561127 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c11cdf0 crc :-1 s=READY pgs=53 gs=1 cs=0 l=1 c_cookie=6841789099375993182 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 -- 10.20.193.22:0/3646561127 shutdown_connections 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 --2- 10.20.193.22:0/3646561127 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c11cdf0 unknown :-1 s=CLOSED pgs=53 gs=1 cs=0 l=1 c_cookie=6841789099375993182 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 -- 10.20.193.22:0/3646561127 >> 10.20.193.22:0/3646561127 conn(0x7f562c057f30 msgr2=0x7f562c058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 -- 10.20.193.22:0/3646561127 shutdown_connections 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 -- 10.20.193.22:0/3646561127 wait complete. 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 Processor -- start 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 -- start start 2026-02-24T07:20:14.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c109210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f562c109770 con 0x7f562c11ca00 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5631b7b640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c109210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5631b7b640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c109210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:43972/0 (socket says 10.20.193.22:43972) 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5631b7b640 1 -- 10.20.193.22:0/1492260187 learned_addr learned my addr 10.20.193.22:0/1492260187 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5631b7b640 1 -- 10.20.193.22:0/1492260187 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c1098b0 con 0x7f562c11ca00 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5631b7b640 1 --2- 10.20.193.22:0/1492260187 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c109210 crc :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f561affd640 1 -- 10.20.193.22:0/1492260187 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f561c00d570 con 0x7f562c11ca00 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 -- 10.20.193.22:0/1492260187 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562c109b00 con 0x7f562c11ca00 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f561affd640 1 -- 10.20.193.22:0/1492260187 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f561c00ded0 con 0x7f562c11ca00 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f561affd640 1 -- 10.20.193.22:0/1492260187 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f561c013500 con 0x7f562c11ca00 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.006+0000 7f5633e06640 1 -- 10.20.193.22:0/1492260187 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f562c10a3f0 con 0x7f562c11ca00 2026-02-24T07:20:14.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.007+0000 7f5633e06640 1 -- 10.20.193.22:0/1492260187 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562c11cdd0 con 0x7f562c11ca00 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.007+0000 7f561affd640 1 -- 10.20.193.22:0/1492260187 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7f561c011040 con 0x7f562c11ca00 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.007+0000 7f561affd640 1 --2- 10.20.193.22:0/1492260187 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f560803f7f0 0x7f560805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.007+0000 7f561affd640 1 -- 10.20.193.22:0/1492260187 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f561c052230 con 0x7f562c11ca00 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.007+0000 7f563137a640 1 --2- 10.20.193.22:0/1492260187 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f560803f7f0 0x7f560805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.008+0000 7f563137a640 1 --2- 10.20.193.22:0/1492260187 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f560803f7f0 0x7f560805fca0 crc :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.009+0000 7f561affd640 1 -- 10.20.193.22:0/1492260187 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f561c013ac0 con 0x7f562c11ca00 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.114+0000 7f5633e06640 1 -- 10.20.193.22:0/1492260187 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f562c10aeb0 con 0x7f562c11ca00 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.116+0000 7f561affd640 1 -- 10.20.193.22:0/1492260187 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (crc 0 0 0) 0x7f561c00f7b0 con 0x7f562c11ca00 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.118+0000 7f5633e06640 1 -- 10.20.193.22:0/1492260187 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f560803f7f0 msgr2=0x7f560805fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.118+0000 7f5633e06640 1 --2- 10.20.193.22:0/1492260187 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f560803f7f0 0x7f560805fca0 crc :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.118+0000 7f5633e06640 1 -- 10.20.193.22:0/1492260187 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 msgr2=0x7f562c109210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:14.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.118+0000 7f5633e06640 1 --2- 10.20.193.22:0/1492260187 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c109210 crc :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.118+0000 7f5633e06640 1 -- 10.20.193.22:0/1492260187 shutdown_connections 2026-02-24T07:20:14.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.118+0000 7f5633e06640 1 --2- 10.20.193.22:0/1492260187 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f560803f7f0 0x7f560805fca0 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.118+0000 7f5633e06640 1 --2- 10.20.193.22:0/1492260187 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f562c11ca00 0x7f562c109210 unknown :-1 s=CLOSED pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.118+0000 7f5633e06640 1 -- 10.20.193.22:0/1492260187 >> 10.20.193.22:0/1492260187 conn(0x7f562c057f30 msgr2=0x7f562c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:14.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.119+0000 7f5633e06640 1 -- 10.20.193.22:0/1492260187 shutdown_connections 2026-02-24T07:20:14.151 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.119+0000 7f5633e06640 1 -- 10.20.193.22:0/1492260187 wait complete. 2026-02-24T07:20:14.392 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.248+0000 7f84d33ae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:14.393 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.251+0000 7f84d33ae640 1 Processor -- start 2026-02-24T07:20:14.393 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.251+0000 7f84d33ae640 1 -- start start 2026-02-24T07:20:14.393 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.251+0000 7f84d33ae640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc0570c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:14.393 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.251+0000 7f84d33ae640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc057600 con 0x7f84cc056cd0 2026-02-24T07:20:14.393 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.251+0000 7f84d1123640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc0570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:14.393 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.251+0000 7f84d1123640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc0570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:43980/0 (socket says 10.20.193.22:43980) 2026-02-24T07:20:14.393 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.251+0000 7f84d1123640 1 -- 10.20.193.22:0/2334632497 learned_addr learned my addr 10.20.193.22:0/2334632497 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:14.393 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d1123640 1 -- 10.20.193.22:0/2334632497 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc057740 con 0x7f84cc056cd0 2026-02-24T07:20:14.394 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d1123640 1 --2- 10.20.193.22:0/2334632497 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc0570c0 crc :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=137376183811952117 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e80ee94cb5cdf5 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:14.394 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84bbfff640 1 -- 10.20.193.22:0/2334632497 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f84bc009d40 con 0x7f84cc056cd0 2026-02-24T07:20:14.394 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84bbfff640 1 -- 10.20.193.22:0/2334632497 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f84bc00e740 con 0x7f84cc056cd0 2026-02-24T07:20:14.394 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84bbfff640 1 -- 10.20.193.22:0/2334632497 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f84bc00d6d0 con 0x7f84cc056cd0 2026-02-24T07:20:14.394 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d33ae640 1 -- 10.20.193.22:0/2334632497 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 msgr2=0x7f84cc0570c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:14.394 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d33ae640 1 --2- 10.20.193.22:0/2334632497 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc0570c0 crc :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=137376183811952117 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.394 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d33ae640 1 -- 10.20.193.22:0/2334632497 shutdown_connections 2026-02-24T07:20:14.394 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d33ae640 1 --2- 10.20.193.22:0/2334632497 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc0570c0 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=137376183811952117 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.394 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d33ae640 1 -- 10.20.193.22:0/2334632497 >> 10.20.193.22:0/2334632497 conn(0x7f84cc059d80 msgr2=0x7f84cc05a180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d33ae640 1 -- 10.20.193.22:0/2334632497 shutdown_connections 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d33ae640 1 -- 10.20.193.22:0/2334632497 wait complete. 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d33ae640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.252+0000 7f84d33ae640 1 Processor -- start 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d33ae640 1 -- start start 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d33ae640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc129220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d33ae640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc129780 con 0x7f84cc056cd0 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d1123640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc129220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d1123640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc129220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:43994/0 (socket says 10.20.193.22:43994) 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d1123640 1 -- 10.20.193.22:0/3942487878 learned_addr learned my addr 10.20.193.22:0/3942487878 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d1123640 1 -- 10.20.193.22:0/3942487878 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc1298c0 con 0x7f84cc056cd0 2026-02-24T07:20:14.395 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d1123640 1 --2- 10.20.193.22:0/3942487878 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc129220 crc :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84ba7fc640 1 -- 10.20.193.22:0/3942487878 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f84bc00d570 con 0x7f84cc056cd0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d33ae640 1 -- 10.20.193.22:0/3942487878 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84cc129b10 con 0x7f84cc056cd0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84ba7fc640 1 -- 10.20.193.22:0/3942487878 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f84bc00d6d0 con 0x7f84cc056cd0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84ba7fc640 1 -- 10.20.193.22:0/3942487878 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f84bc013500 con 0x7f84cc056cd0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d33ae640 1 -- 10.20.193.22:0/3942487878 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84cc12a400 con 0x7f84cc056cd0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.253+0000 7f84d33ae640 1 -- 10.20.193.22:0/3942487878 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84cc0570a0 con 0x7f84cc056cd0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.254+0000 7f84ba7fc640 1 -- 10.20.193.22:0/3942487878 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7f84bc011040 con 0x7f84cc056cd0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.254+0000 7f84ba7fc640 1 --2- 10.20.193.22:0/3942487878 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f84a803f7f0 0x7f84a805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.254+0000 7f84ba7fc640 1 -- 10.20.193.22:0/3942487878 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f84bc052200 con 0x7f84cc056cd0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.254+0000 7f84d0922640 1 --2- 10.20.193.22:0/3942487878 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f84a803f7f0 0x7f84a805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.254+0000 7f84d0922640 1 --2- 10.20.193.22:0/3942487878 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f84a803f7f0 0x7f84a805fca0 crc :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:14.396 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.256+0000 7f84ba7fc640 1 -- 10.20.193.22:0/3942487878 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f84bc013920 con 0x7f84cc056cd0 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.361+0000 7f84d33ae640 1 -- 10.20.193.22:0/3942487878 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f84cc057bf0 con 0x7f84cc056cd0 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.363+0000 7f84ba7fc640 1 -- 10.20.193.22:0/3942487878 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (crc 0 0 0) 0x7f84bc00f2a0 con 0x7f84cc056cd0 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.366+0000 7f84d33ae640 1 -- 10.20.193.22:0/3942487878 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f84a803f7f0 msgr2=0x7f84a805fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.366+0000 7f84d33ae640 1 --2- 10.20.193.22:0/3942487878 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f84a803f7f0 0x7f84a805fca0 crc :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.366+0000 7f84d33ae640 1 -- 10.20.193.22:0/3942487878 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 msgr2=0x7f84cc129220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.366+0000 7f84d33ae640 1 --2- 10.20.193.22:0/3942487878 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc129220 crc :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.366+0000 7f84d33ae640 1 -- 10.20.193.22:0/3942487878 shutdown_connections 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.366+0000 7f84d33ae640 1 --2- 10.20.193.22:0/3942487878 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f84a803f7f0 0x7f84a805fca0 unknown :-1 s=CLOSED pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.366+0000 7f84d33ae640 1 --2- 10.20.193.22:0/3942487878 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f84cc056cd0 0x7f84cc129220 unknown :-1 s=CLOSED pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.366+0000 7f84d33ae640 1 -- 10.20.193.22:0/3942487878 >> 10.20.193.22:0/3942487878 conn(0x7f84cc059d80 msgr2=0x7f84cc11f820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.366+0000 7f84d33ae640 1 -- 10.20.193.22:0/3942487878 shutdown_connections 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.366+0000 7f84d33ae640 1 -- 10.20.193.22:0/3942487878 wait complete. 2026-02-24T07:20:14.397 INFO:teuthology.orchestra.run.trial022.stdout:Enabling the dashboard module... 2026-02-24T07:20:15.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: Added host trial022 2026-02-24T07:20:15.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:15.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: Saving service mon spec with placement count:5 2026-02-24T07:20:15.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:15.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:15.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: Saving service mgr spec with placement count:2 2026-02-24T07:20:15.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:15.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:15.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1492260187' entity='client.admin' 2026-02-24T07:20:15.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3942487878' entity='client.admin' 2026-02-24T07:20:15.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:15.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/295510169' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2026-02-24T07:20:15.243 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:14 trial022 ceph-mon[39108]: from='mgr.14120 10.20.193.22:0/2020584341' entity='mgr.x' 2026-02-24T07:20:15.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.488+0000 7f87f6075640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:15.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.491+0000 7f87f6075640 1 Processor -- start 2026-02-24T07:20:15.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.491+0000 7f87f6075640 1 -- start start 2026-02-24T07:20:15.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.491+0000 7f87f6075640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f005d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:15.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.491+0000 7f87f6075640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87f005ea00 con 0x7f87f005cfe0 2026-02-24T07:20:15.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.491+0000 7f87ef7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f005d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:15.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.491+0000 7f87ef7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f005d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44010/0 (socket says 10.20.193.22:44010) 2026-02-24T07:20:15.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.491+0000 7f87ef7fe640 1 -- 10.20.193.22:0/82530162 learned_addr learned my addr 10.20.193.22:0/82530162 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:15.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.491+0000 7f87ef7fe640 1 -- 10.20.193.22:0/82530162 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f005d910 con 0x7f87f005cfe0 2026-02-24T07:20:15.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.491+0000 7f87ef7fe640 1 --2- 10.20.193.22:0/82530162 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f005d3d0 crc :-1 s=READY pgs=57 gs=1 cs=0 l=1 c_cookie=8621786032570250885 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a6bcb768c63685 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:15.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87ee7fc640 1 -- 10.20.193.22:0/82530162 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f87dc009d40 con 0x7f87f005cfe0 2026-02-24T07:20:15.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87ee7fc640 1 -- 10.20.193.22:0/82530162 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f87dc00e740 con 0x7f87f005cfe0 2026-02-24T07:20:15.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87ee7fc640 1 -- 10.20.193.22:0/82530162 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f87dc00d6d0 con 0x7f87f005cfe0 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 -- 10.20.193.22:0/82530162 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 msgr2=0x7f87f005d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 --2- 10.20.193.22:0/82530162 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f005d3d0 crc :-1 s=READY pgs=57 gs=1 cs=0 l=1 c_cookie=8621786032570250885 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 -- 10.20.193.22:0/82530162 shutdown_connections 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 --2- 10.20.193.22:0/82530162 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f005d3d0 unknown :-1 s=CLOSED pgs=57 gs=1 cs=0 l=1 c_cookie=8621786032570250885 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 -- 10.20.193.22:0/82530162 >> 10.20.193.22:0/82530162 conn(0x7f87f005aa30 msgr2=0x7f87f005ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 -- 10.20.193.22:0/82530162 shutdown_connections 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 -- 10.20.193.22:0/82530162 wait complete. 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 Processor -- start 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 -- start start 2026-02-24T07:20:15.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f0108240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.492+0000 7f87f6075640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87f01087a0 con 0x7f87f005cfe0 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87ef7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f0108240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87ef7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f0108240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44016/0 (socket says 10.20.193.22:44016) 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87ef7fe640 1 -- 10.20.193.22:0/295510169 learned_addr learned my addr 10.20.193.22:0/295510169 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87ef7fe640 1 -- 10.20.193.22:0/295510169 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f01088e0 con 0x7f87f005cfe0 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87ef7fe640 1 --2- 10.20.193.22:0/295510169 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f0108240 crc :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87ecff9640 1 -- 10.20.193.22:0/295510169 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f87dc00d570 con 0x7f87f005cfe0 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87ecff9640 1 -- 10.20.193.22:0/295510169 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f87dc00ded0 con 0x7f87f005cfe0 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87f6075640 1 -- 10.20.193.22:0/295510169 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f0108b30 con 0x7f87f005cfe0 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87ecff9640 1 -- 10.20.193.22:0/295510169 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f87dc013500 con 0x7f87f005cfe0 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87f6075640 1 -- 10.20.193.22:0/295510169 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f0109420 con 0x7f87f005cfe0 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87f6075640 1 -- 10.20.193.22:0/295510169 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f005d3b0 con 0x7f87f005cfe0 2026-02-24T07:20:15.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.493+0000 7f87ecff9640 1 -- 10.20.193.22:0/295510169 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (crc 0 0 0) 0x7f87dc011040 con 0x7f87f005cfe0 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.494+0000 7f87ecff9640 1 --2- 10.20.193.22:0/295510169 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f87c403f7a0 0x7f87c405fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.494+0000 7f87ecff9640 1 -- 10.20.193.22:0/295510169 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f87dc052440 con 0x7f87f005cfe0 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.494+0000 7f87eeffd640 1 --2- 10.20.193.22:0/295510169 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f87c403f7a0 0x7f87c405fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.494+0000 7f87eeffd640 1 --2- 10.20.193.22:0/295510169 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f87c403f7a0 0x7f87c405fc50 crc :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.496+0000 7f87ecff9640 1 -- 10.20.193.22:0/295510169 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f87dc00c9a0 con 0x7f87f005cfe0 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:14.632+0000 7f87f6075640 1 -- 10.20.193.22:0/295510169 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f87f00587a0 con 0x7f87f005cfe0 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.401+0000 7f87ecff9640 1 -- 10.20.193.22:0/295510169 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (crc 0 0 0) 0x7f87dc00f2a0 con 0x7f87f005cfe0 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.404+0000 7f87ecff9640 1 -- 10.20.193.22:0/295510169 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mgrmap(e 9) ==== 52827+0+0 (crc 0 0 0) 0x7f87dc012390 con 0x7f87f005cfe0 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.407+0000 7f87f6075640 1 -- 10.20.193.22:0/295510169 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f87c403f7a0 msgr2=0x7f87c405fc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.407+0000 7f87f6075640 1 --2- 10.20.193.22:0/295510169 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f87c403f7a0 0x7f87c405fc50 crc :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.407+0000 7f87f6075640 1 -- 10.20.193.22:0/295510169 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 msgr2=0x7f87f0108240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:15.439 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.407+0000 7f87f6075640 1 --2- 10.20.193.22:0/295510169 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f0108240 crc :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.439 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.407+0000 7f87f6075640 1 -- 10.20.193.22:0/295510169 shutdown_connections 2026-02-24T07:20:15.439 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.407+0000 7f87f6075640 1 --2- 10.20.193.22:0/295510169 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f87c403f7a0 0x7f87c405fc50 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.439 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.407+0000 7f87f6075640 1 --2- 10.20.193.22:0/295510169 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f87f005cfe0 0x7f87f0108240 unknown :-1 s=CLOSED pgs=58 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.439 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.407+0000 7f87f6075640 1 -- 10.20.193.22:0/295510169 >> 10.20.193.22:0/295510169 conn(0x7f87f005aa30 msgr2=0x7f87f00fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:15.439 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.407+0000 7f87f6075640 1 -- 10.20.193.22:0/295510169 shutdown_connections 2026-02-24T07:20:15.439 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.407+0000 7f87f6075640 1 -- 10.20.193.22:0/295510169 wait complete. 2026-02-24T07:20:15.679 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:15 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ignoring --setuser ceph since I am not root 2026-02-24T07:20:15.679 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:15 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ignoring --setgroup ceph since I am not root 2026-02-24T07:20:15.680 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:15 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:20:15.447+0000 7efcded73fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:15.680 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:15 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:20:15.450+0000 7efcded73fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:15.680 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:15 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:20:15.450+0000 7efcded73fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:15.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:20:15.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-24T07:20:15.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-24T07:20:15.707 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.532+0000 7f1ec3907640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.534+0000 7f1ec3907640 1 Processor -- start 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.534+0000 7f1ec3907640 1 -- start start 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.534+0000 7f1ec3907640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc11cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.534+0000 7f1ec3907640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc11d3e0 con 0x7f1ebc11ca00 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.534+0000 7f1ec167c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc11cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.534+0000 7f1ec167c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc11cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44032/0 (socket says 10.20.193.22:44032) 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.534+0000 7f1ec167c640 1 -- 10.20.193.22:0/2595743090 learned_addr learned my addr 10.20.193.22:0/2595743090 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:15.708 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1ec167c640 1 -- 10.20.193.22:0/2595743090 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc11d520 con 0x7f1ebc11ca00 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1ec167c640 1 --2- 10.20.193.22:0/2595743090 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc11cdf0 crc :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=344730553247092044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8ba9c99844d4c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1eabfff640 1 -- 10.20.193.22:0/2595743090 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f1eac009d40 con 0x7f1ebc11ca00 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1eabfff640 1 -- 10.20.193.22:0/2595743090 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f1eac00e740 con 0x7f1ebc11ca00 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1eabfff640 1 -- 10.20.193.22:0/2595743090 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f1eac00d6d0 con 0x7f1ebc11ca00 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1ec3907640 1 -- 10.20.193.22:0/2595743090 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 msgr2=0x7f1ebc11cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1ec3907640 1 --2- 10.20.193.22:0/2595743090 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc11cdf0 crc :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=344730553247092044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1ec3907640 1 -- 10.20.193.22:0/2595743090 shutdown_connections 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1ec3907640 1 --2- 10.20.193.22:0/2595743090 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc11cdf0 unknown :-1 s=CLOSED pgs=61 gs=1 cs=0 l=1 c_cookie=344730553247092044 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1ec3907640 1 -- 10.20.193.22:0/2595743090 >> 10.20.193.22:0/2595743090 conn(0x7f1ebc057f30 msgr2=0x7f1ebc058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1ec3907640 1 -- 10.20.193.22:0/2595743090 shutdown_connections 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.535+0000 7f1ec3907640 1 -- 10.20.193.22:0/2595743090 wait complete. 2026-02-24T07:20:15.709 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec3907640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec3907640 1 Processor -- start 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec3907640 1 -- start start 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec3907640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc1091f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec3907640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc109750 con 0x7f1ebc11ca00 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec167c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc1091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec167c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc1091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44044/0 (socket says 10.20.193.22:44044) 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec167c640 1 -- 10.20.193.22:0/3314260030 learned_addr learned my addr 10.20.193.22:0/3314260030 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec167c640 1 -- 10.20.193.22:0/3314260030 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc109890 con 0x7f1ebc11ca00 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec167c640 1 --2- 10.20.193.22:0/3314260030 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc1091f0 crc :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1eaa7fc640 1 -- 10.20.193.22:0/3314260030 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f1eac00d570 con 0x7f1ebc11ca00 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec3907640 1 -- 10.20.193.22:0/3314260030 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ebc109ae0 con 0x7f1ebc11ca00 2026-02-24T07:20:15.710 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1eaa7fc640 1 -- 10.20.193.22:0/3314260030 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f1eac00ded0 con 0x7f1ebc11ca00 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1eaa7fc640 1 -- 10.20.193.22:0/3314260030 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f1eac013500 con 0x7f1ebc11ca00 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.536+0000 7f1ec3907640 1 -- 10.20.193.22:0/3314260030 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ebc10a3d0 con 0x7f1ebc11ca00 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.537+0000 7f1ec3907640 1 -- 10.20.193.22:0/3314260030 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ebc11cdd0 con 0x7f1ebc11ca00 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.537+0000 7f1eaa7fc640 1 -- 10.20.193.22:0/3314260030 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 9) ==== 52827+0+0 (crc 0 0 0) 0x7f1eac011040 con 0x7f1ebc11ca00 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.537+0000 7f1eaa7fc640 1 --2- 10.20.193.22:0/3314260030 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f1e8c03f840 0x7f1e8c05fcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.537+0000 7f1eaa7fc640 1 -- 10.20.193.22:0/3314260030 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f1eac052330 con 0x7f1ebc11ca00 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.537+0000 7f1ec0e7b640 1 -- 10.20.193.22:0/3314260030 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f1e8c03f840 msgr2=0x7f1e8c05fcf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/2169717366 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.537+0000 7f1ec0e7b640 1 --2- 10.20.193.22:0/3314260030 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f1e8c03f840 0x7f1e8c05fcf0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.539+0000 7f1eaa7fc640 1 -- 10.20.193.22:0/3314260030 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f1eac013a90 con 0x7f1ebc11ca00 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.676+0000 7f1ec3907640 1 -- 10.20.193.22:0/3314260030 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f1ebc13f120 con 0x7f1ebc11ca00 2026-02-24T07:20:15.711 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.676+0000 7f1eaa7fc640 1 -- 10.20.193.22:0/3314260030 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (crc 0 0 0) 0x7f1eac00f7b0 con 0x7f1ebc11ca00 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.679+0000 7f1ec3907640 1 -- 10.20.193.22:0/3314260030 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f1e8c03f840 msgr2=0x7f1e8c05fcf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.679+0000 7f1ec3907640 1 --2- 10.20.193.22:0/3314260030 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f1e8c03f840 0x7f1e8c05fcf0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.679+0000 7f1ec3907640 1 -- 10.20.193.22:0/3314260030 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 msgr2=0x7f1ebc1091f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.679+0000 7f1ec3907640 1 --2- 10.20.193.22:0/3314260030 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc1091f0 crc :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.679+0000 7f1ec3907640 1 -- 10.20.193.22:0/3314260030 shutdown_connections 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.679+0000 7f1ec3907640 1 --2- 10.20.193.22:0/3314260030 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f1e8c03f840 0x7f1e8c05fcf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.679+0000 7f1ec3907640 1 --2- 10.20.193.22:0/3314260030 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1ebc11ca00 0x7f1ebc1091f0 unknown :-1 s=CLOSED pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.679+0000 7f1ec3907640 1 -- 10.20.193.22:0/3314260030 >> 10.20.193.22:0/3314260030 conn(0x7f1ebc057f30 msgr2=0x7f1ebc0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.679+0000 7f1ec3907640 1 -- 10.20.193.22:0/3314260030 shutdown_connections 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.679+0000 7f1ec3907640 1 -- 10.20.193.22:0/3314260030 wait complete. 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:Waiting for the mgr to restart... 2026-02-24T07:20:15.712 INFO:teuthology.orchestra.run.trial022.stdout:Waiting for mgr epoch 9... 2026-02-24T07:20:16.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:16 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/295510169' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-24T07:20:16.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:16 trial022 ceph-mon[39108]: mgrmap e9: x(active, since 6s) 2026-02-24T07:20:16.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:16 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3314260030' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-24T07:20:16.742 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:16 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T07:20:16.742 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:16 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T07:20:16.742 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:20:16 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: from numpy import show_config as show_numpy_config 2026-02-24T07:20:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:18 trial022 ceph-mon[39108]: Active manager daemon x restarted 2026-02-24T07:20:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:18 trial022 ceph-mon[39108]: Activating manager daemon x 2026-02-24T07:20:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:18 trial022 ceph-mon[39108]: osdmap e3: 0 total, 0 up, 0 in 2026-02-24T07:20:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:18 trial022 ceph-mon[39108]: mgrmap e10: x(active, starting, since 0.00257636s) 2026-02-24T07:20:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:18 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T07:20:18.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:18 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T07:20:18.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:18 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T07:20:18.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:18 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T07:20:18.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:18 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T07:20:18.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:18 trial022 ceph-mon[39108]: Manager daemon x is now available 2026-02-24T07:20:19.271 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout { 2026-02-24T07:20:19.272 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-24T07:20:19.272 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-24T07:20:19.272 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout } 2026-02-24T07:20:19.272 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.794+0000 7f53f5acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:19.272 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.796+0000 7f53f5acb640 1 Processor -- start 2026-02-24T07:20:19.272 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.796+0000 7f53f5acb640 1 -- start start 2026-02-24T07:20:19.272 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53f5acb640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f011cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:19.272 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53f5acb640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53f011d3e0 con 0x7f53f011ca00 2026-02-24T07:20:19.272 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53ef7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f011cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:19.272 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53ef7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f011cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44054/0 (socket says 10.20.193.22:44054) 2026-02-24T07:20:19.273 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53ef7fe640 1 -- 10.20.193.22:0/2401428916 learned_addr learned my addr 10.20.193.22:0/2401428916 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:19.273 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53ef7fe640 1 -- 10.20.193.22:0/2401428916 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f011d520 con 0x7f53f011ca00 2026-02-24T07:20:19.273 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53ef7fe640 1 --2- 10.20.193.22:0/2401428916 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f011cdf0 crc :-1 s=READY pgs=63 gs=1 cs=0 l=1 c_cookie=14917870954952905326 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf06ec986315d26e server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:19.273 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53ee7fc640 1 -- 10.20.193.22:0/2401428916 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f53dc009d40 con 0x7f53f011ca00 2026-02-24T07:20:19.273 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53ee7fc640 1 -- 10.20.193.22:0/2401428916 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f53dc00e740 con 0x7f53f011ca00 2026-02-24T07:20:19.273 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53ee7fc640 1 -- 10.20.193.22:0/2401428916 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f53dc00d6d0 con 0x7f53f011ca00 2026-02-24T07:20:19.273 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53f5acb640 1 -- 10.20.193.22:0/2401428916 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 msgr2=0x7f53f011cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:19.273 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53f5acb640 1 --2- 10.20.193.22:0/2401428916 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f011cdf0 crc :-1 s=READY pgs=63 gs=1 cs=0 l=1 c_cookie=14917870954952905326 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:19.273 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53f5acb640 1 -- 10.20.193.22:0/2401428916 shutdown_connections 2026-02-24T07:20:19.273 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53f5acb640 1 --2- 10.20.193.22:0/2401428916 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f011cdf0 unknown :-1 s=CLOSED pgs=63 gs=1 cs=0 l=1 c_cookie=14917870954952905326 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53f5acb640 1 -- 10.20.193.22:0/2401428916 >> 10.20.193.22:0/2401428916 conn(0x7f53f0057f30 msgr2=0x7f53f0058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53f5acb640 1 -- 10.20.193.22:0/2401428916 shutdown_connections 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.797+0000 7f53f5acb640 1 -- 10.20.193.22:0/2401428916 wait complete. 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53f5acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53f5acb640 1 Processor -- start 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53f5acb640 1 -- start start 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53f5acb640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f01091f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53f5acb640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f53f0109750 con 0x7f53f011ca00 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53ef7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f01091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53ef7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f01091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44068/0 (socket says 10.20.193.22:44068) 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53ef7fe640 1 -- 10.20.193.22:0/1102544155 learned_addr learned my addr 10.20.193.22:0/1102544155 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:19.274 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53ef7fe640 1 -- 10.20.193.22:0/1102544155 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f0109890 con 0x7f53f011ca00 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53ef7fe640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f01091f0 crc :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f53dc00d570 con 0x7f53f011ca00 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f53dc00ded0 con 0x7f53f011ca00 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53f5acb640 1 -- 10.20.193.22:0/1102544155 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f0109ae0 con 0x7f53f011ca00 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f53dc013500 con 0x7f53f011ca00 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.798+0000 7f53f5acb640 1 -- 10.20.193.22:0/1102544155 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f010a3d0 con 0x7f53f011ca00 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.799+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 9) ==== 52827+0+0 (crc 0 0 0) 0x7f53dc011040 con 0x7f53f011ca00 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.799+0000 7f53ecff9640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 0x7f53c405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.799+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 --> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f53c40603b0 con 0x7f53c403f7f0 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.799+0000 7f53eeffd640 1 -- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 msgr2=0x7f53c405fca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/2169717366 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.799+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 935+0+0 (crc 0 0 0) 0x7f53dc0523b0 con 0x7f53f011ca00 2026-02-24T07:20:19.275 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:15.799+0000 7f53eeffd640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 0x7f53c405fca0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:16.000+0000 7f53eeffd640 1 -- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 msgr2=0x7f53c405fca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/2169717366 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:16.000+0000 7f53eeffd640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 0x7f53c405fca0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:16.401+0000 7f53eeffd640 1 -- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 msgr2=0x7f53c405fca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/2169717366 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:16.401+0000 7f53eeffd640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 0x7f53c405fca0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:17.202+0000 7f53eeffd640 1 -- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 msgr2=0x7f53c405fca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/2169717366 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:17.202+0000 7f53eeffd640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 0x7f53c405fca0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:18.197+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mgrmap(e 10) ==== 52594+0+0 (crc 0 0 0) 0x7f53dc050a90 con 0x7f53f011ca00 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:18.197+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 msgr2=0x7f53c405fca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:18.197+0000 7f53ecff9640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 0x7f53c405fca0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.197+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mgrmap(e 11) ==== 52721+0+0 (crc 0 0 0) 0x7f53dc012ca0 con 0x7f53f011ca00 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.198+0000 7f53ecff9640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f53c40610a0 0x7f53c4081480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:19.276 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.198+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f53c40603b0 con 0x7f53c40610a0 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.198+0000 7f53eeffd640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f53c40610a0 0x7f53c4081480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.198+0000 7f53eeffd640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f53c40610a0 0x7f53c4081480 crc :-1 s=READY pgs=1 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.199+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9559 (crc 0 0 0) 0x7f53c40603b0 con 0x7f53c40610a0 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 -- 10.20.193.22:0/1102544155 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f53f00532d0 con 0x7f53c40610a0 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53ecff9640 1 -- 10.20.193.22:0/1102544155 <== mgr.14154 v2:10.20.193.22:6800/4126627015 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (crc 0 0 0) 0x7f53f00532d0 con 0x7f53c40610a0 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 -- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f53c40610a0 msgr2=0x7f53c4081480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f53c40610a0 0x7f53c4081480 crc :-1 s=READY pgs=1 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 -- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 msgr2=0x7f53f01091f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f01091f0 crc :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 -- 10.20.193.22:0/1102544155 shutdown_connections 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f53c40610a0 0x7f53c4081480 unknown :-1 s=CLOSED pgs=1 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:19.277 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:6800/2169717366,v1:10.20.193.22:6801/2169717366] conn(0x7f53c403f7f0 0x7f53c405fca0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:19.278 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 --2- 10.20.193.22:0/1102544155 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f53f011ca00 0x7f53f01091f0 unknown :-1 s=CLOSED pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:19.278 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 -- 10.20.193.22:0/1102544155 >> 10.20.193.22:0/1102544155 conn(0x7f53f0057f30 msgr2=0x7f53f00ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:19.278 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 -- 10.20.193.22:0/1102544155 shutdown_connections 2026-02-24T07:20:19.278 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.202+0000 7f53f5acb640 1 -- 10.20.193.22:0/1102544155 wait complete. 2026-02-24T07:20:19.278 INFO:teuthology.orchestra.run.trial022.stdout:mgr epoch 9 is available 2026-02-24T07:20:19.278 INFO:teuthology.orchestra.run.trial022.stdout:Using certmgr to generate dashboard self-signed certificate... 2026-02-24T07:20:19.489 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:19 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:19.489 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:19 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T07:20:19.489 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:19 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T07:20:19.489 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:19 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:19.489 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:19 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:19.489 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:19 trial022 ceph-mon[39108]: mgrmap e11: x(active, since 1.00415s) 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFHzCCAwegAwIBAgIUfXakZeA+k76tDTQ6V+J7xRh1FHIwDQYJKoZIhvcNAQEL\nBQAwPDE6MDgGA1UEAwwxY2VwaGFkbS1yb290LTMwNDAwMjcyLTExNTEtMTFmMS1i\nZTA5LWQ0MDRlNmU3ZDQ2MDAeFw0yNjAyMjQwNzIwMTlaFw0yOTAyMjMwNzIwMTla\nMBcxFTATBgNVBAMMDDEwLjIwLjE5My4yMjCCAiIwDQYJKoZIhvcNAQEBBQADggIP\nADCCAgoCggIBAK4gglkA39vmcfnLGJKfe6daehVrHB0HhsAe3M0EDduPnwbRsSlV\n60ADaGUM1opRuLYpqPeWz5yTDvkz/pMvqsm10uyov2e1H+nDhDfGRwl1xS6XEHqg\ns2+oG5lkYue//C6G2yE4dsANbRUlxeqpC+PaC/dCkSt2l0pe75KfdFOFrcQ54t/G\nqVaEKpvcNCIAqjpENs8esLcjEjgzOSOddFnC8vBq4Kyu70ZqJYTdONRNd34Kpge0\nAk1U4mD4XAe/D7K88aRy+24sN0mTM7auNOjuT7yOzYSRrbfd0igGKoe1UJeSylV8\n/Ucw4IhSVP2Q3MmQmf52v3zDVUOOYofHhnfclGfVj6gOWOeQwaaXyvm8dV2q/1p6\nkwAgpyNfEOnLV9xz+HrudlJVkPHhtWh4u4OLS5TAW+iTQKzD7wIVpFNaATgpikY/\n2i+VcnkjHH0tW7pA/q9Q9dJ4/HLZGjyzbYbKkq1qK8B+fmoFtPqVoPP4WTwcAGHV\ndvPnyLCwLEXb9jI1gMtr1bVrWQoxcU65Hry7HwEY2Ru4ty+IH1g5Of/f7RcbsuoH\nNVNj/UUXuD8BpIw/AM5N3EPJZZ2e5qvqLoSDjEyhe/S2C0wsVdnUvjbXGGPJD6FG\nQwbOHiHIz7PTgBdf3g0RVnHakM7fPkxC1w4mOz/WRXhYs9jUKLReuoJlAgMBAAGj\nPjA8MCwGA1UdEQQlMCOCCHRyaWFsMDIyghFkYXNoYm9hcmRfc2VydmVyc4cEChTB\nFjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQCWTtwfflTKXH3YMD1a\nJVB/kRyCBE2410cnf57qWU6UCo+CCHOqlS99hR89p6tGmUC/MrdmxaC0B1OrHThv\nuAod9autko0BgtLsjp+OG4VLKA39Reog8KlIWauBYaOZRuTWLj9X+lkWfvgTaaTk\nLuGgfM3LNXvqBt4oVU+fIosNEq1AcWDcCBmpXyb9NEyTBlWP1lrjbYzaWAx2NEO+\nrmxVUw1a9iWlPb6B25MUP36+krFmLo4SWJ6IlWl64hg/Gc5GXXK3w+amzXOo7nZu\nbeFH+VjouO9pP6HdUs7EuYMi6mqWO19D6AR3mdIomxiNgo63kX4igX+PiY2w5oj1\nsLV/mPtaQxnRDtcAjMPkLvfbq5ILZl+OA+vx8/M+zcApcvV65sej4m0z5KpCVZft\np3eTXM01fa66KkxKMO1tSQOdKcltj3WYqu+xyfrWyIw+n0K684U3UfNUlpVOyoTe\nP4ULCmaajdu02PY3FWf29VGvQ9ikzlPOIkzuws9m5GVeS3jMJokWccWHz9C47MdV\nhW4xGNsO4bW/3QIToL0Ayu5qZJn85q0aSdihwxeApetdZ6iX+lx+uj2n8mI5l98w\nPAgS3PmtUXzf0pP0P6sC3VN6cdfsaLtGg1Xh4xv/VPVOyq/Zd8zDwNXH3MUqpnER\nrLcnD54Pivxu0fJqTkrhXitMIA==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAriCCWQDf2+Zx+csYkp97p1p6FWscHQeGwB7czQQN24+fBtGx\nKVXrQANoZQzWilG4timo95bPnJMO+TP+ky+qybXS7Ki/Z7Uf6cOEN8ZHCXXFLpcQ\neqCzb6gbmWRi57/8LobbITh2wA1tFSXF6qkL49oL90KRK3aXSl7vkp90U4WtxDni\n38apVoQqm9w0IgCqOkQ2zx6wtyMSODM5I510WcLy8GrgrK7vRmolhN041E13fgqm\nB7QCTVTiYPhcB78PsrzxpHL7biw3SZMztq406O5PvI7NhJGtt93SKAYqh7VQl5LK\nVXz9RzDgiFJU/ZDcyZCZ/na/fMNVQ45ih8eGd9yUZ9WPqA5Y55DBppfK+bx1Xar/\nWnqTACCnI18Q6ctX3HP4eu52UlWQ8eG1aHi7g4tLlMBb6JNArMPvAhWkU1oBOCmK\nRj/aL5VyeSMcfS1bukD+r1D10nj8ctkaPLNthsqSrWorwH5+agW0+pWg8/hZPBwA\nYdV28+fIsLAsRdv2MjWAy2vVtWtZCjFxTrkevLsfARjZG7i3L4gfWDk5/9/tFxuy\n6gc1U2P9RRe4PwGkjD8Azk3cQ8llnZ7mq+ouhIOMTKF79LYLTCxV2dS+NtcYY8kP\noUZDBs4eIcjPs9OAF1/eDRFWcdqQzt8+TELXDiY7P9ZFeFiz2NQotF66gmUCAwEA\nAQKCAgARbXuJAPIRhk0IsppxAmP+lKr8vc2rMiJQfvDxLA4JraQ9qyXPfKP2XODz\n9txPgm0O/mMaSg6EHfaKW/kyLhEqmHeAlvB2psWHlg6uWQ//Ew8l4e9qS+8++6pX\nfe6ll1eG00SCB1lgpiIG0yhYm4wZxVcb655apUdF0ElWJCjLuz4bElgctuYinJ55\nybOwu4mjb0m1DTNOq8SaZLYRVHmytN+vzw1RpeiY5ELWZiCBTzI90T8GLQQV+ABN\nsviIZfJiR1BAJKn5lZSrA9VR3A8Q89kohs/Btvrrbi4nMgbLsmAF66aIoTaQYNn4\nNZVVaPb6zZg8Gb0soDhGcgJ2kzJoCQ/B8IpKN1NLLK0ap+LMNyXpEFSquqqgm+oy\n6Mwa15lgtY00eOOD5k25aOUJcC96wBgyeYKjM9QU0BSqr0r8JuxaAjGduDZH1HBZ\nOeRU6joobFd/zyOmpqE5faKUkAB9quwYeYeV4PjOVQbUPA4POMhoanG7b9ypwAhT\nv1lV0Hbi0s/xtbCp1H+gP81L2BwYG2yzGMCoflJrM5Pbd421prDa2kpzdGDF8H5Z\nFkg9Xvm5ain9T30ay7uWsY2NaymhG5pXeI+CMBOczmPAPJXgEcpRItBAj0b3E5ZP\noM9CjxSosbobJ+YEQL7vWqEg+AiTSto+Z27x9fcY1QFfct4qOQKCAQEA4FeCz8cw\nz/8LGfGW0O0/8h4bfeuFUt3l4AkBk+al9XCRg3Kxzh+NL/0AedkeCQdeav2IutnA\nHux9vefswmeVlJwAqckza9geTTOeXntaDJ/bmEj8z4+Law0fLCIC8cao/UBmFDGB\n6bl3LKX0eA8FZMHgYvwUHFJqzKj0Clekgw9KI0u9X+7aR3dCf5rOR5qOHcZl+X/m\n5InP76SrliaBSUMRrAzQnAtuWa8OydtBbSSgcERbMCDkVK1nK8Nd8dR0OptnEFu/\nvEMRAGUDnswOe8T0J6FuzC34tiUXu65TkmvuVTnfhjkkKPmzN46F/xm92DR9JxFp\nHjoeDPQQDG6gtwKCAQEAxrL0kf1v0THga4/LhEDGmAPwDQ8Hobw1PSbURTtzl4Bm\n5kzu9ENu7V2gb84LoYvOIray5GUefzuSH4vn7Hm5qeZWmKs/P8dDXdWRspburY7v\njUNJST7rTQJyMDTKN3nx1V7X4q92k/zxRGteJ64PgnWQo0+vXKrpjpEcH6/Ynob6\nAoo4a2cR5AAxZ+JGrbn7EF7HMZ+QnHy5QcTW6ip5ZSgMcUoHQEaOHRsgmxZthJyG\n1SJO5GVlMw8Su7iW0jgf2SIbzp9OXD7Xx4MXMVy7RcRmZtwZdw58BymYW2L34Qwn\nwGd3pSPAEa8KoTBmztQN8/DoWKny4mLhQZCF3rWhwwKCAQBg2OZ71D3aTPv54zV8\nVC960kyD+5y+vVRzdu/bbYLPhh0LZgQkO7KzuMDv2S8CLtAv1+ui3kX2E5nk1a57\n7kPAt+gBY/5y3AWYxmPj3dRuBsTB5SBealWBjVSbtMMYpO5nBdoLdaPjxlEQUURM\nYA+wA5JeqPv1jg7U80sG+/blLUCQJC5Ir9BDcdSfSbErcClR6Ug0gWan2maNycTZ\nOR4vBmkmoRGdi8HDrbLwqVqBR4KLdLb4+/oWJBWZ6ukvcMwMUPIZOcJ3/2vjg7gg\nYW8PN2M/iI1QT7hCyZiJSSSC3V0yJZ29UAWwOruHjFuEWRR/tYkhyH5csjIu3V3g\nQBHZAoIBAQCylrXrYXbW95VWF/A79lyI1UE0+4VIgPj49aVkdIL4cJgL9qnvMYzK\nG5TP6MnbcOTdnog7cAdxJAG6CO1zRhTx9+1tWr2GfXq3I/XIJpBvvkDhHtEH3F1w\n4fnwCgKWyivqM0ymmj5h1L6lWDtQPsoB39kYb86V46f4U8SLVmnEUlzzW3hKUGFs\nJCBD1sTf8IEPvaAboedAP3ni+yCPZ42ktdI5IOhThRbGYlN0ETxuLKGjfyqZbej/\nc1TLFKW6XGeDqXyEwfqUPoeC8vgtjcNkeZnwaXMZ5xLi/SfLO7C/vUUdUeHfs7o2\nKrXLGs3MqBvCXYz35AhCIc2EOHmaKnYxAoIBAHRgpz65nZYtJzl718i47FcaDhtV\n079WNYK55M9NeQLLsTsX1Jr5B6DnfSnMa7vWtRgQK3hQnv3H1NaNBZxEXbCNcTF3\neN/CU9kMK1COdQLIHOnFF3rUivOABeKzCd07dqEW9uDo5I/qebsAYKq7IAtMLVfZ\n4WxiljWw72xv1wyQoO+2yUTRfdh1SrEWEjZapvc6M6ri08+eTpcEvrOyWqHc5gNk\ny8mw3tTYeaYcK84zzccPgclcU7Zlx4YU2Kqb/tdcAdhbY0H2ugEVcRNmCJpiZfpq\ntQhUSrQsnk2o6wsU59SAwys250ELZmAp4Y4wkupVeRO5gNN3APHIp/9Sup8=\n-----END RSA PRIVATE KEY-----\n"} 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.368+0000 7fc884281640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.371+0000 7fc884281640 1 Processor -- start 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.371+0000 7fc884281640 1 -- start start 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.371+0000 7fc884281640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c11ce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.371+0000 7fc884281640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c11d400 con 0x7fc87c11ca20 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.371+0000 7fc881ff6640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c11ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.371+0000 7fc881ff6640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c11ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44126/0 (socket says 10.20.193.22:44126) 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.371+0000 7fc881ff6640 1 -- 10.20.193.22:0/2780740355 learned_addr learned my addr 10.20.193.22:0/2780740355 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc881ff6640 1 -- 10.20.193.22:0/2780740355 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c11d540 con 0x7fc87c11ca20 2026-02-24T07:20:20.018 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc881ff6640 1 --2- 10.20.193.22:0/2780740355 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c11ce10 crc :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=2131932767076689585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d96258e629f26b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc880ff4640 1 -- 10.20.193.22:0/2780740355 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc86c009d40 con 0x7fc87c11ca20 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc880ff4640 1 -- 10.20.193.22:0/2780740355 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fc86c00e740 con 0x7fc87c11ca20 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc880ff4640 1 -- 10.20.193.22:0/2780740355 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc86c00d6d0 con 0x7fc87c11ca20 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc884281640 1 -- 10.20.193.22:0/2780740355 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 msgr2=0x7fc87c11ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc884281640 1 --2- 10.20.193.22:0/2780740355 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c11ce10 crc :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=2131932767076689585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc884281640 1 -- 10.20.193.22:0/2780740355 shutdown_connections 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc884281640 1 --2- 10.20.193.22:0/2780740355 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c11ce10 unknown :-1 s=CLOSED pgs=72 gs=1 cs=0 l=1 c_cookie=2131932767076689585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc884281640 1 -- 10.20.193.22:0/2780740355 >> 10.20.193.22:0/2780740355 conn(0x7fc87c057ef0 msgr2=0x7fc87c0582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc884281640 1 -- 10.20.193.22:0/2780740355 shutdown_connections 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc884281640 1 -- 10.20.193.22:0/2780740355 wait complete. 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc884281640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.372+0000 7fc884281640 1 Processor -- start 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc884281640 1 -- start start 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc884281640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c1091e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc884281640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c109740 con 0x7fc87c11ca20 2026-02-24T07:20:20.019 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc881ff6640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c1091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc881ff6640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c1091e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44128/0 (socket says 10.20.193.22:44128) 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc881ff6640 1 -- 10.20.193.22:0/3465373136 learned_addr learned my addr 10.20.193.22:0/3465373136 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc881ff6640 1 -- 10.20.193.22:0/3465373136 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c109880 con 0x7fc87c11ca20 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc881ff6640 1 --2- 10.20.193.22:0/3465373136 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c1091e0 crc :-1 s=READY pgs=73 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc86affd640 1 -- 10.20.193.22:0/3465373136 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc86c00d570 con 0x7fc87c11ca20 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc884281640 1 -- 10.20.193.22:0/3465373136 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87c109ad0 con 0x7fc87c11ca20 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc86affd640 1 -- 10.20.193.22:0/3465373136 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fc86c00ded0 con 0x7fc87c11ca20 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc86affd640 1 -- 10.20.193.22:0/3465373136 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc86c013500 con 0x7fc87c11ca20 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc884281640 1 -- 10.20.193.22:0/3465373136 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87c10a3c0 con 0x7fc87c11ca20 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.373+0000 7fc884281640 1 -- 10.20.193.22:0/3465373136 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87c11cdf0 con 0x7fc87c11ca20 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.374+0000 7fc86affd640 1 -- 10.20.193.22:0/3465373136 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 11) ==== 52721+0+0 (crc 0 0 0) 0x7fc86c011040 con 0x7fc87c11ca20 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.374+0000 7fc86affd640 1 --2- 10.20.193.22:0/3465373136 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc85803f6d0 0x7fc85805fb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.374+0000 7fc86affd640 1 -- 10.20.193.22:0/3465373136 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7fc86c0522e0 con 0x7fc87c11ca20 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.374+0000 7fc8817f5640 1 --2- 10.20.193.22:0/3465373136 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc85803f6d0 0x7fc85805fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.374+0000 7fc8817f5640 1 --2- 10.20.193.22:0/3465373136 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc85803f6d0 0x7fc85805fb80 crc :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.376+0000 7fc86affd640 1 -- 10.20.193.22:0/3465373136 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fc86c00c9a0 con 0x7fc87c11ca20 2026-02-24T07:20:20.020 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.486+0000 7fc884281640 1 -- 10.20.193.22:0/3465373136 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}) -- 0x7fc87c10aef0 con 0x7fc85803f6d0 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.991+0000 7fc86affd640 1 -- 10.20.193.22:0/3465373136 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5186 (crc 0 0 0) 0x7fc87c10aef0 con 0x7fc85803f6d0 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.992+0000 7fc884281640 1 -- 10.20.193.22:0/3465373136 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc85803f6d0 msgr2=0x7fc85805fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.992+0000 7fc884281640 1 --2- 10.20.193.22:0/3465373136 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc85803f6d0 0x7fc85805fb80 crc :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.992+0000 7fc884281640 1 -- 10.20.193.22:0/3465373136 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 msgr2=0x7fc87c1091e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.992+0000 7fc884281640 1 --2- 10.20.193.22:0/3465373136 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c1091e0 crc :-1 s=READY pgs=73 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.992+0000 7fc884281640 1 -- 10.20.193.22:0/3465373136 shutdown_connections 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.992+0000 7fc884281640 1 --2- 10.20.193.22:0/3465373136 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc85803f6d0 0x7fc85805fb80 unknown :-1 s=CLOSED pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.992+0000 7fc884281640 1 --2- 10.20.193.22:0/3465373136 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc87c11ca20 0x7fc87c1091e0 unknown :-1 s=CLOSED pgs=73 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.992+0000 7fc884281640 1 -- 10.20.193.22:0/3465373136 >> 10.20.193.22:0/3465373136 conn(0x7fc87c057ef0 msgr2=0x7fc87c0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.992+0000 7fc884281640 1 -- 10.20.193.22:0/3465373136 shutdown_connections 2026-02-24T07:20:20.021 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:19.992+0000 7fc884281640 1 -- 10.20.193.22:0/3465373136 wait complete. 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout SSL certificate updated 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.108+0000 7fccc60bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccc60bf640 1 Processor -- start 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccc60bf640 1 -- start start 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccc60bf640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc011cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccc60bf640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fccc011d3e0 con 0x7fccc011ca00 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccbf7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc011cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccbf7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc011cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44130/0 (socket says 10.20.193.22:44130) 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccbf7fe640 1 -- 10.20.193.22:0/1519150533 learned_addr learned my addr 10.20.193.22:0/1519150533 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccbf7fe640 1 -- 10.20.193.22:0/1519150533 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc011d520 con 0x7fccc011ca00 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccbf7fe640 1 --2- 10.20.193.22:0/1519150533 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc011cdf0 crc :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=562017799478106947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ccb035ff56db43 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccbe7fc640 1 -- 10.20.193.22:0/1519150533 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fccac009d40 con 0x7fccc011ca00 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccbe7fc640 1 -- 10.20.193.22:0/1519150533 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fccac00e740 con 0x7fccc011ca00 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccbe7fc640 1 -- 10.20.193.22:0/1519150533 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fccac00d6d0 con 0x7fccc011ca00 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccc60bf640 1 -- 10.20.193.22:0/1519150533 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 msgr2=0x7fccc011cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccc60bf640 1 --2- 10.20.193.22:0/1519150533 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc011cdf0 crc :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=562017799478106947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.253 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccc60bf640 1 -- 10.20.193.22:0/1519150533 shutdown_connections 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccc60bf640 1 --2- 10.20.193.22:0/1519150533 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc011cdf0 unknown :-1 s=CLOSED pgs=74 gs=1 cs=0 l=1 c_cookie=562017799478106947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccc60bf640 1 -- 10.20.193.22:0/1519150533 >> 10.20.193.22:0/1519150533 conn(0x7fccc0057f30 msgr2=0x7fccc0058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.110+0000 7fccc60bf640 1 -- 10.20.193.22:0/1519150533 shutdown_connections 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccc60bf640 1 -- 10.20.193.22:0/1519150533 wait complete. 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccc60bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccc60bf640 1 Processor -- start 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccc60bf640 1 -- start start 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccc60bf640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc01091f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccc60bf640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0109750 con 0x7fccc011ca00 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccbf7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc01091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccbf7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc01091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44144/0 (socket says 10.20.193.22:44144) 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccbf7fe640 1 -- 10.20.193.22:0/3042102847 learned_addr learned my addr 10.20.193.22:0/3042102847 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccbf7fe640 1 -- 10.20.193.22:0/3042102847 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc0109890 con 0x7fccc011ca00 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccbf7fe640 1 --2- 10.20.193.22:0/3042102847 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc01091f0 crc :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccbcff9640 1 -- 10.20.193.22:0/3042102847 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fccac00d570 con 0x7fccc011ca00 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccbcff9640 1 -- 10.20.193.22:0/3042102847 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fccac00ded0 con 0x7fccc011ca00 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccc60bf640 1 -- 10.20.193.22:0/3042102847 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc0109ae0 con 0x7fccc011ca00 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccbcff9640 1 -- 10.20.193.22:0/3042102847 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fccac013500 con 0x7fccc011ca00 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.111+0000 7fccc60bf640 1 -- 10.20.193.22:0/3042102847 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc010a3d0 con 0x7fccc011ca00 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.112+0000 7fccc60bf640 1 -- 10.20.193.22:0/3042102847 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc011cdd0 con 0x7fccc011ca00 2026-02-24T07:20:20.254 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.112+0000 7fccbcff9640 1 -- 10.20.193.22:0/3042102847 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 11) ==== 52721+0+0 (crc 0 0 0) 0x7fccac011040 con 0x7fccc011ca00 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.112+0000 7fccbcff9640 1 --2- 10.20.193.22:0/3042102847 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcc9403f6d0 0x7fcc9405fb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.112+0000 7fccbcff9640 1 -- 10.20.193.22:0/3042102847 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7fccac0522b0 con 0x7fccc011ca00 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.112+0000 7fccbeffd640 1 --2- 10.20.193.22:0/3042102847 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcc9403f6d0 0x7fcc9405fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.113+0000 7fccbeffd640 1 --2- 10.20.193.22:0/3042102847 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcc9403f6d0 0x7fcc9405fb80 crc :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.115+0000 7fccbcff9640 1 -- 10.20.193.22:0/3042102847 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fccac00c9a0 con 0x7fccc011ca00 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.225+0000 7fccc60bf640 1 -- 10.20.193.22:0/3042102847 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}) -- 0x7fccc004da50 con 0x7fcc9403f6d0 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.227+0000 7fccbcff9640 1 -- 10.20.193.22:0/3042102847 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (crc 0 0 0) 0x7fccc004da50 con 0x7fcc9403f6d0 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.228+0000 7fccc60bf640 1 -- 10.20.193.22:0/3042102847 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcc9403f6d0 msgr2=0x7fcc9405fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.228+0000 7fccc60bf640 1 --2- 10.20.193.22:0/3042102847 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcc9403f6d0 0x7fcc9405fb80 crc :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.228+0000 7fccc60bf640 1 -- 10.20.193.22:0/3042102847 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 msgr2=0x7fccc01091f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.228+0000 7fccc60bf640 1 --2- 10.20.193.22:0/3042102847 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc01091f0 crc :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.228+0000 7fccc60bf640 1 -- 10.20.193.22:0/3042102847 shutdown_connections 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.228+0000 7fccc60bf640 1 --2- 10.20.193.22:0/3042102847 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcc9403f6d0 0x7fcc9405fb80 unknown :-1 s=CLOSED pgs=8 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.228+0000 7fccc60bf640 1 --2- 10.20.193.22:0/3042102847 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fccc011ca00 0x7fccc01091f0 unknown :-1 s=CLOSED pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.228+0000 7fccc60bf640 1 -- 10.20.193.22:0/3042102847 >> 10.20.193.22:0/3042102847 conn(0x7fccc0057f30 msgr2=0x7fccc00ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.228+0000 7fccc60bf640 1 -- 10.20.193.22:0/3042102847 shutdown_connections 2026-02-24T07:20:20.255 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.228+0000 7fccc60bf640 1 -- 10.20.193.22:0/3042102847 wait complete. 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.337+0000 7f0de1063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.338+0000 7f0de1063640 1 Processor -- start 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.338+0000 7f0de1063640 1 -- start start 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.338+0000 7f0de1063640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc11cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.338+0000 7f0de1063640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc11d3e0 con 0x7f0ddc11ca00 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0ddad76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc11cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0ddad76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc11cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44148/0 (socket says 10.20.193.22:44148) 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0ddad76640 1 -- 10.20.193.22:0/947654190 learned_addr learned my addr 10.20.193.22:0/947654190 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0ddad76640 1 -- 10.20.193.22:0/947654190 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc11d520 con 0x7f0ddc11ca00 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0ddad76640 1 --2- 10.20.193.22:0/947654190 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc11cdf0 crc :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=1392297535158087468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13526f3b44bfef2c server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0dd9d74640 1 -- 10.20.193.22:0/947654190 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0dd0009d40 con 0x7f0ddc11ca00 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0dd9d74640 1 -- 10.20.193.22:0/947654190 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f0dd000e740 con 0x7f0ddc11ca00 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0dd9d74640 1 -- 10.20.193.22:0/947654190 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0dd000d6d0 con 0x7f0ddc11ca00 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0de1063640 1 -- 10.20.193.22:0/947654190 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 msgr2=0x7f0ddc11cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0de1063640 1 --2- 10.20.193.22:0/947654190 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc11cdf0 crc :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=1392297535158087468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0de1063640 1 -- 10.20.193.22:0/947654190 shutdown_connections 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0de1063640 1 --2- 10.20.193.22:0/947654190 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc11cdf0 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=1392297535158087468 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0de1063640 1 -- 10.20.193.22:0/947654190 >> 10.20.193.22:0/947654190 conn(0x7f0ddc057f30 msgr2=0x7f0ddc058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0de1063640 1 -- 10.20.193.22:0/947654190 shutdown_connections 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0de1063640 1 -- 10.20.193.22:0/947654190 wait complete. 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.339+0000 7f0de1063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0de1063640 1 Processor -- start 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0de1063640 1 -- start start 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0de1063640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc1091f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0de1063640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc109750 con 0x7f0ddc11ca00 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0ddad76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc1091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.482 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0ddad76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc1091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44162/0 (socket says 10.20.193.22:44162) 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0ddad76640 1 -- 10.20.193.22:0/66123831 learned_addr learned my addr 10.20.193.22:0/66123831 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0ddad76640 1 -- 10.20.193.22:0/66123831 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc109890 con 0x7f0ddc11ca00 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0ddad76640 1 --2- 10.20.193.22:0/66123831 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc1091f0 crc :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0dbbfff640 1 -- 10.20.193.22:0/66123831 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0dd000d570 con 0x7f0ddc11ca00 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0de1063640 1 -- 10.20.193.22:0/66123831 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ddc109ae0 con 0x7f0ddc11ca00 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0dbbfff640 1 -- 10.20.193.22:0/66123831 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f0dd000d6d0 con 0x7f0ddc11ca00 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0dbbfff640 1 -- 10.20.193.22:0/66123831 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0dd0013500 con 0x7f0ddc11ca00 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.340+0000 7f0de1063640 1 -- 10.20.193.22:0/66123831 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ddc10a3d0 con 0x7f0ddc11ca00 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.341+0000 7f0de1063640 1 -- 10.20.193.22:0/66123831 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ddc11cdd0 con 0x7f0ddc11ca00 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.341+0000 7f0dbbfff640 1 -- 10.20.193.22:0/66123831 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 12) ==== 52827+0+0 (crc 0 0 0) 0x7f0dd0011040 con 0x7f0ddc11ca00 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.341+0000 7f0dbbfff640 1 --2- 10.20.193.22:0/66123831 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0db003f840 0x7f0db005fcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.341+0000 7f0dbbfff640 1 -- 10.20.193.22:0/66123831 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7f0dd0052520 con 0x7f0ddc11ca00 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.341+0000 7f0dda575640 1 --2- 10.20.193.22:0/66123831 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0db003f840 0x7f0db005fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.341+0000 7f0dda575640 1 --2- 10.20.193.22:0/66123831 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0db003f840 0x7f0db005fcf0 crc :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.343+0000 7f0dbbfff640 1 -- 10.20.193.22:0/66123831 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f0dd000c7a0 con 0x7f0ddc11ca00 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.455+0000 7f0de1063640 1 -- 10.20.193.22:0/66123831 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}) -- 0x7f0ddc04da50 con 0x7f0db003f840 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.457+0000 7f0dbbfff640 1 -- 10.20.193.22:0/66123831 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (crc 0 0 0) 0x7f0ddc04da50 con 0x7f0db003f840 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.458+0000 7f0de1063640 1 -- 10.20.193.22:0/66123831 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0db003f840 msgr2=0x7f0db005fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.458+0000 7f0de1063640 1 --2- 10.20.193.22:0/66123831 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0db003f840 0x7f0db005fcf0 crc :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.458+0000 7f0de1063640 1 -- 10.20.193.22:0/66123831 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 msgr2=0x7f0ddc1091f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.458+0000 7f0de1063640 1 --2- 10.20.193.22:0/66123831 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc1091f0 crc :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.458+0000 7f0de1063640 1 -- 10.20.193.22:0/66123831 shutdown_connections 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.458+0000 7f0de1063640 1 --2- 10.20.193.22:0/66123831 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0db003f840 0x7f0db005fcf0 unknown :-1 s=CLOSED pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.458+0000 7f0de1063640 1 --2- 10.20.193.22:0/66123831 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0ddc11ca00 0x7f0ddc1091f0 unknown :-1 s=CLOSED pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.458+0000 7f0de1063640 1 -- 10.20.193.22:0/66123831 >> 10.20.193.22:0/66123831 conn(0x7f0ddc057f30 msgr2=0x7f0ddc0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.458+0000 7f0de1063640 1 -- 10.20.193.22:0/66123831 shutdown_connections 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.458+0000 7f0de1063640 1 -- 10.20.193.22:0/66123831 wait complete. 2026-02-24T07:20:20.483 INFO:teuthology.orchestra.run.trial022.stdout:Creating initial admin user... 2026-02-24T07:20:20.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:20 trial022 ceph-mon[39108]: [24/Feb/2026:07:20:18] ENGINE Bus STARTING 2026-02-24T07:20:20.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:20 trial022 ceph-mon[39108]: [24/Feb/2026:07:20:18] ENGINE Serving on http://10.20.193.22:8765 2026-02-24T07:20:20.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:20 trial022 ceph-mon[39108]: [24/Feb/2026:07:20:18] ENGINE Serving on https://10.20.193.22:7150 2026-02-24T07:20:20.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:20 trial022 ceph-mon[39108]: [24/Feb/2026:07:20:18] ENGINE Bus STARTED 2026-02-24T07:20:20.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:20 trial022 ceph-mon[39108]: [24/Feb/2026:07:20:18] ENGINE Client ('10.20.193.22', 42396) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T07:20:20.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:20 trial022 ceph-mon[39108]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-24T07:20:20.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:20 trial022 ceph-mon[39108]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-24T07:20:20.503 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:20 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:20.923 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$k4EhCZw0mRlB6l80.o5XwOV/nOOMn8HHQCP/xyHvTYklqr6.Ke/.W", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771917620, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-24T07:20:20.923 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.572+0000 7f9b67e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:20.923 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.576+0000 7f9b67e7f640 1 Processor -- start 2026-02-24T07:20:20.923 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.576+0000 7f9b67e7f640 1 -- start start 2026-02-24T07:20:20.923 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b67e7f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b6011cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.923 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b67e7f640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6011d3e0 con 0x7f9b6011ca00 2026-02-24T07:20:20.923 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b65bf4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b6011cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b65bf4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b6011cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44164/0 (socket says 10.20.193.22:44164) 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b65bf4640 1 -- 10.20.193.22:0/1704915054 learned_addr learned my addr 10.20.193.22:0/1704915054 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b65bf4640 1 -- 10.20.193.22:0/1704915054 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6011d520 con 0x7f9b6011ca00 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b65bf4640 1 --2- 10.20.193.22:0/1704915054 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b6011cdf0 crc :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=9350695425298191424 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c457f27bc4d440 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b64bf2640 1 -- 10.20.193.22:0/1704915054 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f9b5c00ae20 con 0x7f9b6011ca00 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b64bf2640 1 -- 10.20.193.22:0/1704915054 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f9b5c00f740 con 0x7f9b6011ca00 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b64bf2640 1 -- 10.20.193.22:0/1704915054 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f9b5c00e730 con 0x7f9b6011ca00 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b67e7f640 1 -- 10.20.193.22:0/1704915054 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 msgr2=0x7f9b6011cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b67e7f640 1 --2- 10.20.193.22:0/1704915054 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b6011cdf0 crc :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=9350695425298191424 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b67e7f640 1 -- 10.20.193.22:0/1704915054 shutdown_connections 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b67e7f640 1 --2- 10.20.193.22:0/1704915054 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b6011cdf0 unknown :-1 s=CLOSED pgs=78 gs=1 cs=0 l=1 c_cookie=9350695425298191424 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.924 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b67e7f640 1 -- 10.20.193.22:0/1704915054 >> 10.20.193.22:0/1704915054 conn(0x7f9b60057f30 msgr2=0x7f9b60058330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b67e7f640 1 -- 10.20.193.22:0/1704915054 shutdown_connections 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.577+0000 7f9b67e7f640 1 -- 10.20.193.22:0/1704915054 wait complete. 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b67e7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b67e7f640 1 Processor -- start 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b67e7f640 1 -- start start 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b67e7f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b60109210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b67e7f640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9b60109770 con 0x7f9b6011ca00 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b65bf4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b60109210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b65bf4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b60109210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44174/0 (socket says 10.20.193.22:44174) 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b65bf4640 1 -- 10.20.193.22:0/770415437 learned_addr learned my addr 10.20.193.22:0/770415437 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:20.925 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b65bf4640 1 -- 10.20.193.22:0/770415437 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b601098b0 con 0x7f9b6011ca00 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b65bf4640 1 --2- 10.20.193.22:0/770415437 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b60109210 crc :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b4effd640 1 -- 10.20.193.22:0/770415437 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f9b5c00ae20 con 0x7f9b6011ca00 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b67e7f640 1 -- 10.20.193.22:0/770415437 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b60109b60 con 0x7f9b6011ca00 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b4effd640 1 -- 10.20.193.22:0/770415437 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f9b5c00a7b0 con 0x7f9b6011ca00 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b4effd640 1 -- 10.20.193.22:0/770415437 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f9b5c014570 con 0x7f9b6011ca00 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.578+0000 7f9b67e7f640 1 -- 10.20.193.22:0/770415437 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b6010a590 con 0x7f9b6011ca00 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.579+0000 7f9b67e7f640 1 -- 10.20.193.22:0/770415437 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b60109eb0 con 0x7f9b6011ca00 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.579+0000 7f9b4effd640 1 -- 10.20.193.22:0/770415437 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 12) ==== 52827+0+0 (crc 0 0 0) 0x7f9b5c012040 con 0x7f9b6011ca00 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.579+0000 7f9b4effd640 1 --2- 10.20.193.22:0/770415437 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f9b3c03f7f0 0x7f9b3c05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.579+0000 7f9b4effd640 1 -- 10.20.193.22:0/770415437 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7f9b5c0533c0 con 0x7f9b6011ca00 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.579+0000 7f9b653f3640 1 --2- 10.20.193.22:0/770415437 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f9b3c03f7f0 0x7f9b3c05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:20.926 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.579+0000 7f9b653f3640 1 --2- 10.20.193.22:0/770415437 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f9b3c03f7f0 0x7f9b3c05fca0 crc :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.581+0000 7f9b4effd640 1 -- 10.20.193.22:0/770415437 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f9b5c0149b0 con 0x7f9b6011ca00 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.692+0000 7f9b67e7f640 1 -- 10.20.193.22:0/770415437 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f9b6004da50 con 0x7f9b3c03f7f0 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.892+0000 7f9b4effd640 1 -- 10.20.193.22:0/770415437 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (crc 0 0 0) 0x7f9b6004da50 con 0x7f9b3c03f7f0 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.895+0000 7f9b67e7f640 1 -- 10.20.193.22:0/770415437 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f9b3c03f7f0 msgr2=0x7f9b3c05fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.895+0000 7f9b67e7f640 1 --2- 10.20.193.22:0/770415437 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f9b3c03f7f0 0x7f9b3c05fca0 crc :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.895+0000 7f9b67e7f640 1 -- 10.20.193.22:0/770415437 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 msgr2=0x7f9b60109210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.895+0000 7f9b67e7f640 1 --2- 10.20.193.22:0/770415437 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b60109210 crc :-1 s=READY pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.895+0000 7f9b67e7f640 1 -- 10.20.193.22:0/770415437 shutdown_connections 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.895+0000 7f9b67e7f640 1 --2- 10.20.193.22:0/770415437 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f9b3c03f7f0 0x7f9b3c05fca0 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.895+0000 7f9b67e7f640 1 --2- 10.20.193.22:0/770415437 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9b6011ca00 0x7f9b60109210 unknown :-1 s=CLOSED pgs=79 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.895+0000 7f9b67e7f640 1 -- 10.20.193.22:0/770415437 >> 10.20.193.22:0/770415437 conn(0x7f9b60057f30 msgr2=0x7f9b600ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:20.927 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.895+0000 7f9b67e7f640 1 -- 10.20.193.22:0/770415437 shutdown_connections 2026-02-24T07:20:20.928 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:20.895+0000 7f9b67e7f640 1 -- 10.20.193.22:0/770415437 wait complete. 2026-02-24T07:20:20.928 INFO:teuthology.orchestra.run.trial022.stdout:Fetching dashboard port number... 2026-02-24T07:20:21.146 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stdout 8443 2026-02-24T07:20:21.146 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.002+0000 7f94ba9b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:21.146 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.005+0000 7f94ba9b6640 1 Processor -- start 2026-02-24T07:20:21.146 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.005+0000 7f94ba9b6640 1 -- start start 2026-02-24T07:20:21.146 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.005+0000 7f94ba9b6640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b411ce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.005+0000 7f94ba9b6640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f94b411d400 con 0x7f94b411ca20 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94b3fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b411ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94b3fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b411ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44178/0 (socket says 10.20.193.22:44178) 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94b3fff640 1 -- 10.20.193.22:0/1523720948 learned_addr learned my addr 10.20.193.22:0/1523720948 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94b3fff640 1 -- 10.20.193.22:0/1523720948 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b411d540 con 0x7f94b411ca20 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94b3fff640 1 --2- 10.20.193.22:0/1523720948 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b411ce10 crc :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=11857991435120570449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4900c6247fc7051 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94b2ffd640 1 -- 10.20.193.22:0/1523720948 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f94a0009d40 con 0x7f94b411ca20 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94b2ffd640 1 -- 10.20.193.22:0/1523720948 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f94a000e740 con 0x7f94b411ca20 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94b2ffd640 1 -- 10.20.193.22:0/1523720948 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f94a000d6d0 con 0x7f94b411ca20 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1523720948 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 msgr2=0x7f94b411ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94ba9b6640 1 --2- 10.20.193.22:0/1523720948 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b411ce10 crc :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=11857991435120570449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1523720948 shutdown_connections 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94ba9b6640 1 --2- 10.20.193.22:0/1523720948 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b411ce10 unknown :-1 s=CLOSED pgs=80 gs=1 cs=0 l=1 c_cookie=11857991435120570449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.147 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1523720948 >> 10.20.193.22:0/1523720948 conn(0x7f94b4057ef0 msgr2=0x7f94b40582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1523720948 shutdown_connections 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.006+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1523720948 wait complete. 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94ba9b6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94ba9b6640 1 Processor -- start 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94ba9b6640 1 -- start start 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94ba9b6640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b41091e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94ba9b6640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4109740 con 0x7f94b411ca20 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94b3fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b41091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94b3fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b41091e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44180/0 (socket says 10.20.193.22:44180) 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94b3fff640 1 -- 10.20.193.22:0/1153634499 learned_addr learned my addr 10.20.193.22:0/1153634499 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94b3fff640 1 -- 10.20.193.22:0/1153634499 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b4109880 con 0x7f94b411ca20 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94b3fff640 1 --2- 10.20.193.22:0/1153634499 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b41091e0 crc :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94b17fa640 1 -- 10.20.193.22:0/1153634499 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f94a000d570 con 0x7f94b411ca20 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94b17fa640 1 -- 10.20.193.22:0/1153634499 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f94a000ded0 con 0x7f94b411ca20 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94b17fa640 1 -- 10.20.193.22:0/1153634499 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f94a0013500 con 0x7f94b411ca20 2026-02-24T07:20:21.148 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1153634499 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b4109ad0 con 0x7f94b411ca20 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.007+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1153634499 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b410a3c0 con 0x7f94b411ca20 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.008+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1153634499 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b411cdf0 con 0x7f94b411ca20 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.008+0000 7f94b17fa640 1 -- 10.20.193.22:0/1153634499 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 12) ==== 52827+0+0 (crc 0 0 0) 0x7f94a0011040 con 0x7f94b411ca20 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.008+0000 7f94b17fa640 1 --2- 10.20.193.22:0/1153634499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f948803f840 0x7f948805fcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.008+0000 7f94b17fa640 1 -- 10.20.193.22:0/1153634499 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7f94a0052390 con 0x7f94b411ca20 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.008+0000 7f94b37fe640 1 --2- 10.20.193.22:0/1153634499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f948803f840 0x7f948805fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.009+0000 7f94b37fe640 1 --2- 10.20.193.22:0/1153634499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f948803f840 0x7f948805fcf0 crc :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.010+0000 7f94b17fa640 1 -- 10.20.193.22:0/1153634499 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f94a000c150 con 0x7f94b411ca20 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.116+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1153634499 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f94b413f140 con 0x7f94b411ca20 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.116+0000 7f94b17fa640 1 -- 10.20.193.22:0/1153634499 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (crc 0 0 0) 0x7f94a000f7b0 con 0x7f94b411ca20 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.119+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1153634499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f948803f840 msgr2=0x7f948805fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.119+0000 7f94ba9b6640 1 --2- 10.20.193.22:0/1153634499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f948803f840 0x7f948805fcf0 crc :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.119+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1153634499 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 msgr2=0x7f94b41091e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.119+0000 7f94ba9b6640 1 --2- 10.20.193.22:0/1153634499 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b41091e0 crc :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.119+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1153634499 shutdown_connections 2026-02-24T07:20:21.149 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.119+0000 7f94ba9b6640 1 --2- 10.20.193.22:0/1153634499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f948803f840 0x7f948805fcf0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.119+0000 7f94ba9b6640 1 --2- 10.20.193.22:0/1153634499 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f94b411ca20 0x7f94b41091e0 unknown :-1 s=CLOSED pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.119+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1153634499 >> 10.20.193.22:0/1153634499 conn(0x7f94b4057ef0 msgr2=0x7f94b40ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:21.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.119+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1153634499 shutdown_connections 2026-02-24T07:20:21.150 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.119+0000 7f94ba9b6640 1 -- 10.20.193.22:0/1153634499 wait complete. 2026-02-24T07:20:21.151 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-24T07:20:21.151 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout disabled 2026-02-24T07:20:21.156 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-24T07:20:21.156 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout inactive 2026-02-24T07:20:21.156 INFO:teuthology.orchestra.run.trial022.stdout:firewalld.service is not enabled 2026-02-24T07:20:21.157 INFO:teuthology.orchestra.run.trial022.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-24T07:20:21.157 INFO:teuthology.orchestra.run.trial022.stdout:Ceph Dashboard is now available at: 2026-02-24T07:20:21.158 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:21.158 INFO:teuthology.orchestra.run.trial022.stdout: URL: https://trial022:8443/ 2026-02-24T07:20:21.158 INFO:teuthology.orchestra.run.trial022.stdout: User: admin 2026-02-24T07:20:21.158 INFO:teuthology.orchestra.run.trial022.stdout: Password: jab1xz009a 2026-02-24T07:20:21.158 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:21.158 INFO:teuthology.orchestra.run.trial022.stdout:Saving cluster configuration to /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config directory 2026-02-24T07:20:21.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.243+0000 7fccd3690640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:21.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.246+0000 7fccd3690640 1 Processor -- start 2026-02-24T07:20:21.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.246+0000 7fccd3690640 1 -- start start 2026-02-24T07:20:21.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.246+0000 7fccd3690640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc11ce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:21.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.246+0000 7fccd3690640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc11d400 con 0x7fcccc11ca20 2026-02-24T07:20:21.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.246+0000 7fccd1405640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc11ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:21.434 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.246+0000 7fccd1405640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc11ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44188/0 (socket says 10.20.193.22:44188) 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.246+0000 7fccd1405640 1 -- 10.20.193.22:0/1025424442 learned_addr learned my addr 10.20.193.22:0/1025424442 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.246+0000 7fccd1405640 1 -- 10.20.193.22:0/1025424442 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc11d540 con 0x7fcccc11ca20 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.246+0000 7fccd1405640 1 --2- 10.20.193.22:0/1025424442 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc11ce10 crc :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=8246695090734501391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7272257dfe300e0f server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccbbfff640 1 -- 10.20.193.22:0/1025424442 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fccbc009d40 con 0x7fcccc11ca20 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccbbfff640 1 -- 10.20.193.22:0/1025424442 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fccbc00e740 con 0x7fcccc11ca20 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccbbfff640 1 -- 10.20.193.22:0/1025424442 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fccbc00d6d0 con 0x7fcccc11ca20 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 -- 10.20.193.22:0/1025424442 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 msgr2=0x7fcccc11ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 --2- 10.20.193.22:0/1025424442 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc11ce10 crc :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=8246695090734501391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 -- 10.20.193.22:0/1025424442 shutdown_connections 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 --2- 10.20.193.22:0/1025424442 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc11ce10 unknown :-1 s=CLOSED pgs=82 gs=1 cs=0 l=1 c_cookie=8246695090734501391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 -- 10.20.193.22:0/1025424442 >> 10.20.193.22:0/1025424442 conn(0x7fcccc057ef0 msgr2=0x7fcccc0582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:21.435 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 -- 10.20.193.22:0/1025424442 shutdown_connections 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 -- 10.20.193.22:0/1025424442 wait complete. 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 Processor -- start 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 -- start start 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc1091e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd3690640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc109740 con 0x7fcccc11ca20 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd1405640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc1091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd1405640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc1091e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:44202/0 (socket says 10.20.193.22:44202) 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.247+0000 7fccd1405640 1 -- 10.20.193.22:0/2948197673 learned_addr learned my addr 10.20.193.22:0/2948197673 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.248+0000 7fccd1405640 1 -- 10.20.193.22:0/2948197673 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc109880 con 0x7fcccc11ca20 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.248+0000 7fccd1405640 1 --2- 10.20.193.22:0/2948197673 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc1091e0 crc :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:21.436 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.248+0000 7fccba7fc640 1 -- 10.20.193.22:0/2948197673 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fccbc00d570 con 0x7fcccc11ca20 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.248+0000 7fccba7fc640 1 -- 10.20.193.22:0/2948197673 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fccbc00ded0 con 0x7fcccc11ca20 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.248+0000 7fccba7fc640 1 -- 10.20.193.22:0/2948197673 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fccbc013500 con 0x7fcccc11ca20 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.248+0000 7fccd3690640 1 -- 10.20.193.22:0/2948197673 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc109ad0 con 0x7fcccc11ca20 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.248+0000 7fccd3690640 1 -- 10.20.193.22:0/2948197673 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc10a3c0 con 0x7fcccc11ca20 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.248+0000 7fccd3690640 1 -- 10.20.193.22:0/2948197673 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcccc11cdf0 con 0x7fcccc11ca20 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.248+0000 7fccba7fc640 1 -- 10.20.193.22:0/2948197673 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 12) ==== 52827+0+0 (crc 0 0 0) 0x7fccbc011040 con 0x7fcccc11ca20 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.249+0000 7fccba7fc640 1 --2- 10.20.193.22:0/2948197673 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcca803f7f0 0x7fcca805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.249+0000 7fccba7fc640 1 -- 10.20.193.22:0/2948197673 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7fccbc052510 con 0x7fcccc11ca20 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.249+0000 7fccd0c04640 1 --2- 10.20.193.22:0/2948197673 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcca803f7f0 0x7fcca805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.249+0000 7fccd0c04640 1 --2- 10.20.193.22:0/2948197673 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcca803f7f0 0x7fcca805fca0 crc :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:21.437 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.251+0000 7fccba7fc640 1 -- 10.20.193.22:0/2948197673 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fccbc013ae0 con 0x7fcccc11ca20 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.405+0000 7fccd3690640 1 -- 10.20.193.22:0/2948197673 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fcccc13f140 con 0x7fcccc11ca20 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.407+0000 7fccba7fc640 1 -- 10.20.193.22:0/2948197673 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v32)=0 set mgr/dashboard/cluster/status v32) ==== 153+0+0 (crc 0 0 0) 0x7fccbc00f7b0 con 0x7fcccc11ca20 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.408+0000 7fccd3690640 1 -- 10.20.193.22:0/2948197673 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcca803f7f0 msgr2=0x7fcca805fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.408+0000 7fccd3690640 1 --2- 10.20.193.22:0/2948197673 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcca803f7f0 0x7fcca805fca0 crc :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.408+0000 7fccd3690640 1 -- 10.20.193.22:0/2948197673 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 msgr2=0x7fcccc1091e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.408+0000 7fccd3690640 1 --2- 10.20.193.22:0/2948197673 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc1091e0 crc :-1 s=READY pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.408+0000 7fccd3690640 1 -- 10.20.193.22:0/2948197673 shutdown_connections 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.408+0000 7fccd3690640 1 --2- 10.20.193.22:0/2948197673 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fcca803f7f0 0x7fcca805fca0 unknown :-1 s=CLOSED pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.408+0000 7fccd3690640 1 --2- 10.20.193.22:0/2948197673 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcccc11ca20 0x7fcccc1091e0 unknown :-1 s=CLOSED pgs=83 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.408+0000 7fccd3690640 1 -- 10.20.193.22:0/2948197673 >> 10.20.193.22:0/2948197673 conn(0x7fcccc057ef0 msgr2=0x7fcccc0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:21.438 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.408+0000 7fccd3690640 1 -- 10.20.193.22:0/2948197673 shutdown_connections 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout:/usr/bin/ceph: stderr 2026-02-24T07:20:21.408+0000 7fccd3690640 1 -- 10.20.193.22:0/2948197673 wait complete. 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout:Or, if you are only running a single cluster on this host: 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-24T07:20:21.439 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:21.440 INFO:teuthology.orchestra.run.trial022.stdout: ceph telemetry on 2026-02-24T07:20:21.440 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:21.440 INFO:teuthology.orchestra.run.trial022.stdout:For more information see: 2026-02-24T07:20:21.440 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:21.440 INFO:teuthology.orchestra.run.trial022.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-24T07:20:21.440 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:21.440 INFO:teuthology.orchestra.run.trial022.stdout:Bootstrap complete. 2026-02-24T07:20:21.440 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:21 trial022 ceph-mon[39108]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:21.441 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:21 trial022 ceph-mon[39108]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:21.441 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:21 trial022 ceph-mon[39108]: mgrmap e12: x(active, since 2s) 2026-02-24T07:20:21.441 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:21 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:21.441 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:21 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:21.441 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:21 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1153634499' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2026-02-24T07:20:21.441 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout static 2026-02-24T07:20:21.444 INFO:teuthology.orchestra.run.trial022.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-24T07:20:21.444 INFO:teuthology.orchestra.run.trial022.stdout:systemctl: stdout inactive 2026-02-24T07:20:21.444 INFO:teuthology.orchestra.run.trial022.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-24T07:20:21.594 INFO:tasks.cephadm:Fetching config... 2026-02-24T07:20:21.594 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:20:21.594 DEBUG:teuthology.orchestra.run.trial022:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-24T07:20:21.651 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-24T07:20:21.651 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:20:21.651 DEBUG:teuthology.orchestra.run.trial022:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-24T07:20:21.708 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-24T07:20:21.708 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:20:21.709 DEBUG:teuthology.orchestra.run.trial022:> sudo dd if=/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-24T07:20:21.775 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-24T07:20:21.775 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:20:21.775 DEBUG:teuthology.orchestra.run.trial022:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-24T07:20:21.832 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-24T07:20:21.832 DEBUG:teuthology.orchestra.run.trial022:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJoUmQXuRMLhM4tr38N7h23w4q8GeJoP/9kPxPX8Inxh ceph-30400272-1151-11f1-be09-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T07:20:21.905 INFO:teuthology.orchestra.run.trial022.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJoUmQXuRMLhM4tr38N7h23w4q8GeJoP/9kPxPX8Inxh ceph-30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:20:21.916 DEBUG:teuthology.orchestra.run.trial195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJoUmQXuRMLhM4tr38N7h23w4q8GeJoP/9kPxPX8Inxh ceph-30400272-1151-11f1-be09-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-24T07:20:21.952 INFO:teuthology.orchestra.run.trial195.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJoUmQXuRMLhM4tr38N7h23w4q8GeJoP/9kPxPX8Inxh ceph-30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:20:21.962 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-24T07:20:22.077 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:22.193 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:22.193 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 -- 10.20.193.22:0/3603223072 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f15f410e8d0 msgr2=0x7f15f410ecc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:22.193 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 --2- 10.20.193.22:0/3603223072 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f15f410e8d0 0x7f15f410ecc0 crc :-1 s=READY pgs=84 gs=1 cs=0 l=1 c_cookie=15116387524645719438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.193 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 -- 10.20.193.22:0/3603223072 shutdown_connections 2026-02-24T07:20:22.193 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 --2- 10.20.193.22:0/3603223072 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f15f410e8d0 0x7f15f410ecc0 unknown :-1 s=CLOSED pgs=84 gs=1 cs=0 l=1 c_cookie=15116387524645719438 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.193 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 -- 10.20.193.22:0/3603223072 >> 10.20.193.22:0/3603223072 conn(0x7f15f40ec060 msgr2=0x7f15f410c470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:22.194 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 -- 10.20.193.22:0/3603223072 shutdown_connections 2026-02-24T07:20:22.194 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 -- 10.20.193.22:0/3603223072 wait complete. 2026-02-24T07:20:22.194 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:22.194 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 Processor -- start 2026-02-24T07:20:22.194 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 -- start start 2026-02-24T07:20:22.194 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f15f410e8d0 0x7f15f411c810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:22.194 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15fbe92640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f15f411cd70 con 0x7f15f410e8d0 2026-02-24T07:20:22.194 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15f9c07640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f15f410e8d0 0x7f15f411c810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:22.194 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15f9c07640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f15f410e8d0 0x7f15f411c810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51702/0 (socket says 10.20.193.22:51702) 2026-02-24T07:20:22.194 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15f9c07640 1 -- 10.20.193.22:0/3689722150 learned_addr learned my addr 10.20.193.22:0/3689722150 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:22.195 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.188+0000 7f15f9c07640 1 -- 10.20.193.22:0/3689722150 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f411ceb0 con 0x7f15f410e8d0 2026-02-24T07:20:22.195 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15f9c07640 1 --2- 10.20.193.22:0/3689722150 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f15f410e8d0 0x7f15f411c810 crc :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:22.195 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15e2ffd640 1 -- 10.20.193.22:0/3689722150 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f15e400d690 con 0x7f15f410e8d0 2026-02-24T07:20:22.195 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15e2ffd640 1 -- 10.20.193.22:0/3689722150 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f15e400d7f0 con 0x7f15f410e8d0 2026-02-24T07:20:22.195 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15fbe92640 1 -- 10.20.193.22:0/3689722150 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f411d100 con 0x7f15f410e8d0 2026-02-24T07:20:22.195 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15e2ffd640 1 -- 10.20.193.22:0/3689722150 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f15e400fd70 con 0x7f15f410e8d0 2026-02-24T07:20:22.195 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15fbe92640 1 -- 10.20.193.22:0/3689722150 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f411da70 con 0x7f15f410e8d0 2026-02-24T07:20:22.195 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15fbe92640 1 -- 10.20.193.22:0/3689722150 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f4132210 con 0x7f15f410e8d0 2026-02-24T07:20:22.195 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15e2ffd640 1 -- 10.20.193.22:0/3689722150 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 12) ==== 52827+0+0 (crc 0 0 0) 0x7f15e40026a0 con 0x7f15f410e8d0 2026-02-24T07:20:22.195 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15e2ffd640 1 --2- 10.20.193.22:0/3689722150 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f15d003f7f0 0x7f15d005fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:22.196 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15e2ffd640 1 -- 10.20.193.22:0/3689722150 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7f15e4051b90 con 0x7f15f410e8d0 2026-02-24T07:20:22.196 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.189+0000 7f15f9406640 1 --2- 10.20.193.22:0/3689722150 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f15d003f7f0 0x7f15d005fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:22.196 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.190+0000 7f15f9406640 1 --2- 10.20.193.22:0/3689722150 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f15d003f7f0 0x7f15d005fca0 crc :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:22.196 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.191+0000 7f15e2ffd640 1 -- 10.20.193.22:0/3689722150 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f15e4015340 con 0x7f15f410e8d0 2026-02-24T07:20:22.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.295+0000 7f15fbe92640 1 -- 10.20.193.22:0/3689722150 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f15f4132420 con 0x7f15f410e8d0 2026-02-24T07:20:22.299 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.297+0000 7f15e2ffd640 1 -- 10.20.193.22:0/3689722150 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (crc 0 0 0) 0x7f15e40140c0 con 0x7f15f410e8d0 2026-02-24T07:20:22.301 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.298+0000 7f15fbe92640 1 -- 10.20.193.22:0/3689722150 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f15d003f7f0 msgr2=0x7f15d005fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:22.301 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.298+0000 7f15fbe92640 1 --2- 10.20.193.22:0/3689722150 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f15d003f7f0 0x7f15d005fca0 crc :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.301 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.298+0000 7f15fbe92640 1 -- 10.20.193.22:0/3689722150 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f15f410e8d0 msgr2=0x7f15f411c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:22.301 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.298+0000 7f15fbe92640 1 --2- 10.20.193.22:0/3689722150 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f15f410e8d0 0x7f15f411c810 crc :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.302 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.298+0000 7f15fbe92640 1 -- 10.20.193.22:0/3689722150 shutdown_connections 2026-02-24T07:20:22.302 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.298+0000 7f15fbe92640 1 --2- 10.20.193.22:0/3689722150 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f15d003f7f0 0x7f15d005fca0 unknown :-1 s=CLOSED pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.302 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.298+0000 7f15fbe92640 1 --2- 10.20.193.22:0/3689722150 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f15f410e8d0 0x7f15f411c810 unknown :-1 s=CLOSED pgs=85 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.302 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.298+0000 7f15fbe92640 1 -- 10.20.193.22:0/3689722150 >> 10.20.193.22:0/3689722150 conn(0x7f15f40ec060 msgr2=0x7f15f410c440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:22.302 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.298+0000 7f15fbe92640 1 -- 10.20.193.22:0/3689722150 shutdown_connections 2026-02-24T07:20:22.302 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.298+0000 7f15fbe92640 1 -- 10.20.193.22:0/3689722150 wait complete. 2026-02-24T07:20:22.339 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-24T07:20:22.339 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-24T07:20:22.458 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:22.566 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:22 trial022 ceph-mon[39108]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:22.567 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:22 trial022 ceph-mon[39108]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:22.567 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:22 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2948197673' entity='client.admin' 2026-02-24T07:20:22.567 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:22 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3689722150' entity='client.admin' 2026-02-24T07:20:22.591 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:22.591 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 -- 10.20.193.22:0/1687195264 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f80e010c430 msgr2=0x7f80e010c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:22.591 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 --2- 10.20.193.22:0/1687195264 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f80e010c430 0x7f80e010c820 crc :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=10276426331251251478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.591 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 -- 10.20.193.22:0/1687195264 shutdown_connections 2026-02-24T07:20:22.591 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 --2- 10.20.193.22:0/1687195264 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f80e010c430 0x7f80e010c820 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=10276426331251251478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.591 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 -- 10.20.193.22:0/1687195264 >> 10.20.193.22:0/1687195264 conn(0x7f80e00e9b80 msgr2=0x7f80e0109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:22.591 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 -- 10.20.193.22:0/1687195264 shutdown_connections 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 -- 10.20.193.22:0/1687195264 wait complete. 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 Processor -- start 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 -- start start 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f80e010c430 0x7f80e011a3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e6c6c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f80e011a910 con 0x7f80e010c430 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e5c6a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f80e010c430 0x7f80e011a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e5c6a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f80e010c430 0x7f80e011a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51718/0 (socket says 10.20.193.22:51718) 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.586+0000 7f80e5c6a640 1 -- 10.20.193.22:0/2706272311 learned_addr learned my addr 10.20.193.22:0/2706272311 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.587+0000 7f80e5c6a640 1 -- 10.20.193.22:0/2706272311 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e011aa50 con 0x7f80e010c430 2026-02-24T07:20:22.592 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.587+0000 7f80e5c6a640 1 --2- 10.20.193.22:0/2706272311 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f80e010c430 0x7f80e011a3b0 crc :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.587+0000 7f80ceffd640 1 -- 10.20.193.22:0/2706272311 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f80d000d690 con 0x7f80e010c430 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.587+0000 7f80e6c6c640 1 -- 10.20.193.22:0/2706272311 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e011aca0 con 0x7f80e010c430 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.587+0000 7f80ceffd640 1 -- 10.20.193.22:0/2706272311 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f80d000d7f0 con 0x7f80e010c430 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.587+0000 7f80ceffd640 1 -- 10.20.193.22:0/2706272311 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f80d000fd70 con 0x7f80e010c430 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.587+0000 7f80e6c6c640 1 -- 10.20.193.22:0/2706272311 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e011b610 con 0x7f80e010c430 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.587+0000 7f80e6c6c640 1 -- 10.20.193.22:0/2706272311 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e012fdf0 con 0x7f80e010c430 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.587+0000 7f80ceffd640 1 -- 10.20.193.22:0/2706272311 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 12) ==== 52827+0+0 (crc 0 0 0) 0x7f80d000f6b0 con 0x7f80e010c430 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.588+0000 7f80ceffd640 1 --2- 10.20.193.22:0/2706272311 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f80bc03f7f0 0x7f80bc05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.588+0000 7f80ceffd640 1 -- 10.20.193.22:0/2706272311 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7f80d0051ba0 con 0x7f80e010c430 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.588+0000 7f80e5469640 1 --2- 10.20.193.22:0/2706272311 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f80bc03f7f0 0x7f80bc05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:22.593 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.588+0000 7f80e5469640 1 --2- 10.20.193.22:0/2706272311 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f80bc03f7f0 0x7f80bc05fca0 crc :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:22.594 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.590+0000 7f80ceffd640 1 -- 10.20.193.22:0/2706272311 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f80d00071c0 con 0x7f80e010c430 2026-02-24T07:20:22.699 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.697+0000 7f80e6c6c640 1 -- 10.20.193.22:0/2706272311 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f80e011c390 con 0x7f80bc03f7f0 2026-02-24T07:20:22.702 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.699+0000 7f80ceffd640 1 -- 10.20.193.22:0/2706272311 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x7f80e011c390 con 0x7f80bc03f7f0 2026-02-24T07:20:22.704 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.701+0000 7f80e6c6c640 1 -- 10.20.193.22:0/2706272311 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f80bc03f7f0 msgr2=0x7f80bc05fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:22.704 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.701+0000 7f80e6c6c640 1 --2- 10.20.193.22:0/2706272311 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f80bc03f7f0 0x7f80bc05fca0 crc :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.704 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.701+0000 7f80e6c6c640 1 -- 10.20.193.22:0/2706272311 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f80e010c430 msgr2=0x7f80e011a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:22.704 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.701+0000 7f80e6c6c640 1 --2- 10.20.193.22:0/2706272311 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f80e010c430 0x7f80e011a3b0 crc :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.705 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.701+0000 7f80e6c6c640 1 -- 10.20.193.22:0/2706272311 shutdown_connections 2026-02-24T07:20:22.705 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.701+0000 7f80e6c6c640 1 --2- 10.20.193.22:0/2706272311 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f80bc03f7f0 0x7f80bc05fca0 unknown :-1 s=CLOSED pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.705 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.701+0000 7f80e6c6c640 1 --2- 10.20.193.22:0/2706272311 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f80e010c430 0x7f80e011a3b0 unknown :-1 s=CLOSED pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:22.705 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.701+0000 7f80e6c6c640 1 -- 10.20.193.22:0/2706272311 >> 10.20.193.22:0/2706272311 conn(0x7f80e00e9b80 msgr2=0x7f80e0109f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:22.705 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.701+0000 7f80e6c6c640 1 -- 10.20.193.22:0/2706272311 shutdown_connections 2026-02-24T07:20:22.705 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:22.701+0000 7f80e6c6c640 1 -- 10.20.193.22:0/2706272311 wait complete. 2026-02-24T07:20:22.741 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial195 2026-02-24T07:20:22.741 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:20:22.741 DEBUG:teuthology.orchestra.run.trial195:> dd of=/etc/ceph/ceph.conf 2026-02-24T07:20:22.760 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:20:22.760 DEBUG:teuthology.orchestra.run.trial195:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:20:22.816 INFO:tasks.cephadm:Adding host trial195 to orchestrator... 2026-02-24T07:20:22.817 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch host add trial195 2026-02-24T07:20:22.934 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:23.046 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.041+0000 7f06dfb08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:23.047 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 -- 10.20.193.22:0/2374237103 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f06d810e850 msgr2=0x7f06d810ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:23.047 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 --2- 10.20.193.22:0/2374237103 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f06d810e850 0x7f06d810ec40 crc :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=8712649231335261450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:23.047 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 -- 10.20.193.22:0/2374237103 shutdown_connections 2026-02-24T07:20:23.047 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 --2- 10.20.193.22:0/2374237103 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f06d810e850 0x7f06d810ec40 unknown :-1 s=CLOSED pgs=88 gs=1 cs=0 l=1 c_cookie=8712649231335261450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:23.047 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 -- 10.20.193.22:0/2374237103 >> 10.20.193.22:0/2374237103 conn(0x7f06d80ebf80 msgr2=0x7f06d810c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:23.047 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 -- 10.20.193.22:0/2374237103 shutdown_connections 2026-02-24T07:20:23.047 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 -- 10.20.193.22:0/2374237103 wait complete. 2026-02-24T07:20:23.047 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:23.047 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 Processor -- start 2026-02-24T07:20:23.047 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 -- start start 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f06d810e850 0x7f06d811c7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dfb08640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f06d811cd30 con 0x7f06d810e850 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dd87d640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f06d810e850 0x7f06d811c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dd87d640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f06d810e850 0x7f06d811c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51730/0 (socket says 10.20.193.22:51730) 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dd87d640 1 -- 10.20.193.22:0/3534941389 learned_addr learned my addr 10.20.193.22:0/3534941389 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.042+0000 7f06dd87d640 1 -- 10.20.193.22:0/3534941389 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d811ce70 con 0x7f06d810e850 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.043+0000 7f06dd87d640 1 --2- 10.20.193.22:0/3534941389 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f06d810e850 0x7f06d811c7d0 crc :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.043+0000 7f06c6ffd640 1 -- 10.20.193.22:0/3534941389 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f06c800d690 con 0x7f06d810e850 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.043+0000 7f06c6ffd640 1 -- 10.20.193.22:0/3534941389 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f06c800d7f0 con 0x7f06d810e850 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.043+0000 7f06dfb08640 1 -- 10.20.193.22:0/3534941389 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d811d0c0 con 0x7f06d810e850 2026-02-24T07:20:23.048 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.043+0000 7f06c6ffd640 1 -- 10.20.193.22:0/3534941389 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f06c800fd70 con 0x7f06d810e850 2026-02-24T07:20:23.049 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.043+0000 7f06dfb08640 1 -- 10.20.193.22:0/3534941389 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d811da30 con 0x7f06d810e850 2026-02-24T07:20:23.049 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.043+0000 7f06dfb08640 1 -- 10.20.193.22:0/3534941389 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d8132210 con 0x7f06d810e850 2026-02-24T07:20:23.049 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.043+0000 7f06c6ffd640 1 -- 10.20.193.22:0/3534941389 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 12) ==== 52827+0+0 (crc 0 0 0) 0x7f06c80026a0 con 0x7f06d810e850 2026-02-24T07:20:23.049 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.043+0000 7f06c6ffd640 1 --2- 10.20.193.22:0/3534941389 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f06b403f840 0x7f06b405fcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:23.049 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.044+0000 7f06c6ffd640 1 -- 10.20.193.22:0/3534941389 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7f06c8051ac0 con 0x7f06d810e850 2026-02-24T07:20:23.049 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.044+0000 7f06dd07c640 1 --2- 10.20.193.22:0/3534941389 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f06b403f840 0x7f06b405fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:23.049 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.044+0000 7f06dd07c640 1 --2- 10.20.193.22:0/3534941389 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f06b403f840 0x7f06b405fcf0 crc :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:23.049 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.046+0000 7f06c6ffd640 1 -- 10.20.193.22:0/3534941389 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f06c800f6b0 con 0x7f06d810e850 2026-02-24T07:20:23.155 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:23.153+0000 7f06dfb08640 1 -- 10.20.193.22:0/3534941389 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial195", "target": ["mon-mgr", ""]}) -- 0x7f06d811e7b0 con 0x7f06b403f840 2026-02-24T07:20:23.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:23 trial022 ceph-mon[39108]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:23.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:23 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:23.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:23 trial022 ceph-mon[39108]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial195", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:23.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:23 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:23.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:23 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:23.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:23 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial022", "name": "osd_memory_target"} : dispatch 2026-02-24T07:20:23.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:23 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:23.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:23 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:20:23.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:23 trial022 ceph-mon[39108]: Updating trial022:/etc/ceph/ceph.conf 2026-02-24T07:20:24.825 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.822+0000 7f06c6ffd640 1 -- 10.20.193.22:0/3534941389 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (crc 0 0 0) 0x7f06d811e7b0 con 0x7f06b403f840 2026-02-24T07:20:24.825 INFO:teuthology.orchestra.run.trial022.stdout:Added host 'trial195' with addr '10.20.193.195' 2026-02-24T07:20:24.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.827+0000 7f06dfb08640 1 -- 10.20.193.22:0/3534941389 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f06b403f840 msgr2=0x7f06b405fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:24.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.827+0000 7f06dfb08640 1 --2- 10.20.193.22:0/3534941389 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f06b403f840 0x7f06b405fcf0 crc :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:24.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.827+0000 7f06dfb08640 1 -- 10.20.193.22:0/3534941389 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f06d810e850 msgr2=0x7f06d811c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:24.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.827+0000 7f06dfb08640 1 --2- 10.20.193.22:0/3534941389 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f06d810e850 0x7f06d811c7d0 crc :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:24.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.827+0000 7f06dfb08640 1 -- 10.20.193.22:0/3534941389 shutdown_connections 2026-02-24T07:20:24.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.827+0000 7f06dfb08640 1 --2- 10.20.193.22:0/3534941389 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f06b403f840 0x7f06b405fcf0 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:24.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.827+0000 7f06dfb08640 1 --2- 10.20.193.22:0/3534941389 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f06d810e850 0x7f06d811c7d0 unknown :-1 s=CLOSED pgs=89 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:24.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.827+0000 7f06dfb08640 1 -- 10.20.193.22:0/3534941389 >> 10.20.193.22:0/3534941389 conn(0x7f06d80ebf80 msgr2=0x7f06d810c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:24.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.827+0000 7f06dfb08640 1 -- 10.20.193.22:0/3534941389 shutdown_connections 2026-02-24T07:20:24.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:24.827+0000 7f06dfb08640 1 -- 10.20.193.22:0/3534941389 wait complete. 2026-02-24T07:20:24.868 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-24T07:20:24.984 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:25.086 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:25.086 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 1 -- 10.20.193.22:0/1838181412 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fceb0060740 msgr2=0x7fceb0060b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:25.086 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 1 --2- 10.20.193.22:0/1838181412 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fceb0060740 0x7fceb0060b10 crc :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=16714203601969057633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:25.086 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 1 -- 10.20.193.22:0/1838181412 shutdown_connections 2026-02-24T07:20:25.086 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 1 --2- 10.20.193.22:0/1838181412 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fceb0060740 0x7fceb0060b10 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=16714203601969057633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:25.087 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 1 -- 10.20.193.22:0/1838181412 >> 10.20.193.22:0/1838181412 conn(0x7fceb00ea1e0 msgr2=0x7fceb010a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:25.087 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 1 -- 10.20.193.22:0/1838181412 shutdown_connections 2026-02-24T07:20:25.087 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 1 -- 10.20.193.22:0/1838181412 wait complete. 2026-02-24T07:20:25.087 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:25.087 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: Updating trial022:/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:20:25.087 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: Deploying cephadm binary to trial195 2026-02-24T07:20:25.087 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: Updating trial022:/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: Updating trial022:/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: Certificate for "cephadm-signed_agent_cert (trial022)" is still valid for 1824 days. 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:25.088 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:24 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:25.091 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 1 Processor -- start 2026-02-24T07:20:25.091 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.083+0000 7fceb7bb7640 1 -- start start 2026-02-24T07:20:25.091 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fceb7bb7640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fceb0060740 0x7fceb00f05d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:25.091 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fceb7bb7640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fceb00f0b10 con 0x7fceb0060740 2026-02-24T07:20:25.091 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fceb592c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fceb0060740 0x7fceb00f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:25.091 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fceb592c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fceb0060740 0x7fceb00f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51758/0 (socket says 10.20.193.22:51758) 2026-02-24T07:20:25.091 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fceb592c640 1 -- 10.20.193.22:0/4121039069 learned_addr learned my addr 10.20.193.22:0/4121039069 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fceb592c640 1 -- 10.20.193.22:0/4121039069 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb00f0c50 con 0x7fceb0060740 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fceb592c640 1 --2- 10.20.193.22:0/4121039069 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fceb0060740 0x7fceb00f05d0 crc :-1 s=READY pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fce9effd640 1 -- 10.20.193.22:0/4121039069 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fcea000d690 con 0x7fceb0060740 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fceb7bb7640 1 -- 10.20.193.22:0/4121039069 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb00f0ea0 con 0x7fceb0060740 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fce9effd640 1 -- 10.20.193.22:0/4121039069 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fcea000d7f0 con 0x7fceb0060740 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fce9effd640 1 -- 10.20.193.22:0/4121039069 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fcea000fd70 con 0x7fceb0060740 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.084+0000 7fceb7bb7640 1 -- 10.20.193.22:0/4121039069 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb00f5c80 con 0x7fceb0060740 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.085+0000 7fceb7bb7640 1 -- 10.20.193.22:0/4121039069 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb0055fb0 con 0x7fceb0060740 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.085+0000 7fce9effd640 1 -- 10.20.193.22:0/4121039069 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 12) ==== 52827+0+0 (crc 0 0 0) 0x7fcea000e5c0 con 0x7fceb0060740 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.085+0000 7fce9effd640 1 --2- 10.20.193.22:0/4121039069 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fce8c03f7f0 0x7fce8c05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.085+0000 7fce9effd640 1 -- 10.20.193.22:0/4121039069 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7fcea0051c70 con 0x7fceb0060740 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.085+0000 7fceb512b640 1 --2- 10.20.193.22:0/4121039069 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fce8c03f7f0 0x7fce8c05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:25.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.085+0000 7fceb512b640 1 --2- 10.20.193.22:0/4121039069 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fce8c03f7f0 0x7fce8c05fca0 crc :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:25.093 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.087+0000 7fce9effd640 1 -- 10.20.193.22:0/4121039069 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fcea0015b00 con 0x7fceb0060740 2026-02-24T07:20:25.143 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.141+0000 7fce9effd640 1 -- 10.20.193.22:0/4121039069 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7fcea000f6b0 con 0x7fceb0060740 2026-02-24T07:20:25.200 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.197+0000 7fceb7bb7640 1 -- 10.20.193.22:0/4121039069 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fceb0137100 con 0x7fce8c03f7f0 2026-02-24T07:20:25.200 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.198+0000 7fce9effd640 1 -- 10.20.193.22:0/4121039069 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (crc 0 0 0) 0x7fceb0137100 con 0x7fce8c03f7f0 2026-02-24T07:20:25.201 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:25.201 INFO:teuthology.orchestra.run.trial022.stdout:[{"addr": "10.20.193.22", "hostname": "trial022", "labels": [], "status": ""}, {"addr": "10.20.193.195", "hostname": "trial195", "labels": [], "status": ""}] 2026-02-24T07:20:25.202 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.199+0000 7fceb7bb7640 1 -- 10.20.193.22:0/4121039069 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fce8c03f7f0 msgr2=0x7fce8c05fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:25.202 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.199+0000 7fceb7bb7640 1 --2- 10.20.193.22:0/4121039069 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fce8c03f7f0 0x7fce8c05fca0 crc :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:25.202 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.199+0000 7fceb7bb7640 1 -- 10.20.193.22:0/4121039069 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fceb0060740 msgr2=0x7fceb00f05d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:25.202 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.199+0000 7fceb7bb7640 1 --2- 10.20.193.22:0/4121039069 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fceb0060740 0x7fceb00f05d0 crc :-1 s=READY pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:25.202 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.199+0000 7fceb7bb7640 1 -- 10.20.193.22:0/4121039069 shutdown_connections 2026-02-24T07:20:25.203 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.199+0000 7fceb7bb7640 1 --2- 10.20.193.22:0/4121039069 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fce8c03f7f0 0x7fce8c05fca0 unknown :-1 s=CLOSED pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:25.203 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.199+0000 7fceb7bb7640 1 --2- 10.20.193.22:0/4121039069 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fceb0060740 0x7fceb00f05d0 unknown :-1 s=CLOSED pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:25.203 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.199+0000 7fceb7bb7640 1 -- 10.20.193.22:0/4121039069 >> 10.20.193.22:0/4121039069 conn(0x7fceb00ea1e0 msgr2=0x7fceb0130ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:25.203 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.199+0000 7fceb7bb7640 1 -- 10.20.193.22:0/4121039069 shutdown_connections 2026-02-24T07:20:25.203 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.199+0000 7fceb7bb7640 1 -- 10.20.193.22:0/4121039069 wait complete. 2026-02-24T07:20:25.238 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-24T07:20:25.239 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd crush tunables default 2026-02-24T07:20:25.356 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:25.455 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.450+0000 7f01962fe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:25.455 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.450+0000 7f01962fe640 1 -- 10.20.193.22:0/2603082929 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0190115770 msgr2=0x7f0190115b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:25.455 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.450+0000 7f01962fe640 1 --2- 10.20.193.22:0/2603082929 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0190115770 0x7f0190115b40 crc :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=6031210468428031103 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.450+0000 7f01962fe640 1 -- 10.20.193.22:0/2603082929 shutdown_connections 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.450+0000 7f01962fe640 1 --2- 10.20.193.22:0/2603082929 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0190115770 0x7f0190115b40 unknown :-1 s=CLOSED pgs=92 gs=1 cs=0 l=1 c_cookie=6031210468428031103 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.450+0000 7f01962fe640 1 -- 10.20.193.22:0/2603082929 >> 10.20.193.22:0/2603082929 conn(0x7f019005de90 msgr2=0x7f019005e290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.450+0000 7f01962fe640 1 -- 10.20.193.22:0/2603082929 shutdown_connections 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.450+0000 7f01962fe640 1 -- 10.20.193.22:0/2603082929 wait complete. 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.450+0000 7f01962fe640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f01962fe640 1 Processor -- start 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f01962fe640 1 -- start start 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f01962fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0190115770 0x7f01900f7640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f01962fe640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01900f7b80 con 0x7f0190115770 2026-02-24T07:20:25.456 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f018ffff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0190115770 0x7f01900f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f018ffff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0190115770 0x7f01900f7640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51776/0 (socket says 10.20.193.22:51776) 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f018ffff640 1 -- 10.20.193.22:0/2148814749 learned_addr learned my addr 10.20.193.22:0/2148814749 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f018ffff640 1 -- 10.20.193.22:0/2148814749 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01900f7cc0 con 0x7f0190115770 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f018ffff640 1 --2- 10.20.193.22:0/2148814749 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0190115770 0x7f01900f7640 crc :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f018d7fa640 1 -- 10.20.193.22:0/2148814749 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f017c00d690 con 0x7f0190115770 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f01962fe640 1 -- 10.20.193.22:0/2148814749 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01900f7f10 con 0x7f0190115770 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f018d7fa640 1 -- 10.20.193.22:0/2148814749 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f017c00d7f0 con 0x7f0190115770 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f018d7fa640 1 -- 10.20.193.22:0/2148814749 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f017c00fd70 con 0x7f0190115770 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.451+0000 7f01962fe640 1 -- 10.20.193.22:0/2148814749 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01900fcd40 con 0x7f0190115770 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.452+0000 7f01962fe640 1 -- 10.20.193.22:0/2148814749 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0190116a50 con 0x7f0190115770 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.452+0000 7f018d7fa640 1 -- 10.20.193.22:0/2148814749 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7f017c00e5c0 con 0x7f0190115770 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.452+0000 7f018d7fa640 1 --2- 10.20.193.22:0/2148814749 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f016403f890 0x7f016405fd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:25.457 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.452+0000 7f018d7fa640 1 -- 10.20.193.22:0/2148814749 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1150+0+0 (crc 0 0 0) 0x7f017c051d50 con 0x7f0190115770 2026-02-24T07:20:25.458 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.452+0000 7f018f7fe640 1 --2- 10.20.193.22:0/2148814749 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f016403f890 0x7f016405fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:25.458 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.452+0000 7f018f7fe640 1 --2- 10.20.193.22:0/2148814749 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f016403f890 0x7f016405fd40 crc :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:25.458 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.454+0000 7f018d7fa640 1 -- 10.20.193.22:0/2148814749 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f017c015b00 con 0x7f0190115770 2026-02-24T07:20:25.564 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:25.561+0000 7f01962fe640 1 -- 10.20.193.22:0/2148814749 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0190059c40 con 0x7f0190115770 2026-02-24T07:20:26.143 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.141+0000 7f018d7fa640 1 -- 10.20.193.22:0/2148814749 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (crc 0 0 0) 0x7f017c007e60 con 0x7f0190115770 2026-02-24T07:20:26.143 INFO:teuthology.orchestra.run.trial022.stderr:adjusted tunables profile to default 2026-02-24T07:20:26.146 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.143+0000 7f01962fe640 1 -- 10.20.193.22:0/2148814749 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f016403f890 msgr2=0x7f016405fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:26.146 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.143+0000 7f01962fe640 1 --2- 10.20.193.22:0/2148814749 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f016403f890 0x7f016405fd40 crc :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.146 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.143+0000 7f01962fe640 1 -- 10.20.193.22:0/2148814749 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0190115770 msgr2=0x7f01900f7640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:26.146 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.143+0000 7f01962fe640 1 --2- 10.20.193.22:0/2148814749 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0190115770 0x7f01900f7640 crc :-1 s=READY pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.146 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.143+0000 7f01962fe640 1 -- 10.20.193.22:0/2148814749 shutdown_connections 2026-02-24T07:20:26.146 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.143+0000 7f01962fe640 1 --2- 10.20.193.22:0/2148814749 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f016403f890 0x7f016405fd40 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.146 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.143+0000 7f01962fe640 1 --2- 10.20.193.22:0/2148814749 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0190115770 0x7f01900f7640 unknown :-1 s=CLOSED pgs=93 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.146 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.143+0000 7f01962fe640 1 -- 10.20.193.22:0/2148814749 >> 10.20.193.22:0/2148814749 conn(0x7f019005de90 msgr2=0x7f01901197b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:26.146 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.143+0000 7f01962fe640 1 -- 10.20.193.22:0/2148814749 shutdown_connections 2026-02-24T07:20:26.146 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:26.143+0000 7f01962fe640 1 -- 10.20.193.22:0/2148814749 wait complete. 2026-02-24T07:20:26.183 INFO:tasks.cephadm:Adding mon.a on trial022 2026-02-24T07:20:26.183 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch apply mon '1;trial022:10.20.193.22=a' 2026-02-24T07:20:26.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:25 trial022 ceph-mon[39108]: Added host trial195 2026-02-24T07:20:26.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:25 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:26.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:25 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:26.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:25 trial022 ceph-mon[39108]: mgrmap e13: x(active, since 6s) 2026-02-24T07:20:26.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:25 trial022 ceph-mon[39108]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:20:26.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:25 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2148814749' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-24T07:20:26.326 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T07:20:26.326 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b1ffff640 1 -- 10.20.193.195:0/4140249707 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0b2000dbe0 con 0x7f0b3010cdb0 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 -- 10.20.193.195:0/4140249707 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0b3010cdb0 msgr2=0x7f0b3010d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 --2- 10.20.193.195:0/4140249707 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0b3010cdb0 0x7f0b3010d1a0 crc :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=7152679684082699761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 -- 10.20.193.195:0/4140249707 shutdown_connections 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 --2- 10.20.193.195:0/4140249707 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0b3010cdb0 0x7f0b3010d1a0 unknown :-1 s=CLOSED pgs=94 gs=1 cs=0 l=1 c_cookie=7152679684082699761 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 -- 10.20.193.195:0/4140249707 >> 10.20.193.195:0/4140249707 conn(0x7f0b300e8740 msgr2=0x7f0b30108b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 -- 10.20.193.195:0/4140249707 shutdown_connections 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 -- 10.20.193.195:0/4140249707 wait complete. 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 Processor -- start 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 -- start start 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0b3010cdb0 0x7f0b3011df10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.454+0000 7f0b37537640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3011e470 con 0x7f0b3010cdb0 2026-02-24T07:20:26.453 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.455+0000 7f0b352ac640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0b3010cdb0 0x7f0b3011df10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:26.454 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.455+0000 7f0b352ac640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0b3010cdb0 0x7f0b3011df10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.195:55306/0 (socket says 10.20.193.195:55306) 2026-02-24T07:20:26.454 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.455+0000 7f0b352ac640 1 -- 10.20.193.195:0/1600390231 learned_addr learned my addr 10.20.193.195:0/1600390231 (peer_addr_for_me v2:10.20.193.195:0/0) 2026-02-24T07:20:26.454 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.455+0000 7f0b352ac640 1 -- 10.20.193.195:0/1600390231 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3011e5b0 con 0x7f0b3010cdb0 2026-02-24T07:20:26.454 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.455+0000 7f0b352ac640 1 --2- 10.20.193.195:0/1600390231 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0b3010cdb0 0x7f0b3011df10 crc :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:26.454 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.455+0000 7f0b1e7fc640 1 -- 10.20.193.195:0/1600390231 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0b2000d690 con 0x7f0b3010cdb0 2026-02-24T07:20:26.454 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.455+0000 7f0b37537640 1 -- 10.20.193.195:0/1600390231 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3011e800 con 0x7f0b3010cdb0 2026-02-24T07:20:26.454 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.455+0000 7f0b1e7fc640 1 -- 10.20.193.195:0/1600390231 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f0b2000d7f0 con 0x7f0b3010cdb0 2026-02-24T07:20:26.454 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.455+0000 7f0b1e7fc640 1 -- 10.20.193.195:0/1600390231 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0b2000fd70 con 0x7f0b3010cdb0 2026-02-24T07:20:26.454 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.455+0000 7f0b37537640 1 -- 10.20.193.195:0/1600390231 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3011f170 con 0x7f0b3010cdb0 2026-02-24T07:20:26.454 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.456+0000 7f0b37537640 1 -- 10.20.193.195:0/1600390231 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b3005f4b0 con 0x7f0b3010cdb0 2026-02-24T07:20:26.455 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.456+0000 7f0b1e7fc640 1 -- 10.20.193.195:0/1600390231 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7f0b2000f6b0 con 0x7f0b3010cdb0 2026-02-24T07:20:26.455 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.456+0000 7f0b1e7fc640 1 --2- 10.20.193.195:0/1600390231 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0b0c03f8e0 0x7f0b0c05fd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:26.455 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.456+0000 7f0b1e7fc640 1 -- 10.20.193.195:0/1600390231 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (crc 0 0 0) 0x7f0b20051ae0 con 0x7f0b3010cdb0 2026-02-24T07:20:26.455 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.457+0000 7f0b34aab640 1 --2- 10.20.193.195:0/1600390231 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0b0c03f8e0 0x7f0b0c05fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:26.455 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.457+0000 7f0b34aab640 1 --2- 10.20.193.195:0/1600390231 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0b0c03f8e0 0x7f0b0c05fd90 crc :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:26.457 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.459+0000 7f0b1e7fc640 1 -- 10.20.193.195:0/1600390231 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f0b200071c0 con 0x7f0b3010cdb0 2026-02-24T07:20:26.567 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.569+0000 7f0b37537640 1 -- 10.20.193.195:0/1600390231 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "1;trial022:10.20.193.22=a", "target": ["mon-mgr", ""]}) -- 0x7f0b30132f50 con 0x7f0b0c03f8e0 2026-02-24T07:20:26.573 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.575+0000 7f0b1e7fc640 1 -- 10.20.193.195:0/1600390231 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (crc 0 0 0) 0x7f0b30132f50 con 0x7f0b0c03f8e0 2026-02-24T07:20:26.573 INFO:teuthology.orchestra.run.trial195.stdout:Scheduled mon update... 2026-02-24T07:20:26.575 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.576+0000 7f0b37537640 1 -- 10.20.193.195:0/1600390231 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0b0c03f8e0 msgr2=0x7f0b0c05fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:26.575 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.576+0000 7f0b37537640 1 --2- 10.20.193.195:0/1600390231 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0b0c03f8e0 0x7f0b0c05fd90 crc :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.575 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.576+0000 7f0b37537640 1 -- 10.20.193.195:0/1600390231 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0b3010cdb0 msgr2=0x7f0b3011df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:26.575 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.576+0000 7f0b37537640 1 --2- 10.20.193.195:0/1600390231 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0b3010cdb0 0x7f0b3011df10 crc :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.575 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.576+0000 7f0b37537640 1 -- 10.20.193.195:0/1600390231 shutdown_connections 2026-02-24T07:20:26.575 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.576+0000 7f0b37537640 1 --2- 10.20.193.195:0/1600390231 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0b0c03f8e0 0x7f0b0c05fd90 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.575 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.576+0000 7f0b37537640 1 --2- 10.20.193.195:0/1600390231 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0b3010cdb0 0x7f0b3011df10 unknown :-1 s=CLOSED pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.575 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.576+0000 7f0b37537640 1 -- 10.20.193.195:0/1600390231 >> 10.20.193.195:0/1600390231 conn(0x7f0b300e8740 msgr2=0x7f0b30108b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:26.575 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.576+0000 7f0b37537640 1 -- 10.20.193.195:0/1600390231 shutdown_connections 2026-02-24T07:20:26.575 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.576+0000 7f0b37537640 1 -- 10.20.193.195:0/1600390231 wait complete. 2026-02-24T07:20:26.628 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-02-24T07:20:26.628 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph mon dump -f json 2026-02-24T07:20:26.745 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T07:20:26.745 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-24T07:20:26.861 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:26.861 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 -- 10.20.193.195:0/3007574752 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9a0c10e830 msgr2=0x7f9a0c10ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:26.861 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 --2- 10.20.193.195:0/3007574752 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9a0c10e830 0x7f9a0c10ec20 crc :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=3048056550577623845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.861 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 -- 10.20.193.195:0/3007574752 shutdown_connections 2026-02-24T07:20:26.861 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 --2- 10.20.193.195:0/3007574752 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9a0c10e830 0x7f9a0c10ec20 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=3048056550577623845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:26.861 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 -- 10.20.193.195:0/3007574752 >> 10.20.193.195:0/3007574752 conn(0x7f9a0c0ebf80 msgr2=0x7f9a0c10c390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 -- 10.20.193.195:0/3007574752 shutdown_connections 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 -- 10.20.193.195:0/3007574752 wait complete. 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 Processor -- start 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 -- start start 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9a0c10e830 0x7f9a0c11c720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a13936640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c11cc80 con 0x7f9a0c10e830 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a116ab640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9a0c10e830 0x7f9a0c11c720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a116ab640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9a0c10e830 0x7f9a0c11c720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.195:55320/0 (socket says 10.20.193.195:55320) 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.860+0000 7f9a116ab640 1 -- 10.20.193.195:0/2586127164 learned_addr learned my addr 10.20.193.195:0/2586127164 (peer_addr_for_me v2:10.20.193.195:0/0) 2026-02-24T07:20:26.862 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.861+0000 7f9a116ab640 1 -- 10.20.193.195:0/2586127164 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c11cdc0 con 0x7f9a0c10e830 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.861+0000 7f9a116ab640 1 --2- 10.20.193.195:0/2586127164 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9a0c10e830 0x7f9a0c11c720 crc :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.861+0000 7f99fa7fc640 1 -- 10.20.193.195:0/2586127164 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f99fc00d690 con 0x7f9a0c10e830 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.861+0000 7f9a13936640 1 -- 10.20.193.195:0/2586127164 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0c11d010 con 0x7f9a0c10e830 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.861+0000 7f99fa7fc640 1 -- 10.20.193.195:0/2586127164 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f99fc00d7f0 con 0x7f9a0c10e830 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.861+0000 7f9a13936640 1 -- 10.20.193.195:0/2586127164 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0c11d980 con 0x7f9a0c10e830 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.861+0000 7f99fa7fc640 1 -- 10.20.193.195:0/2586127164 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f99fc016040 con 0x7f9a0c10e830 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.861+0000 7f9a13936640 1 -- 10.20.193.195:0/2586127164 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0c1321f0 con 0x7f9a0c10e830 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.862+0000 7f99fa7fc640 1 -- 10.20.193.195:0/2586127164 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7f99fc0026a0 con 0x7f9a0c10e830 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.862+0000 7f99fa7fc640 1 --2- 10.20.193.195:0/2586127164 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f99e803f890 0x7f99e805fd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.862+0000 7f99fa7fc640 1 -- 10.20.193.195:0/2586127164 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (crc 0 0 0) 0x7f99fc051aa0 con 0x7f9a0c10e830 2026-02-24T07:20:26.863 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.862+0000 7f9a10eaa640 1 --2- 10.20.193.195:0/2586127164 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f99e803f890 0x7f99e805fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:26.864 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.863+0000 7f9a10eaa640 1 --2- 10.20.193.195:0/2586127164 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f99e803f890 0x7f99e805fd40 crc :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:26.864 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:26.864+0000 7f99fa7fc640 1 -- 10.20.193.195:0/2586127164 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f99fc00f610 con 0x7f9a0c10e830 2026-02-24T07:20:27.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.009+0000 7f9a13936640 1 -- 10.20.193.195:0/2586127164 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9a0c11e5d0 con 0x7f9a0c10e830 2026-02-24T07:20:27.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.010+0000 7f99fa7fc640 1 -- 10.20.193.195:0/2586127164 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+821 (crc 0 0 0) 0x7f99fc015130 con 0x7f9a0c10e830 2026-02-24T07:20:27.009 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:20:27.010 INFO:teuthology.orchestra.run.trial195.stdout:{"epoch":1,"fsid":"30400272-1151-11f1-be09-d404e6e7d460","modified":"2026-02-24T07:19:57.637230Z","created":"2026-02-24T07:19:57.637230Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:3300","nonce":0},{"type":"v1","addr":"10.20.193.22:6789","nonce":0}]},"addr":"10.20.193.22:6789/0","public_addr":"10.20.193.22:6789/0","priority":0,"weight":0,"time_added":"2026-02-24T07:19:57:637244+0000","crush_location":[]}],"quorum":[0]} 2026-02-24T07:20:27.010 INFO:teuthology.orchestra.run.trial195.stderr:dumped monmap epoch 1 2026-02-24T07:20:27.011 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.011+0000 7f9a13936640 1 -- 10.20.193.195:0/2586127164 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f99e803f890 msgr2=0x7f99e805fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:27.011 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.011+0000 7f9a13936640 1 --2- 10.20.193.195:0/2586127164 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f99e803f890 0x7f99e805fd40 crc :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.011 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.011+0000 7f9a13936640 1 -- 10.20.193.195:0/2586127164 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9a0c10e830 msgr2=0x7f9a0c11c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:27.011 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.011+0000 7f9a13936640 1 --2- 10.20.193.195:0/2586127164 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9a0c10e830 0x7f9a0c11c720 crc :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.011 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.011+0000 7f9a13936640 1 -- 10.20.193.195:0/2586127164 shutdown_connections 2026-02-24T07:20:27.011 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.011+0000 7f9a13936640 1 --2- 10.20.193.195:0/2586127164 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f99e803f890 0x7f99e805fd40 unknown :-1 s=CLOSED pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.011 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.011+0000 7f9a13936640 1 --2- 10.20.193.195:0/2586127164 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9a0c10e830 0x7f9a0c11c720 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.011 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.011+0000 7f9a13936640 1 -- 10.20.193.195:0/2586127164 >> 10.20.193.195:0/2586127164 conn(0x7f9a0c0ebf80 msgr2=0x7f9a0c10c360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:27.011 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.011+0000 7f9a13936640 1 -- 10.20.193.195:0/2586127164 shutdown_connections 2026-02-24T07:20:27.011 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.011+0000 7f9a13936640 1 -- 10.20.193.195:0/2586127164 wait complete. 2026-02-24T07:20:27.050 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-24T07:20:27.050 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-24T07:20:27.170 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:27.274 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:27.275 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 -- 10.20.193.22:0/2976744963 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c2810eb90 msgr2=0x7f8c2810ef60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:27.275 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 --2- 10.20.193.22:0/2976744963 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c2810eb90 0x7f8c2810ef60 crc :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=16728863062837274527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.275 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 -- 10.20.193.22:0/2976744963 shutdown_connections 2026-02-24T07:20:27.275 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 --2- 10.20.193.22:0/2976744963 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c2810eb90 0x7f8c2810ef60 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=16728863062837274527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.275 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 -- 10.20.193.22:0/2976744963 >> 10.20.193.22:0/2976744963 conn(0x7f8c280ec460 msgr2=0x7f8c2810c870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:27.275 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 -- 10.20.193.22:0/2976744963 shutdown_connections 2026-02-24T07:20:27.275 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 -- 10.20.193.22:0/2976744963 wait complete. 2026-02-24T07:20:27.275 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:27.275 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 Processor -- start 2026-02-24T07:20:27.275 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 -- start start 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c2810eb90 0x7f8c280f2880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2f050640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8c280f2dc0 con 0x7f8c2810eb90 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2cdc5640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c2810eb90 0x7f8c280f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2cdc5640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c2810eb90 0x7f8c280f2880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51800/0 (socket says 10.20.193.22:51800) 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2cdc5640 1 -- 10.20.193.22:0/1654361513 learned_addr learned my addr 10.20.193.22:0/1654361513 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.270+0000 7f8c2cdc5640 1 -- 10.20.193.22:0/1654361513 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c280f2f00 con 0x7f8c2810eb90 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.271+0000 7f8c2cdc5640 1 --2- 10.20.193.22:0/1654361513 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c2810eb90 0x7f8c280f2880 crc :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.271+0000 7f8c1dffb640 1 -- 10.20.193.22:0/1654361513 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f8c1800d690 con 0x7f8c2810eb90 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.271+0000 7f8c1dffb640 1 -- 10.20.193.22:0/1654361513 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f8c1800d7f0 con 0x7f8c2810eb90 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.271+0000 7f8c2f050640 1 -- 10.20.193.22:0/1654361513 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c280f3150 con 0x7f8c2810eb90 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.271+0000 7f8c1dffb640 1 -- 10.20.193.22:0/1654361513 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f8c1800fd70 con 0x7f8c2810eb90 2026-02-24T07:20:27.276 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.271+0000 7f8c2f050640 1 -- 10.20.193.22:0/1654361513 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c280f7f80 con 0x7f8c2810eb90 2026-02-24T07:20:27.277 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.271+0000 7f8c2f050640 1 -- 10.20.193.22:0/1654361513 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c28113670 con 0x7f8c2810eb90 2026-02-24T07:20:27.277 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.271+0000 7f8c1dffb640 1 -- 10.20.193.22:0/1654361513 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7f8c1800f6b0 con 0x7f8c2810eb90 2026-02-24T07:20:27.277 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.272+0000 7f8c1dffb640 1 --2- 10.20.193.22:0/1654361513 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c0403f8e0 0x7f8c0405fd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:27.277 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.272+0000 7f8c1dffb640 1 -- 10.20.193.22:0/1654361513 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (crc 0 0 0) 0x7f8c18051b50 con 0x7f8c2810eb90 2026-02-24T07:20:27.277 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.272+0000 7f8c1ffff640 1 --2- 10.20.193.22:0/1654361513 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c0403f8e0 0x7f8c0405fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:27.277 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.272+0000 7f8c1ffff640 1 --2- 10.20.193.22:0/1654361513 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c0403f8e0 0x7f8c0405fd90 crc :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:27.277 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.274+0000 7f8c1dffb640 1 -- 10.20.193.22:0/1654361513 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f8c180071c0 con 0x7f8c2810eb90 2026-02-24T07:20:27.381 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.378+0000 7f8c2f050640 1 -- 10.20.193.22:0/1654361513 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f8c2810fe70 con 0x7f8c2810eb90 2026-02-24T07:20:27.382 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:27 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:27.382 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:27 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2148814749' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-24T07:20:27.382 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:27 trial022 ceph-mon[39108]: osdmap e4: 0 total, 0 up, 0 in 2026-02-24T07:20:27.382 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:27 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:27.382 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:27 trial022 ceph-mon[39108]: from='client.? 10.20.193.195:0/2586127164' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-24T07:20:27.383 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.379+0000 7f8c1dffb640 1 -- 10.20.193.22:0/1654361513 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+175 (crc 0 0 0) 0x7f8c180071c0 con 0x7f8c2810eb90 2026-02-24T07:20:27.383 INFO:teuthology.orchestra.run.trial022.stdout:# minimal ceph.conf for 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:20:27.383 INFO:teuthology.orchestra.run.trial022.stdout:[global] 2026-02-24T07:20:27.383 INFO:teuthology.orchestra.run.trial022.stdout: fsid = 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:20:27.383 INFO:teuthology.orchestra.run.trial022.stdout: mon_host = [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] 2026-02-24T07:20:27.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.380+0000 7f8c2f050640 1 -- 10.20.193.22:0/1654361513 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c0403f8e0 msgr2=0x7f8c0405fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:27.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.380+0000 7f8c2f050640 1 --2- 10.20.193.22:0/1654361513 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c0403f8e0 0x7f8c0405fd90 crc :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.380+0000 7f8c2f050640 1 -- 10.20.193.22:0/1654361513 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c2810eb90 msgr2=0x7f8c280f2880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:27.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.380+0000 7f8c2f050640 1 --2- 10.20.193.22:0/1654361513 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c2810eb90 0x7f8c280f2880 crc :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.380+0000 7f8c2f050640 1 -- 10.20.193.22:0/1654361513 shutdown_connections 2026-02-24T07:20:27.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.380+0000 7f8c2f050640 1 --2- 10.20.193.22:0/1654361513 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c0403f8e0 0x7f8c0405fd90 unknown :-1 s=CLOSED pgs=20 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.380+0000 7f8c2f050640 1 --2- 10.20.193.22:0/1654361513 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c2810eb90 0x7f8c280f2880 unknown :-1 s=CLOSED pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.380+0000 7f8c2f050640 1 -- 10.20.193.22:0/1654361513 >> 10.20.193.22:0/1654361513 conn(0x7f8c280ec460 msgr2=0x7f8c28139be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:27.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.380+0000 7f8c2f050640 1 -- 10.20.193.22:0/1654361513 shutdown_connections 2026-02-24T07:20:27.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:27.380+0000 7f8c2f050640 1 -- 10.20.193.22:0/1654361513 wait complete. 2026-02-24T07:20:27.431 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-24T07:20:27.431 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:20:27.431 DEBUG:teuthology.orchestra.run.trial022:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T07:20:27.457 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:20:27.457 DEBUG:teuthology.orchestra.run.trial022:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:20:27.522 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:20:27.522 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/etc/ceph/ceph.conf 2026-02-24T07:20:27.550 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:20:27.550 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:20:27.615 INFO:tasks.cephadm:Adding mgr.x on trial022 2026-02-24T07:20:27.616 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch apply mgr '1;trial022=x' 2026-02-24T07:20:27.769 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:20:27.887 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.886+0000 7f8c4d21c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:27.887 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.886+0000 7f8c4d21c640 1 -- 10.20.193.195:0/1779875328 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c4810e850 msgr2=0x7f8c4810ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:27.887 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.886+0000 7f8c4d21c640 1 --2- 10.20.193.195:0/1779875328 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c4810e850 0x7f8c4810ec40 crc :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=2180349298672788431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.886+0000 7f8c4d21c640 1 -- 10.20.193.195:0/1779875328 shutdown_connections 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.886+0000 7f8c4d21c640 1 --2- 10.20.193.195:0/1779875328 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c4810e850 0x7f8c4810ec40 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=2180349298672788431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.886+0000 7f8c4d21c640 1 -- 10.20.193.195:0/1779875328 >> 10.20.193.195:0/1779875328 conn(0x7f8c480ebf80 msgr2=0x7f8c4810c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.886+0000 7f8c4d21c640 1 -- 10.20.193.195:0/1779875328 shutdown_connections 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.886+0000 7f8c4d21c640 1 -- 10.20.193.195:0/1779875328 wait complete. 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c4d21c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c4d21c640 1 Processor -- start 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c4d21c640 1 -- start start 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c4d21c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c4810e850 0x7f8c4811c7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c4d21c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4811cd30 con 0x7f8c4810e850 2026-02-24T07:20:27.888 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c46d76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c4810e850 0x7f8c4811c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:27.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c46d76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c4810e850 0x7f8c4811c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.195:55338/0 (socket says 10.20.193.195:55338) 2026-02-24T07:20:27.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c46d76640 1 -- 10.20.193.195:0/363396769 learned_addr learned my addr 10.20.193.195:0/363396769 (peer_addr_for_me v2:10.20.193.195:0/0) 2026-02-24T07:20:27.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c46d76640 1 -- 10.20.193.195:0/363396769 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4811ce70 con 0x7f8c4810e850 2026-02-24T07:20:27.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c46d76640 1 --2- 10.20.193.195:0/363396769 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c4810e850 0x7f8c4811c7d0 crc :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:27.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.887+0000 7f8c27fff640 1 -- 10.20.193.195:0/363396769 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f8c3c00d690 con 0x7f8c4810e850 2026-02-24T07:20:27.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.888+0000 7f8c27fff640 1 -- 10.20.193.195:0/363396769 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f8c3c00d7f0 con 0x7f8c4810e850 2026-02-24T07:20:27.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.888+0000 7f8c4d21c640 1 -- 10.20.193.195:0/363396769 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4811d0c0 con 0x7f8c4810e850 2026-02-24T07:20:27.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.888+0000 7f8c27fff640 1 -- 10.20.193.195:0/363396769 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f8c3c00fe70 con 0x7f8c4810e850 2026-02-24T07:20:27.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.888+0000 7f8c4d21c640 1 -- 10.20.193.195:0/363396769 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4811da30 con 0x7f8c4810e850 2026-02-24T07:20:27.889 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.888+0000 7f8c4d21c640 1 -- 10.20.193.195:0/363396769 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c48132210 con 0x7f8c4810e850 2026-02-24T07:20:27.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.888+0000 7f8c27fff640 1 -- 10.20.193.195:0/363396769 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7f8c3c0026a0 con 0x7f8c4810e850 2026-02-24T07:20:27.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.888+0000 7f8c27fff640 1 --2- 10.20.193.195:0/363396769 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c1c03f8c0 0x7f8c1c05fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:27.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.888+0000 7f8c27fff640 1 -- 10.20.193.195:0/363396769 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (crc 0 0 0) 0x7f8c3c051c50 con 0x7f8c4810e850 2026-02-24T07:20:27.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.889+0000 7f8c46575640 1 --2- 10.20.193.195:0/363396769 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c1c03f8c0 0x7f8c1c05fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:27.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.889+0000 7f8c46575640 1 --2- 10.20.193.195:0/363396769 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c1c03f8c0 0x7f8c1c05fd70 crc :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:27.890 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:27.891+0000 7f8c27fff640 1 -- 10.20.193.195:0/363396769 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f8c3c00e5c0 con 0x7f8c4810e850 2026-02-24T07:20:28.005 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.006+0000 7f8c4d21c640 1 -- 10.20.193.195:0/363396769 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial022=x", "target": ["mon-mgr", ""]}) -- 0x7f8c4811e7b0 con 0x7f8c1c03f8c0 2026-02-24T07:20:28.007 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.009+0000 7f8c27fff640 1 -- 10.20.193.195:0/363396769 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (crc 0 0 0) 0x7f8c4811e7b0 con 0x7f8c1c03f8c0 2026-02-24T07:20:28.007 INFO:teuthology.orchestra.run.trial195.stdout:Scheduled mgr update... 2026-02-24T07:20:28.008 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.010+0000 7f8c4d21c640 1 -- 10.20.193.195:0/363396769 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c1c03f8c0 msgr2=0x7f8c1c05fd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:28.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.010+0000 7f8c4d21c640 1 --2- 10.20.193.195:0/363396769 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c1c03f8c0 0x7f8c1c05fd70 crc :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.010+0000 7f8c4d21c640 1 -- 10.20.193.195:0/363396769 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c4810e850 msgr2=0x7f8c4811c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:28.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.010+0000 7f8c4d21c640 1 --2- 10.20.193.195:0/363396769 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c4810e850 0x7f8c4811c7d0 crc :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.010+0000 7f8c4d21c640 1 -- 10.20.193.195:0/363396769 shutdown_connections 2026-02-24T07:20:28.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.010+0000 7f8c4d21c640 1 --2- 10.20.193.195:0/363396769 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8c1c03f8c0 0x7f8c1c05fd70 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.010+0000 7f8c4d21c640 1 --2- 10.20.193.195:0/363396769 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8c4810e850 0x7f8c4811c7d0 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.010+0000 7f8c4d21c640 1 -- 10.20.193.195:0/363396769 >> 10.20.193.195:0/363396769 conn(0x7f8c480ebf80 msgr2=0x7f8c4810c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:28.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.010+0000 7f8c4d21c640 1 -- 10.20.193.195:0/363396769 shutdown_connections 2026-02-24T07:20:28.009 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:28.010+0000 7f8c4d21c640 1 -- 10.20.193.195:0/363396769 wait complete. 2026-02-24T07:20:28.044 DEBUG:tasks.cephadm:set 0 configs 2026-02-24T07:20:28.044 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph config dump 2026-02-24T07:20:28.159 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.261+0000 7f56b3fa0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.261+0000 7f56b3fa0640 1 -- 10.20.193.22:0/1468341896 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f56ac060800 msgr2=0x7f56ac12d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.261+0000 7f56b3fa0640 1 --2- 10.20.193.22:0/1468341896 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f56ac060800 0x7f56ac12d3d0 crc :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=2190114266703227437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.261+0000 7f56b3fa0640 1 -- 10.20.193.22:0/1468341896 shutdown_connections 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.261+0000 7f56b3fa0640 1 --2- 10.20.193.22:0/1468341896 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f56ac060800 0x7f56ac12d3d0 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=2190114266703227437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.261+0000 7f56b3fa0640 1 -- 10.20.193.22:0/1468341896 >> 10.20.193.22:0/1468341896 conn(0x7f56ac0e8cf0 msgr2=0x7f56ac109100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.261+0000 7f56b3fa0640 1 -- 10.20.193.22:0/1468341896 shutdown_connections 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b3fa0640 1 -- 10.20.193.22:0/1468341896 wait complete. 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b3fa0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b3fa0640 1 Processor -- start 2026-02-24T07:20:28.264 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b3fa0640 1 -- start start 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b3fa0640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f56ac060800 0x7f56ac10c970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b3fa0640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac10ced0 con 0x7f56ac060800 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b1d15640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f56ac060800 0x7f56ac10c970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b1d15640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f56ac060800 0x7f56ac10c970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51808/0 (socket says 10.20.193.22:51808) 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b1d15640 1 -- 10.20.193.22:0/4102048049 learned_addr learned my addr 10.20.193.22:0/4102048049 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b1d15640 1 -- 10.20.193.22:0/4102048049 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac10d010 con 0x7f56ac060800 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b1d15640 1 --2- 10.20.193.22:0/4102048049 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f56ac060800 0x7f56ac10c970 crc :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f569affd640 1 -- 10.20.193.22:0/4102048049 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f569c002b80 con 0x7f56ac060800 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f569affd640 1 -- 10.20.193.22:0/4102048049 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f569c00d850 con 0x7f56ac060800 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b3fa0640 1 -- 10.20.193.22:0/4102048049 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac10b2f0 con 0x7f56ac060800 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f569affd640 1 -- 10.20.193.22:0/4102048049 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f569c00f580 con 0x7f56ac060800 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.262+0000 7f56b3fa0640 1 -- 10.20.193.22:0/4102048049 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac10b860 con 0x7f56ac060800 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.263+0000 7f56b3fa0640 1 -- 10.20.193.22:0/4102048049 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ac10d200 con 0x7f56ac060800 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.263+0000 7f569affd640 1 -- 10.20.193.22:0/4102048049 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7f569c00d340 con 0x7f56ac060800 2026-02-24T07:20:28.265 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.263+0000 7f569affd640 1 --2- 10.20.193.22:0/4102048049 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f568803f8e0 0x7f568805fd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:28.266 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.263+0000 7f569affd640 1 -- 10.20.193.22:0/4102048049 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (crc 0 0 0) 0x7f569c052010 con 0x7f56ac060800 2026-02-24T07:20:28.266 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.263+0000 7f56b1514640 1 --2- 10.20.193.22:0/4102048049 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f568803f8e0 0x7f568805fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:28.266 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.264+0000 7f56b1514640 1 --2- 10.20.193.22:0/4102048049 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f568803f8e0 0x7f568805fd90 crc :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:28.267 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.265+0000 7f569affd640 1 -- 10.20.193.22:0/4102048049 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f569c00aaa0 con 0x7f56ac060800 2026-02-24T07:20:28.372 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.369+0000 7f56b3fa0640 1 -- 10.20.193.22:0/4102048049 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f56ac1300a0 con 0x7f56ac060800 2026-02-24T07:20:28.372 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.369+0000 7f569affd640 1 -- 10.20.193.22:0/4102048049 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v9) ==== 59+0+19570 (crc 0 0 0) 0x7f569c007ea0 con 0x7f56ac060800 2026-02-24T07:20:28.374 INFO:teuthology.orchestra.run.trial022.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-24T07:20:28.374 INFO:teuthology.orchestra.run.trial022.stdout:global dev auth_debug true 2026-02-24T07:20:28.374 INFO:teuthology.orchestra.run.trial022.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 * 2026-02-24T07:20:28.375 INFO:teuthology.orchestra.run.trial022.stdout:global dev debug_asserts_on_shutdown true 2026-02-24T07:20:28.375 INFO:teuthology.orchestra.run.trial022.stdout:global advanced enable_experimental_unrecoverable_data_corrupting_features crimson 2026-02-24T07:20:28.375 INFO:teuthology.orchestra.run.trial022.stdout:global basic log_to_file true 2026-02-24T07:20:28.375 INFO:teuthology.orchestra.run.trial022.stdout:global basic log_to_journald false 2026-02-24T07:20:28.375 INFO:teuthology.orchestra.run.trial022.stdout:global basic log_to_stderr false 2026-02-24T07:20:28.375 INFO:teuthology.orchestra.run.trial022.stdout:global advanced mon_allow_pool_delete true 2026-02-24T07:20:28.375 INFO:teuthology.orchestra.run.trial022.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-24T07:20:28.376 INFO:teuthology.orchestra.run.trial022.stdout:global advanced mon_cluster_log_to_file true 2026-02-24T07:20:28.376 INFO:teuthology.orchestra.run.trial022.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-24T07:20:28.376 INFO:teuthology.orchestra.run.trial022.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-24T07:20:28.376 INFO:teuthology.orchestra.run.trial022.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-24T07:20:28.376 INFO:teuthology.orchestra.run.trial022.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-24T07:20:28.376 INFO:teuthology.orchestra.run.trial022.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-24T07:20:28.376 INFO:teuthology.orchestra.run.trial022.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-24T07:20:28.377 INFO:teuthology.orchestra.run.trial022.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-24T07:20:28.377 INFO:teuthology.orchestra.run.trial022.stdout:global basic ms_client_mode crc * 2026-02-24T07:20:28.377 INFO:teuthology.orchestra.run.trial022.stdout:global basic ms_cluster_mode crc * 2026-02-24T07:20:28.377 INFO:teuthology.orchestra.run.trial022.stdout:global dev ms_die_on_bug true 2026-02-24T07:20:28.377 INFO:teuthology.orchestra.run.trial022.stdout:global dev ms_die_on_old_message true 2026-02-24T07:20:28.377 INFO:teuthology.orchestra.run.trial022.stdout:global basic ms_mon_client_mode crc * 2026-02-24T07:20:28.377 INFO:teuthology.orchestra.run.trial022.stdout:global basic ms_mon_cluster_mode crc * 2026-02-24T07:20:28.378 INFO:teuthology.orchestra.run.trial022.stdout:global basic ms_mon_service_mode crc * 2026-02-24T07:20:28.378 INFO:teuthology.orchestra.run.trial022.stdout:global basic ms_service_mode crc * 2026-02-24T07:20:28.378 INFO:teuthology.orchestra.run.trial022.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T07:20:28.378 INFO:teuthology.orchestra.run.trial022.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-24T07:20:28.378 INFO:teuthology.orchestra.run.trial022.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-24T07:20:28.378 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-24T07:20:28.379 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-24T07:20:28.379 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-24T07:20:28.379 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced debug_mon 20/20 2026-02-24T07:20:28.379 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced debug_ms 1/1 2026-02-24T07:20:28.379 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced debug_paxos 20/20 2026-02-24T07:20:28.379 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced mon_data_avail_warn 5 2026-02-24T07:20:28.379 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-24T07:20:28.380 INFO:teuthology.orchestra.run.trial022.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-24T07:20:28.380 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-24T07:20:28.380 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-24T07:20:28.380 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-24T07:20:28.380 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-24T07:20:28.380 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-24T07:20:28.380 INFO:teuthology.orchestra.run.trial022.stdout:mon dev mon_warn_on_pool_no_app false 2026-02-24T07:20:28.380 INFO:teuthology.orchestra.run.trial022.stdout:mon advanced osd_pool_default_crimson true 2026-02-24T07:20:28.380 INFO:teuthology.orchestra.run.trial022.stdout:mgr advanced debug_mgr 20/20 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:mgr advanced debug_ms 1/1 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:mgr advanced debug_osd 10/10 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:osd dev bdev_debug_aio true 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced crimson_cpu_num 4 * 2026-02-24T07:20:28.381 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced crimson_osd_obc_lru_size 10 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_ms 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_osd 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_backref 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_cache 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_cleaner 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_device 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_epm 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_fixedkv_tree 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_journal 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_lba 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_odata 20/20 2026-02-24T07:20:28.382 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_omap 20/20 2026-02-24T07:20:28.383 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_onode 20/20 2026-02-24T07:20:28.383 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_t 20/20 2026-02-24T07:20:28.383 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced debug_seastore_tm 20/20 2026-02-24T07:20:28.383 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_blocked_scrub_grace_period 3600 2026-02-24T07:20:28.383 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_class_default_list * * 2026-02-24T07:20:28.383 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_class_load_list * * 2026-02-24T07:20:28.383 INFO:teuthology.orchestra.run.trial022.stdout:osd dev osd_debug_misdirected_ops true 2026-02-24T07:20:28.383 INFO:teuthology.orchestra.run.trial022.stdout:osd dev osd_debug_op_order true 2026-02-24T07:20:28.384 INFO:teuthology.orchestra.run.trial022.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-24T07:20:28.384 INFO:teuthology.orchestra.run.trial022.stdout:osd dev osd_debug_shutdown true 2026-02-24T07:20:28.384 INFO:teuthology.orchestra.run.trial022.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-24T07:20:28.384 INFO:teuthology.orchestra.run.trial022.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-24T07:20:28.384 INFO:teuthology.orchestra.run.trial022.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-24T07:20:28.384 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-24T07:20:28.384 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-24T07:20:28.384 INFO:teuthology.orchestra.run.trial022.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-24T07:20:28.384 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_memory_target_autotune true 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_objectstore seastore * 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_op_queue debug_random * 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_recover_clone_overlap true 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced seastore_cachepin_size_pershard 67108864 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd dev seastore_cachepin_type 2Q * 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:osd advanced seastore_max_concurrent_transactions 8 2026-02-24T07:20:28.385 INFO:teuthology.orchestra.run.trial022.stdout:client advanced debug_ms 1/1 2026-02-24T07:20:28.386 INFO:teuthology.orchestra.run.trial022.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-24T07:20:28.386 INFO:teuthology.orchestra.run.trial022.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-24T07:20:28.386 INFO:teuthology.orchestra.run.trial022.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-24T07:20:28.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.370+0000 7f56b3fa0640 1 -- 10.20.193.22:0/4102048049 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f568803f8e0 msgr2=0x7f568805fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:28.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.370+0000 7f56b3fa0640 1 --2- 10.20.193.22:0/4102048049 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f568803f8e0 0x7f568805fd90 crc :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.370+0000 7f56b3fa0640 1 -- 10.20.193.22:0/4102048049 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f56ac060800 msgr2=0x7f56ac10c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:28.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.370+0000 7f56b3fa0640 1 --2- 10.20.193.22:0/4102048049 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f56ac060800 0x7f56ac10c970 crc :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.370+0000 7f56b3fa0640 1 -- 10.20.193.22:0/4102048049 shutdown_connections 2026-02-24T07:20:28.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.370+0000 7f56b3fa0640 1 --2- 10.20.193.22:0/4102048049 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f568803f8e0 0x7f568805fd90 unknown :-1 s=CLOSED pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.370+0000 7f56b3fa0640 1 --2- 10.20.193.22:0/4102048049 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f56ac060800 0x7f56ac10c970 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.370+0000 7f56b3fa0640 1 -- 10.20.193.22:0/4102048049 >> 10.20.193.22:0/4102048049 conn(0x7f56ac0e8cf0 msgr2=0x7f56ac1090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:28.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.370+0000 7f56b3fa0640 1 -- 10.20.193.22:0/4102048049 shutdown_connections 2026-02-24T07:20:28.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.370+0000 7f56b3fa0640 1 -- 10.20.193.22:0/4102048049 wait complete. 2026-02-24T07:20:28.409 INFO:tasks.cephadm:Enabling crimson flags... 2026-02-24T07:20:28.410 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-24T07:20:28.432 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial022:10.20.193.22=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:28.432 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: Saving service mon spec with placement trial022:10.20.193.22=a;count:1 2026-02-24T07:20:28.432 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.432 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.432 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial195", "name": "osd_memory_target"} : dispatch 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: Updating trial195:/etc/ceph/ceph.conf 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: Updating trial195:/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1654361513' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: Updating trial195:/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.433 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:28.434 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:28.435 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:20:28.435 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.435 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:28.435 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-24T07:20:28.435 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-24T07:20:28.435 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:28.525 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:28.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:28.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 -- 10.20.193.22:0/731316820 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1dac10e960 msgr2=0x7f1dac10ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:28.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 --2- 10.20.193.22:0/731316820 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1dac10e960 0x7f1dac10ed50 crc :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=6819601816189381762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 -- 10.20.193.22:0/731316820 shutdown_connections 2026-02-24T07:20:28.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 --2- 10.20.193.22:0/731316820 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1dac10e960 0x7f1dac10ed50 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=6819601816189381762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:28.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 -- 10.20.193.22:0/731316820 >> 10.20.193.22:0/731316820 conn(0x7f1dac0ec0d0 msgr2=0x7f1dac10c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:28.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 -- 10.20.193.22:0/731316820 shutdown_connections 2026-02-24T07:20:28.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 -- 10.20.193.22:0/731316820 wait complete. 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 Processor -- start 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 -- start start 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1dac10e960 0x7f1dac11c7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db3d04640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac11cd30 con 0x7f1dac10e960 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db1a79640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1dac10e960 0x7f1dac11c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db1a79640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1dac10e960 0x7f1dac11c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51832/0 (socket says 10.20.193.22:51832) 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.627+0000 7f1db1a79640 1 -- 10.20.193.22:0/1866410665 learned_addr learned my addr 10.20.193.22:0/1866410665 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.628+0000 7f1db1a79640 1 -- 10.20.193.22:0/1866410665 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac11ce70 con 0x7f1dac10e960 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.628+0000 7f1db1a79640 1 --2- 10.20.193.22:0/1866410665 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1dac10e960 0x7f1dac11c7d0 crc :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:28.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.628+0000 7f1d9affd640 1 -- 10.20.193.22:0/1866410665 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f1d9c00d690 con 0x7f1dac10e960 2026-02-24T07:20:28.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.628+0000 7f1db3d04640 1 -- 10.20.193.22:0/1866410665 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac11d0c0 con 0x7f1dac10e960 2026-02-24T07:20:28.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.628+0000 7f1d9affd640 1 -- 10.20.193.22:0/1866410665 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f1d9c00d7f0 con 0x7f1dac10e960 2026-02-24T07:20:28.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.628+0000 7f1d9affd640 1 -- 10.20.193.22:0/1866410665 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f1d9c00fd70 con 0x7f1dac10e960 2026-02-24T07:20:28.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.628+0000 7f1db3d04640 1 -- 10.20.193.22:0/1866410665 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac11da30 con 0x7f1dac10e960 2026-02-24T07:20:28.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.628+0000 7f1db3d04640 1 -- 10.20.193.22:0/1866410665 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac132320 con 0x7f1dac10e960 2026-02-24T07:20:28.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.628+0000 7f1d9affd640 1 -- 10.20.193.22:0/1866410665 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7f1d9c00f6b0 con 0x7f1dac10e960 2026-02-24T07:20:28.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.628+0000 7f1d9affd640 1 --2- 10.20.193.22:0/1866410665 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1d8803f890 0x7f1d8805fd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:28.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.629+0000 7f1d9affd640 1 -- 10.20.193.22:0/1866410665 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (crc 0 0 0) 0x7f1d9c051c60 con 0x7f1dac10e960 2026-02-24T07:20:28.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.629+0000 7f1db1278640 1 --2- 10.20.193.22:0/1866410665 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1d8803f890 0x7f1d8805fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:28.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.629+0000 7f1db1278640 1 --2- 10.20.193.22:0/1866410665 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1d8803f890 0x7f1d8805fd40 crc :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:28.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.630+0000 7f1d9affd640 1 -- 10.20.193.22:0/1866410665 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f1d9c0071c0 con 0x7f1dac10e960 2026-02-24T07:20:28.745 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:28.743+0000 7f1db3d04640 1 -- 10.20.193.22:0/1866410665 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7f1dac11e7b0 con 0x7f1dac10e960 2026-02-24T07:20:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a[39104]: 2026-02-24T07:20:28.743+0000 7f3cac6c5640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-24T07:20:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a[39104]: Please be aware that this feature is experimental, untested, 2026-02-24T07:20:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a[39104]: unsupported, and may result in data corruption, data loss, 2026-02-24T07:20:29.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a[39104]: and/or irreparable damage to your cluster. Do not use 2026-02-24T07:20:29.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a[39104]: feature with important data. 2026-02-24T07:20:29.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:28 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mon-a[39104]: 2026-02-24T07:20:29.284 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.282+0000 7f1d9affd640 1 -- 10.20.193.22:0/1866410665 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v5) ==== 99+0+0 (crc 0 0 0) 0x7f1d9c0071c0 con 0x7f1dac10e960 2026-02-24T07:20:29.286 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.284+0000 7f1db3d04640 1 -- 10.20.193.22:0/1866410665 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1d8803f890 msgr2=0x7f1d8805fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:29.286 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.284+0000 7f1db3d04640 1 --2- 10.20.193.22:0/1866410665 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1d8803f890 0x7f1d8805fd40 crc :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:29.286 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.284+0000 7f1db3d04640 1 -- 10.20.193.22:0/1866410665 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1dac10e960 msgr2=0x7f1dac11c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:29.286 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.284+0000 7f1db3d04640 1 --2- 10.20.193.22:0/1866410665 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1dac10e960 0x7f1dac11c7d0 crc :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:29.286 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.284+0000 7f1db3d04640 1 -- 10.20.193.22:0/1866410665 shutdown_connections 2026-02-24T07:20:29.286 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.284+0000 7f1db3d04640 1 --2- 10.20.193.22:0/1866410665 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1d8803f890 0x7f1d8805fd40 unknown :-1 s=CLOSED pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:29.286 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.284+0000 7f1db3d04640 1 --2- 10.20.193.22:0/1866410665 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1dac10e960 0x7f1dac11c7d0 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:29.286 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.284+0000 7f1db3d04640 1 -- 10.20.193.22:0/1866410665 >> 10.20.193.22:0/1866410665 conn(0x7f1dac0ec0d0 msgr2=0x7f1dac10c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:29.286 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.284+0000 7f1db3d04640 1 -- 10.20.193.22:0/1866410665 shutdown_connections 2026-02-24T07:20:29.286 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:29.284+0000 7f1db3d04640 1 -- 10.20.193.22:0/1866410665 wait complete. 2026-02-24T07:20:29.342 INFO:tasks.cephadm:Deploying OSDs... 2026-02-24T07:20:29.343 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:20:29.343 DEBUG:teuthology.orchestra.run.trial022:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T07:20:29.400 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T07:20:29.400 DEBUG:teuthology.orchestra.run.trial022:> stat /dev/vg_nvme/lv_1 2026-02-24T07:20:29.457 INFO:teuthology.orchestra.run.trial022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T07:20:29.458 INFO:teuthology.orchestra.run.trial022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:20:29.458 INFO:teuthology.orchestra.run.trial022.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-24T07:20:29.458 INFO:teuthology.orchestra.run.trial022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:20:29.458 INFO:teuthology.orchestra.run.trial022.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:20:29.458 INFO:teuthology.orchestra.run.trial022.stdout:Access: 2026-02-24 07:20:23.119789231 +0000 2026-02-24T07:20:29.458 INFO:teuthology.orchestra.run.trial022.stdout:Modify: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.458 INFO:teuthology.orchestra.run.trial022.stdout:Change: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.458 INFO:teuthology.orchestra.run.trial022.stdout: Birth: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.459 DEBUG:teuthology.orchestra.run.trial022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T07:20:29.521 INFO:teuthology.orchestra.run.trial022.stderr:1+0 records in 2026-02-24T07:20:29.521 INFO:teuthology.orchestra.run.trial022.stderr:1+0 records out 2026-02-24T07:20:29.522 INFO:teuthology.orchestra.run.trial022.stderr:512 bytes copied, 0.000162822 s, 3.1 MB/s 2026-02-24T07:20:29.523 DEBUG:teuthology.orchestra.run.trial022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T07:20:29.580 DEBUG:teuthology.orchestra.run.trial022:> stat /dev/vg_nvme/lv_2 2026-02-24T07:20:29.637 INFO:teuthology.orchestra.run.trial022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T07:20:29.637 INFO:teuthology.orchestra.run.trial022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:20:29.637 INFO:teuthology.orchestra.run.trial022.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-24T07:20:29.637 INFO:teuthology.orchestra.run.trial022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:20:29.638 INFO:teuthology.orchestra.run.trial022.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:20:29.638 INFO:teuthology.orchestra.run.trial022.stdout:Access: 2026-02-24 07:20:23.149788736 +0000 2026-02-24T07:20:29.638 INFO:teuthology.orchestra.run.trial022.stdout:Modify: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.638 INFO:teuthology.orchestra.run.trial022.stdout:Change: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.638 INFO:teuthology.orchestra.run.trial022.stdout: Birth: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.638 DEBUG:teuthology.orchestra.run.trial022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T07:20:29.699 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: Updating trial195:/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T07:20:29.699 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: Reconfiguring mon.a (unknown last config time)... 2026-02-24T07:20:29.699 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: Reconfiguring daemon mon.a on trial022 2026-02-24T07:20:29.699 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial022=x", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:29.699 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: Saving service mgr spec with placement trial022=x;count:1 2026-02-24T07:20:29.699 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: Reconfiguring mgr.x (unknown last config time)... 2026-02-24T07:20:29.699 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: Reconfiguring daemon mgr.x on trial022 2026-02-24T07:20:29.699 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:29.699 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:29.700 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4102048049' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-24T07:20:29.700 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:29 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1866410665' entity='client.admin' cmd={"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:20:29.701 INFO:teuthology.orchestra.run.trial022.stderr:1+0 records in 2026-02-24T07:20:29.701 INFO:teuthology.orchestra.run.trial022.stderr:1+0 records out 2026-02-24T07:20:29.701 INFO:teuthology.orchestra.run.trial022.stderr:512 bytes copied, 0.000148947 s, 3.4 MB/s 2026-02-24T07:20:29.702 DEBUG:teuthology.orchestra.run.trial022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T07:20:29.759 DEBUG:teuthology.orchestra.run.trial022:> stat /dev/vg_nvme/lv_3 2026-02-24T07:20:29.815 INFO:teuthology.orchestra.run.trial022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T07:20:29.815 INFO:teuthology.orchestra.run.trial022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:20:29.816 INFO:teuthology.orchestra.run.trial022.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-24T07:20:29.816 INFO:teuthology.orchestra.run.trial022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:20:29.816 INFO:teuthology.orchestra.run.trial022.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:20:29.816 INFO:teuthology.orchestra.run.trial022.stdout:Access: 2026-02-24 07:20:23.180788224 +0000 2026-02-24T07:20:29.816 INFO:teuthology.orchestra.run.trial022.stdout:Modify: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.816 INFO:teuthology.orchestra.run.trial022.stdout:Change: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.816 INFO:teuthology.orchestra.run.trial022.stdout: Birth: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.816 DEBUG:teuthology.orchestra.run.trial022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T07:20:29.878 INFO:teuthology.orchestra.run.trial022.stderr:1+0 records in 2026-02-24T07:20:29.878 INFO:teuthology.orchestra.run.trial022.stderr:1+0 records out 2026-02-24T07:20:29.878 INFO:teuthology.orchestra.run.trial022.stderr:512 bytes copied, 0.000151661 s, 3.4 MB/s 2026-02-24T07:20:29.879 DEBUG:teuthology.orchestra.run.trial022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T07:20:29.936 DEBUG:teuthology.orchestra.run.trial022:> stat /dev/vg_nvme/lv_4 2026-02-24T07:20:29.992 INFO:teuthology.orchestra.run.trial022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T07:20:29.993 INFO:teuthology.orchestra.run.trial022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:20:29.993 INFO:teuthology.orchestra.run.trial022.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-24T07:20:29.993 INFO:teuthology.orchestra.run.trial022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:20:29.993 INFO:teuthology.orchestra.run.trial022.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:20:29.993 INFO:teuthology.orchestra.run.trial022.stdout:Access: 2026-02-24 07:20:23.211787711 +0000 2026-02-24T07:20:29.993 INFO:teuthology.orchestra.run.trial022.stdout:Modify: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.993 INFO:teuthology.orchestra.run.trial022.stdout:Change: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.993 INFO:teuthology.orchestra.run.trial022.stdout: Birth: 2026-02-24 07:17:12.493988074 +0000 2026-02-24T07:20:29.994 DEBUG:teuthology.orchestra.run.trial022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T07:20:30.055 INFO:teuthology.orchestra.run.trial022.stderr:1+0 records in 2026-02-24T07:20:30.055 INFO:teuthology.orchestra.run.trial022.stderr:1+0 records out 2026-02-24T07:20:30.055 INFO:teuthology.orchestra.run.trial022.stderr:512 bytes copied, 0.000132065 s, 3.9 MB/s 2026-02-24T07:20:30.056 DEBUG:teuthology.orchestra.run.trial022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T07:20:30.112 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:20:30.112 DEBUG:teuthology.orchestra.run.trial195:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T07:20:30.131 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T07:20:30.131 DEBUG:teuthology.orchestra.run.trial195:> stat /dev/vg_nvme/lv_1 2026-02-24T07:20:30.188 INFO:teuthology.orchestra.run.trial195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T07:20:30.189 INFO:teuthology.orchestra.run.trial195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:20:30.189 INFO:teuthology.orchestra.run.trial195.stdout:Device: 6h/6d Inode: 1337 Links: 1 2026-02-24T07:20:30.189 INFO:teuthology.orchestra.run.trial195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:20:30.189 INFO:teuthology.orchestra.run.trial195.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:20:30.190 INFO:teuthology.orchestra.run.trial195.stdout:Access: 2026-02-24 07:20:26.943101182 +0000 2026-02-24T07:20:30.190 INFO:teuthology.orchestra.run.trial195.stdout:Modify: 2026-02-24 07:17:08.080740360 +0000 2026-02-24T07:20:30.190 INFO:teuthology.orchestra.run.trial195.stdout:Change: 2026-02-24 07:17:08.080740360 +0000 2026-02-24T07:20:30.190 INFO:teuthology.orchestra.run.trial195.stdout: Birth: 2026-02-24 07:17:08.080740360 +0000 2026-02-24T07:20:30.191 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T07:20:30.254 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records in 2026-02-24T07:20:30.254 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records out 2026-02-24T07:20:30.254 INFO:teuthology.orchestra.run.trial195.stderr:512 bytes copied, 0.000155038 s, 3.3 MB/s 2026-02-24T07:20:30.255 DEBUG:teuthology.orchestra.run.trial195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T07:20:30.313 DEBUG:teuthology.orchestra.run.trial195:> stat /dev/vg_nvme/lv_2 2026-02-24T07:20:30.369 INFO:teuthology.orchestra.run.trial195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T07:20:30.369 INFO:teuthology.orchestra.run.trial195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:20:30.369 INFO:teuthology.orchestra.run.trial195.stdout:Device: 6h/6d Inode: 1352 Links: 1 2026-02-24T07:20:30.369 INFO:teuthology.orchestra.run.trial195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:20:30.369 INFO:teuthology.orchestra.run.trial195.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:20:30.369 INFO:teuthology.orchestra.run.trial195.stdout:Access: 2026-02-24 07:20:26.970100430 +0000 2026-02-24T07:20:30.369 INFO:teuthology.orchestra.run.trial195.stdout:Modify: 2026-02-24 07:17:08.082740304 +0000 2026-02-24T07:20:30.369 INFO:teuthology.orchestra.run.trial195.stdout:Change: 2026-02-24 07:17:08.082740304 +0000 2026-02-24T07:20:30.370 INFO:teuthology.orchestra.run.trial195.stdout: Birth: 2026-02-24 07:17:08.082740304 +0000 2026-02-24T07:20:30.370 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T07:20:30.431 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records in 2026-02-24T07:20:30.432 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records out 2026-02-24T07:20:30.432 INFO:teuthology.orchestra.run.trial195.stderr:512 bytes copied, 0.000133087 s, 3.8 MB/s 2026-02-24T07:20:30.433 DEBUG:teuthology.orchestra.run.trial195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T07:20:30.459 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:30 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1866410665' entity='client.admin' cmd='[{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:20:30.459 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:30 trial022 ceph-mon[39108]: osdmap e5: 0 total, 0 up, 0 in 2026-02-24T07:20:30.490 DEBUG:teuthology.orchestra.run.trial195:> stat /dev/vg_nvme/lv_3 2026-02-24T07:20:30.547 INFO:teuthology.orchestra.run.trial195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T07:20:30.547 INFO:teuthology.orchestra.run.trial195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:20:30.547 INFO:teuthology.orchestra.run.trial195.stdout:Device: 6h/6d Inode: 1332 Links: 1 2026-02-24T07:20:30.547 INFO:teuthology.orchestra.run.trial195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:20:30.547 INFO:teuthology.orchestra.run.trial195.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:20:30.547 INFO:teuthology.orchestra.run.trial195.stdout:Access: 2026-02-24 07:20:26.998099652 +0000 2026-02-24T07:20:30.547 INFO:teuthology.orchestra.run.trial195.stdout:Modify: 2026-02-24 07:17:08.080740360 +0000 2026-02-24T07:20:30.548 INFO:teuthology.orchestra.run.trial195.stdout:Change: 2026-02-24 07:17:08.080740360 +0000 2026-02-24T07:20:30.548 INFO:teuthology.orchestra.run.trial195.stdout: Birth: 2026-02-24 07:17:08.080740360 +0000 2026-02-24T07:20:30.548 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T07:20:30.611 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records in 2026-02-24T07:20:30.611 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records out 2026-02-24T07:20:30.612 INFO:teuthology.orchestra.run.trial195.stderr:512 bytes copied, 0.000147865 s, 3.5 MB/s 2026-02-24T07:20:30.614 DEBUG:teuthology.orchestra.run.trial195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T07:20:30.670 DEBUG:teuthology.orchestra.run.trial195:> stat /dev/vg_nvme/lv_4 2026-02-24T07:20:30.727 INFO:teuthology.orchestra.run.trial195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T07:20:30.727 INFO:teuthology.orchestra.run.trial195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T07:20:30.727 INFO:teuthology.orchestra.run.trial195.stdout:Device: 6h/6d Inode: 1338 Links: 1 2026-02-24T07:20:30.727 INFO:teuthology.orchestra.run.trial195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T07:20:30.727 INFO:teuthology.orchestra.run.trial195.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T07:20:30.727 INFO:teuthology.orchestra.run.trial195.stdout:Access: 2026-02-24 07:20:27.026098873 +0000 2026-02-24T07:20:30.727 INFO:teuthology.orchestra.run.trial195.stdout:Modify: 2026-02-24 07:17:08.081740332 +0000 2026-02-24T07:20:30.727 INFO:teuthology.orchestra.run.trial195.stdout:Change: 2026-02-24 07:17:08.081740332 +0000 2026-02-24T07:20:30.728 INFO:teuthology.orchestra.run.trial195.stdout: Birth: 2026-02-24 07:17:08.081740332 +0000 2026-02-24T07:20:30.728 DEBUG:teuthology.orchestra.run.trial195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T07:20:30.789 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records in 2026-02-24T07:20:30.789 INFO:teuthology.orchestra.run.trial195.stderr:1+0 records out 2026-02-24T07:20:30.789 INFO:teuthology.orchestra.run.trial195.stderr:512 bytes copied, 0.000133798 s, 3.8 MB/s 2026-02-24T07:20:30.790 DEBUG:teuthology.orchestra.run.trial195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T07:20:30.848 INFO:tasks.cephadm:Deploying osd.0 on trial022 with /dev/vg_nvme/lv_4... 2026-02-24T07:20:30.848 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T07:20:30.966 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:31.422 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:31.438 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch daemon add osd trial022:vg_nvme/lv_4 --skip-validation 2026-02-24T07:20:31.556 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:31.666 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.662+0000 7fe8e8b62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:31.667 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.662+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2041084911 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8e410cb20 msgr2=0x7fe8e410cf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:31.667 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.662+0000 7fe8e8b62640 1 --2- 10.20.193.22:0/2041084911 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8e410cb20 0x7fe8e410cf10 crc :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=1917993785439685845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:31.667 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.662+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2041084911 shutdown_connections 2026-02-24T07:20:31.667 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.662+0000 7fe8e8b62640 1 --2- 10.20.193.22:0/2041084911 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8e410cb20 0x7fe8e410cf10 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=1917993785439685845 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:31.667 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.662+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2041084911 >> 10.20.193.22:0/2041084911 conn(0x7fe8e40ea270 msgr2=0x7fe8e410a680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:31.667 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.662+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2041084911 shutdown_connections 2026-02-24T07:20:31.667 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.662+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2041084911 wait complete. 2026-02-24T07:20:31.668 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e8b62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:31.668 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e8b62640 1 Processor -- start 2026-02-24T07:20:31.668 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e8b62640 1 -- start start 2026-02-24T07:20:31.668 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e8b62640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8e410cb20 0x7fe8e40f4400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:31.668 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e8b62640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e40f4960 con 0x7fe8e410cb20 2026-02-24T07:20:31.668 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e2575640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8e410cb20 0x7fe8e40f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:31.668 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e2575640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8e410cb20 0x7fe8e40f4400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51856/0 (socket says 10.20.193.22:51856) 2026-02-24T07:20:31.669 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e2575640 1 -- 10.20.193.22:0/2775332867 learned_addr learned my addr 10.20.193.22:0/2775332867 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:31.669 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e2575640 1 -- 10.20.193.22:0/2775332867 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e40f4aa0 con 0x7fe8e410cb20 2026-02-24T07:20:31.669 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e2575640 1 --2- 10.20.193.22:0/2775332867 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8e410cb20 0x7fe8e40f4400 crc :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:31.669 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8cb7fe640 1 -- 10.20.193.22:0/2775332867 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe8d800d690 con 0x7fe8e410cb20 2026-02-24T07:20:31.669 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8cb7fe640 1 -- 10.20.193.22:0/2775332867 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fe8d800d7f0 con 0x7fe8e410cb20 2026-02-24T07:20:31.669 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2775332867 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e40f4cf0 con 0x7fe8e410cb20 2026-02-24T07:20:31.669 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8cb7fe640 1 -- 10.20.193.22:0/2775332867 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe8d800fd70 con 0x7fe8e410cb20 2026-02-24T07:20:31.669 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.663+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2775332867 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e40f5660 con 0x7fe8e410cb20 2026-02-24T07:20:31.670 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.664+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2775332867 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e4062e10 con 0x7fe8e410cb20 2026-02-24T07:20:31.670 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.664+0000 7fe8cb7fe640 1 -- 10.20.193.22:0/2775332867 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7fe8d800e5c0 con 0x7fe8e410cb20 2026-02-24T07:20:31.670 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.664+0000 7fe8cb7fe640 1 --2- 10.20.193.22:0/2775332867 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fe8bc03f8e0 0x7fe8bc05fd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:31.670 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.664+0000 7fe8cb7fe640 1 -- 10.20.193.22:0/2775332867 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1172+0+0 (crc 0 0 0) 0x7fe8d8051bf0 con 0x7fe8e410cb20 2026-02-24T07:20:31.670 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.664+0000 7fe8e1d74640 1 --2- 10.20.193.22:0/2775332867 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fe8bc03f8e0 0x7fe8bc05fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:31.670 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.665+0000 7fe8e1d74640 1 --2- 10.20.193.22:0/2775332867 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fe8bc03f8e0 0x7fe8bc05fd90 crc :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:31.671 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.667+0000 7fe8cb7fe640 1 -- 10.20.193.22:0/2775332867 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fe8d8015b20 con 0x7fe8e410cb20 2026-02-24T07:20:31.782 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:31.781+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2775332867 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial022:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fe8e405f5e0 con 0x7fe8bc03f8e0 2026-02-24T07:20:32.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='client.14200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial022:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: osd.default does not exist. Creating it now. 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: Creating OSDs with service ID: default on trial022:['vg_nvme/lv_4'] 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: Marking host: trial022 for OSDSpec preview refresh. 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: Saving service osd.default spec with placement trial022 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:32.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3604803053' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca990aad-309e-4860-89f8-220d9644f458"} : dispatch 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3604803053' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca990aad-309e-4860-89f8-220d9644f458"}]': finished 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: osdmap e6: 1 total, 0 up, 1 in 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:20:32.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:32 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2396713308' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T07:20:34.843 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:34 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T07:20:34.843 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:34 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:35.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:35 trial022 ceph-mon[39108]: Deploying daemon osd.0 on trial022 2026-02-24T07:20:35.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:35 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-24T07:20:35.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:35 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:35.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:35 trial022 ceph-mon[39108]: Deploying daemon osd.0 on trial022 2026-02-24T07:20:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:37 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:37 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:39.214 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:39 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:39.214 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:39 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:39.214 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:39 trial022 ceph-mon[39108]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T07:20:39.214 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:39 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:39.214 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:39 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:39.214 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:39 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:39.214 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:39 trial022 ceph-mon[39108]: from='osd.0 [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-24T07:20:39.214 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:39 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:39.214 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:39 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:39.279 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.277+0000 7fe8cb7fe640 1 -- 10.20.193.22:0/2775332867 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (crc 0 0 0) 0x7fe8e405f5e0 con 0x7fe8bc03f8e0 2026-02-24T07:20:39.279 INFO:teuthology.orchestra.run.trial022.stdout:Created osd(s) 0 on host 'trial022' 2026-02-24T07:20:39.282 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.280+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2775332867 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fe8bc03f8e0 msgr2=0x7fe8bc05fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:39.282 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.280+0000 7fe8e8b62640 1 --2- 10.20.193.22:0/2775332867 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fe8bc03f8e0 0x7fe8bc05fd90 crc :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:39.282 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.280+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2775332867 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8e410cb20 msgr2=0x7fe8e40f4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:39.282 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.280+0000 7fe8e8b62640 1 --2- 10.20.193.22:0/2775332867 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8e410cb20 0x7fe8e40f4400 crc :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:39.282 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.280+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2775332867 shutdown_connections 2026-02-24T07:20:39.282 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.280+0000 7fe8e8b62640 1 --2- 10.20.193.22:0/2775332867 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fe8bc03f8e0 0x7fe8bc05fd90 unknown :-1 s=CLOSED pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:39.282 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.280+0000 7fe8e8b62640 1 --2- 10.20.193.22:0/2775332867 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8e410cb20 0x7fe8e40f4400 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:39.282 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.280+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2775332867 >> 10.20.193.22:0/2775332867 conn(0x7fe8e40ea270 msgr2=0x7fe8e40ea640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:39.282 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.280+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2775332867 shutdown_connections 2026-02-24T07:20:39.283 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:39.280+0000 7fe8e8b62640 1 -- 10.20.193.22:0/2775332867 wait complete. 2026-02-24T07:20:39.319 DEBUG:teuthology.orchestra.run.trial022:osd.0> sudo journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.0.service 2026-02-24T07:20:39.322 INFO:tasks.cephadm:Deploying osd.1 on trial022 with /dev/vg_nvme/lv_3... 2026-02-24T07:20:39.322 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T07:20:39.483 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:40.349 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:40.349 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:40.350 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='osd.0 [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-24T07:20:40.350 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: osdmap e7: 1 total, 0 up, 1 in 2026-02-24T07:20:40.350 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:20:40.350 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='osd.0 [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial022", "root=default"]} : dispatch 2026-02-24T07:20:40.350 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:40.350 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:40.350 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T07:20:40.350 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:40.350 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:40.350 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:20:40.351 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:40.351 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:20:40.351 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:20:40.351 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:40 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:40.583 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:20:40.600 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch daemon add osd trial022:vg_nvme/lv_3 --skip-validation 2026-02-24T07:20:40.719 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:20:40.827 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:40.828 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 -- 10.20.193.22:0/3622911323 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb4e810e960 msgr2=0x7fb4e810ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:40.828 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 --2- 10.20.193.22:0/3622911323 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb4e810e960 0x7fb4e810ed50 crc :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=9103891987939113346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:40.828 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 -- 10.20.193.22:0/3622911323 shutdown_connections 2026-02-24T07:20:40.828 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 --2- 10.20.193.22:0/3622911323 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb4e810e960 0x7fb4e810ed50 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=9103891987939113346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:40.828 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 -- 10.20.193.22:0/3622911323 >> 10.20.193.22:0/3622911323 conn(0x7fb4e80ec0d0 msgr2=0x7fb4e810c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:40.828 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 -- 10.20.193.22:0/3622911323 shutdown_connections 2026-02-24T07:20:40.828 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 -- 10.20.193.22:0/3622911323 wait complete. 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 Processor -- start 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 -- start start 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb4e810e960 0x7fb4e811c8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e811ce50 con 0x7fb4e810e960 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4edc59640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb4e810e960 0x7fb4e811c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4edc59640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb4e810e960 0x7fb4e811c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:58076/0 (socket says 10.20.193.22:58076) 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4edc59640 1 -- 10.20.193.22:0/2598910138 learned_addr learned my addr 10.20.193.22:0/2598910138 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4edc59640 1 -- 10.20.193.22:0/2598910138 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e811cf90 con 0x7fb4e810e960 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4edc59640 1 --2- 10.20.193.22:0/2598910138 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb4e810e960 0x7fb4e811c8f0 crc :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:40.829 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4d6ffd640 1 -- 10.20.193.22:0/2598910138 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fb4d800d690 con 0x7fb4e810e960 2026-02-24T07:20:40.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 -- 10.20.193.22:0/2598910138 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e811d1e0 con 0x7fb4e810e960 2026-02-24T07:20:40.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4d6ffd640 1 -- 10.20.193.22:0/2598910138 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fb4d800d7f0 con 0x7fb4e810e960 2026-02-24T07:20:40.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4d6ffd640 1 -- 10.20.193.22:0/2598910138 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fb4d800fe70 con 0x7fb4e810e960 2026-02-24T07:20:40.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.823+0000 7fb4efee4640 1 -- 10.20.193.22:0/2598910138 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e811db50 con 0x7fb4e810e960 2026-02-24T07:20:40.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.824+0000 7fb4efee4640 1 -- 10.20.193.22:0/2598910138 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e8132320 con 0x7fb4e810e960 2026-02-24T07:20:40.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.824+0000 7fb4d6ffd640 1 -- 10.20.193.22:0/2598910138 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7fb4d80026a0 con 0x7fb4e810e960 2026-02-24T07:20:40.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.824+0000 7fb4d6ffd640 1 --2- 10.20.193.22:0/2598910138 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb4c403f8c0 0x7fb4c405fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:40.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.824+0000 7fb4d6ffd640 1 -- 10.20.193.22:0/2598910138 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1502+0+0 (crc 0 0 0) 0x7fb4d8051db0 con 0x7fb4e810e960 2026-02-24T07:20:40.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.824+0000 7fb4ed458640 1 --2- 10.20.193.22:0/2598910138 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb4c403f8c0 0x7fb4c405fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:40.830 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.825+0000 7fb4ed458640 1 --2- 10.20.193.22:0/2598910138 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb4c403f8c0 0x7fb4c405fd70 crc :-1 s=READY pgs=28 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:40.831 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.827+0000 7fb4d6ffd640 1 -- 10.20.193.22:0/2598910138 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fb4d8055040 con 0x7fb4e810e960 2026-02-24T07:20:40.861 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:20:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0[55291]: 2026-02-24T07:20:40.622+0000 7fa956a9e640 -1 osd.0 0 waiting for initial osdmap 2026-02-24T07:20:40.862 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:20:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0[55291]: 2026-02-24T07:20:40.624+0000 7fa94e95d640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T07:20:40.942 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:40.941+0000 7fb4efee4640 1 -- 10.20.193.22:0/2598910138 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial022:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb4e811e8d0 con 0x7fb4c403f8c0 2026-02-24T07:20:41.451 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: Detected new or changed devices on trial022 2026-02-24T07:20:41.452 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: Adjusting osd_memory_target on trial022 to 84047M 2026-02-24T07:20:41.452 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-24T07:20:41.452 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: from='osd.0 [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial022", "root=default"]}]': finished 2026-02-24T07:20:41.452 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: osdmap e8: 1 total, 0 up, 1 in 2026-02-24T07:20:41.453 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:20:41.453 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:20:41.453 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:41.453 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:41.453 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:20:41.453 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:20:41.453 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:41 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: purged_snaps scrub starts 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: purged_snaps scrub ok 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: from='client.14210 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial022:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: osd.default does not exist. Creating it now. 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: Creating OSDs with service ID: default on trial022:['vg_nvme/lv_3'] 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: Marking host: trial022 for OSDSpec preview refresh. 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: Saving service osd.default spec with placement trial022 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: osd.0 [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613] boot 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: osdmap e9: 1 total, 1 up, 1 in 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3694023357' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca12e232-92e2-4ceb-a1ed-5a9001d238ab"} : dispatch 2026-02-24T07:20:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3694023357' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca12e232-92e2-4ceb-a1ed-5a9001d238ab"}]': finished 2026-02-24T07:20:42.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: osdmap e10: 2 total, 1 up, 2 in 2026-02-24T07:20:42.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:20:42.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1064424793' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T07:20:43.458 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:43 trial022 ceph-mon[39108]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T07:20:44.907 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:44 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:44.907 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:44 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:44.907 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:44 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:44.907 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:44 trial022 ceph-mon[39108]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T07:20:44.907 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:44 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-24T07:20:44.907 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:44 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:44.908 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:44 trial022 ceph-mon[39108]: Deploying daemon osd.1 on trial022 2026-02-24T07:20:44.908 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:44 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:44.908 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:44 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:46.870 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:46.871 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:46.871 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T07:20:46.871 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='osd.1 [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-24T07:20:46.871 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:46.871 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:46.871 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:46.871 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:46.871 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:46.871 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:20:46.871 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:46.872 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:20:46.872 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:20:46.872 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:46 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:47.177 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.175+0000 7fb4d6ffd640 1 -- 10.20.193.22:0/2598910138 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (crc 0 0 0) 0x7fb4e811e8d0 con 0x7fb4c403f8c0 2026-02-24T07:20:47.178 INFO:teuthology.orchestra.run.trial022.stdout:Created osd(s) 1 on host 'trial022' 2026-02-24T07:20:47.180 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.178+0000 7fb4efee4640 1 -- 10.20.193.22:0/2598910138 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb4c403f8c0 msgr2=0x7fb4c405fd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:47.180 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.178+0000 7fb4efee4640 1 --2- 10.20.193.22:0/2598910138 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb4c403f8c0 0x7fb4c405fd70 crc :-1 s=READY pgs=28 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:47.180 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.178+0000 7fb4efee4640 1 -- 10.20.193.22:0/2598910138 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb4e810e960 msgr2=0x7fb4e811c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:47.180 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.178+0000 7fb4efee4640 1 --2- 10.20.193.22:0/2598910138 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb4e810e960 0x7fb4e811c8f0 crc :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:47.180 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.178+0000 7fb4efee4640 1 -- 10.20.193.22:0/2598910138 shutdown_connections 2026-02-24T07:20:47.181 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.178+0000 7fb4efee4640 1 --2- 10.20.193.22:0/2598910138 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb4c403f8c0 0x7fb4c405fd70 unknown :-1 s=CLOSED pgs=28 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:47.181 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.178+0000 7fb4efee4640 1 --2- 10.20.193.22:0/2598910138 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb4e810e960 0x7fb4e811c8f0 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:47.181 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.178+0000 7fb4efee4640 1 -- 10.20.193.22:0/2598910138 >> 10.20.193.22:0/2598910138 conn(0x7fb4e80ec0d0 msgr2=0x7fb4e810c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:47.181 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.178+0000 7fb4efee4640 1 -- 10.20.193.22:0/2598910138 shutdown_connections 2026-02-24T07:20:47.181 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:20:47.178+0000 7fb4efee4640 1 -- 10.20.193.22:0/2598910138 wait complete. 2026-02-24T07:20:47.216 DEBUG:teuthology.orchestra.run.trial022:osd.1> sudo journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.1.service 2026-02-24T07:20:47.219 INFO:tasks.cephadm:Deploying osd.2 on trial195 with /dev/vg_nvme/lv_4... 2026-02-24T07:20:47.220 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-24T07:20:47.339 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:20:47.888 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:20:47.904 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch daemon add osd trial195:vg_nvme/lv_4 --skip-validation 2026-02-24T07:20:47.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:47 trial022 ceph-mon[39108]: Detected new or changed devices on trial022 2026-02-24T07:20:47.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:47 trial022 ceph-mon[39108]: from='osd.1 [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-24T07:20:47.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:47 trial022 ceph-mon[39108]: osdmap e11: 2 total, 1 up, 2 in 2026-02-24T07:20:47.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:47 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:20:47.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:47 trial022 ceph-mon[39108]: from='osd.1 [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial022", "root=default"]} : dispatch 2026-02-24T07:20:47.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:47 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:47.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:47 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:47.992 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:20:47 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1[62997]: 2026-02-24T07:20:47.817+0000 7fd97bab6640 -1 osd.1 0 waiting for initial osdmap 2026-02-24T07:20:47.992 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:20:47 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1[62997]: 2026-02-24T07:20:47.819+0000 7fd97797d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T07:20:48.054 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:20:48.166 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f23127fc640 1 -- 10.20.193.195:0/305048096 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f230000dbe0 con 0x7f231410e830 2026-02-24T07:20:48.166 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:48.166 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 1 -- 10.20.193.195:0/305048096 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f231410e830 msgr2=0x7f231410ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 1 --2- 10.20.193.195:0/305048096 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f231410e830 0x7f231410ec20 crc :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=8717461124863098793 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 1 -- 10.20.193.195:0/305048096 shutdown_connections 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 1 --2- 10.20.193.195:0/305048096 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f231410e830 0x7f231410ec20 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=8717461124863098793 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 1 -- 10.20.193.195:0/305048096 >> 10.20.193.195:0/305048096 conn(0x7f23140ebf80 msgr2=0x7f231410c390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 1 -- 10.20.193.195:0/305048096 shutdown_connections 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 1 -- 10.20.193.195:0/305048096 wait complete. 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 1 Processor -- start 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.164+0000 7f2319edc640 1 -- start start 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f2319edc640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f231410e830 0x7f231411c7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:48.167 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f2319edc640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f231411cd20 con 0x7f231410e830 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f23137fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f231410e830 0x7f231411c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f23137fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f231410e830 0x7f231411c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.195:59688/0 (socket says 10.20.193.195:59688) 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f23137fe640 1 -- 10.20.193.195:0/2378243885 learned_addr learned my addr 10.20.193.195:0/2378243885 (peer_addr_for_me v2:10.20.193.195:0/0) 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f23137fe640 1 -- 10.20.193.195:0/2378243885 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231411ce60 con 0x7f231410e830 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f23137fe640 1 --2- 10.20.193.195:0/2378243885 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f231410e830 0x7f231411c7c0 crc :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f2310ff9640 1 -- 10.20.193.195:0/2378243885 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f230000d690 con 0x7f231410e830 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f2319edc640 1 -- 10.20.193.195:0/2378243885 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231411d0b0 con 0x7f231410e830 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f2310ff9640 1 -- 10.20.193.195:0/2378243885 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f230000d7f0 con 0x7f231410e830 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f2319edc640 1 -- 10.20.193.195:0/2378243885 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231411da20 con 0x7f231410e830 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.165+0000 7f2310ff9640 1 -- 10.20.193.195:0/2378243885 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f2300016040 con 0x7f231410e830 2026-02-24T07:20:48.168 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.166+0000 7f2319edc640 1 -- 10.20.193.195:0/2378243885 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23141321f0 con 0x7f231410e830 2026-02-24T07:20:48.169 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.166+0000 7f2310ff9640 1 -- 10.20.193.195:0/2378243885 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7f230000f6b0 con 0x7f231410e830 2026-02-24T07:20:48.169 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.166+0000 7f2310ff9640 1 --2- 10.20.193.195:0/2378243885 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f22e803f890 0x7f22e805fd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:48.169 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.166+0000 7f2310ff9640 1 -- 10.20.193.195:0/2378243885 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 1934+0+0 (crc 0 0 0) 0x7f2300051e30 con 0x7f231410e830 2026-02-24T07:20:48.169 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.166+0000 7f2312ffd640 1 --2- 10.20.193.195:0/2378243885 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f22e803f890 0x7f22e805fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:48.169 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.167+0000 7f2312ffd640 1 --2- 10.20.193.195:0/2378243885 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f22e803f890 0x7f22e805fd40 crc :-1 s=READY pgs=33 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:48.170 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.168+0000 7f2310ff9640 1 -- 10.20.193.195:0/2378243885 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f2300007810 con 0x7f231410e830 2026-02-24T07:20:48.276 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:48.277+0000 7f2319edc640 1 -- 10.20.193.195:0/2378243885 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial195:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f231411e7a0 con 0x7f22e803f890 2026-02-24T07:20:49.152 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='osd.1 [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial022", "root=default"]}]': finished 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: osdmap e12: 2 total, 1 up, 2 in 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='client.14219 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial195:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: osd.default does not exist. Creating it now. 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: Creating OSDs with service ID: default on trial195:['vg_nvme/lv_4'] 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: Marking host: trial195 for OSDSpec preview refresh. 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: Saving service osd.default spec with placement trial195 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:49.153 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:20:49.154 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:20:49.154 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:49.154 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:49.154 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:49.154 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:49.154 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:49.154 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:48 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:50.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: purged_snaps scrub starts 2026-02-24T07:20:50.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: purged_snaps scrub ok 2026-02-24T07:20:50.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: osd.1 [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904] boot 2026-02-24T07:20:50.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: osdmap e13: 2 total, 2 up, 2 in 2026-02-24T07:20:50.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:20:50.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: from='client.? 10.20.193.195:0/372396383' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2931f5f7-673d-40d3-bf7a-fd6bc2e0c0d5"} : dispatch 2026-02-24T07:20:50.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: from='client.? 10.20.193.195:0/372396383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2931f5f7-673d-40d3-bf7a-fd6bc2e0c0d5"}]': finished 2026-02-24T07:20:50.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: osdmap e14: 3 total, 2 up, 3 in 2026-02-24T07:20:50.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:20:50.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:50.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:50.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:49 trial022 ceph-mon[39108]: from='client.? 10.20.193.195:0/2128541836' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T07:20:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: Adjusting osd_memory_target on trial022 to 42023M 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: osdmap e15: 3 total, 2 up, 3 in 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:20:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:50 trial022 ceph-mon[39108]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T07:20:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:52 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T07:20:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:52 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:52.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:52 trial022 ceph-mon[39108]: Deploying daemon osd.2 on trial195 2026-02-24T07:20:52.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:52 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-24T07:20:52.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:52 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:52.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:52 trial022 ceph-mon[39108]: Deploying daemon osd.2 on trial195 2026-02-24T07:20:53.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:53 trial022 ceph-mon[39108]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T07:20:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:54 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:54 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:55 trial022 ceph-mon[39108]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T07:20:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:55 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:55 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:55.550 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.550+0000 7f2310ff9640 1 -- 10.20.193.195:0/2378243885 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (crc 0 0 0) 0x7f231411e7a0 con 0x7f22e803f890 2026-02-24T07:20:55.550 INFO:teuthology.orchestra.run.trial195.stdout:Created osd(s) 2 on host 'trial195' 2026-02-24T07:20:55.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.552+0000 7f2319edc640 1 -- 10.20.193.195:0/2378243885 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f22e803f890 msgr2=0x7f22e805fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:55.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.552+0000 7f2319edc640 1 --2- 10.20.193.195:0/2378243885 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f22e803f890 0x7f22e805fd40 crc :-1 s=READY pgs=33 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:55.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.552+0000 7f2319edc640 1 -- 10.20.193.195:0/2378243885 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f231410e830 msgr2=0x7f231411c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:55.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.552+0000 7f2319edc640 1 --2- 10.20.193.195:0/2378243885 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f231410e830 0x7f231411c7c0 crc :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:55.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.552+0000 7f2319edc640 1 -- 10.20.193.195:0/2378243885 shutdown_connections 2026-02-24T07:20:55.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.552+0000 7f2319edc640 1 --2- 10.20.193.195:0/2378243885 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f22e803f890 0x7f22e805fd40 unknown :-1 s=CLOSED pgs=33 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:55.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.552+0000 7f2319edc640 1 --2- 10.20.193.195:0/2378243885 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f231410e830 0x7f231411c7c0 unknown :-1 s=CLOSED pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:55.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.552+0000 7f2319edc640 1 -- 10.20.193.195:0/2378243885 >> 10.20.193.195:0/2378243885 conn(0x7f23140ebf80 msgr2=0x7f231410c360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:55.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.552+0000 7f2319edc640 1 -- 10.20.193.195:0/2378243885 shutdown_connections 2026-02-24T07:20:55.552 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:55.552+0000 7f2319edc640 1 -- 10.20.193.195:0/2378243885 wait complete. 2026-02-24T07:20:55.593 DEBUG:teuthology.orchestra.run.trial195:osd.2> sudo journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.2.service 2026-02-24T07:20:55.595 INFO:tasks.cephadm:Deploying osd.3 on trial195 with /dev/vg_nvme/lv_3... 2026-02-24T07:20:55.595 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-24T07:20:55.754 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:20:55.776 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:20:55 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2[47154]: 2026-02-24T07:20:55.641+0000 7f53c991e780 -1 osd.2 0 log_to_monitors true 2026-02-24T07:20:56.529 INFO:teuthology.orchestra.run.trial195.stdout: 2026-02-24T07:20:56.548 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch daemon add osd trial195:vg_nvme/lv_3 --skip-validation 2026-02-24T07:20:56.668 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:20:56.769 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:56.769 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 1 -- 10.20.193.195:0/3072467316 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f020410e830 msgr2=0x7f020410ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:20:56.769 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 1 --2- 10.20.193.195:0/3072467316 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f020410e830 0x7f020410ec20 crc :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=10328983744088591963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:56.769 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 1 -- 10.20.193.195:0/3072467316 shutdown_connections 2026-02-24T07:20:56.769 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 1 --2- 10.20.193.195:0/3072467316 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f020410e830 0x7f020410ec20 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=10328983744088591963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 1 -- 10.20.193.195:0/3072467316 >> 10.20.193.195:0/3072467316 conn(0x7f02040ebf80 msgr2=0x7f020410c390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 1 -- 10.20.193.195:0/3072467316 shutdown_connections 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 1 -- 10.20.193.195:0/3072467316 wait complete. 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 1 Processor -- start 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.770+0000 7f020b21f640 1 -- start start 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.771+0000 7f020b21f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f020410e830 0x7f020411c7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.771+0000 7f020b21f640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f020411cd20 con 0x7f020410e830 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.771+0000 7f0208f94640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f020410e830 0x7f020411c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.771+0000 7f0208f94640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f020410e830 0x7f020411c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.195:49528/0 (socket says 10.20.193.195:49528) 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.771+0000 7f0208f94640 1 -- 10.20.193.195:0/2470043890 learned_addr learned my addr 10.20.193.195:0/2470043890 (peer_addr_for_me v2:10.20.193.195:0/0) 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.771+0000 7f0208f94640 1 -- 10.20.193.195:0/2470043890 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020411ce60 con 0x7f020410e830 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.771+0000 7f0208f94640 1 --2- 10.20.193.195:0/2470043890 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f020410e830 0x7f020411c7c0 crc :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.771+0000 7f01f9ffb640 1 -- 10.20.193.195:0/2470043890 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f01f400d690 con 0x7f020410e830 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.771+0000 7f020b21f640 1 -- 10.20.193.195:0/2470043890 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020411d0b0 con 0x7f020410e830 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.771+0000 7f020b21f640 1 -- 10.20.193.195:0/2470043890 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020411da20 con 0x7f020410e830 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.772+0000 7f01f9ffb640 1 -- 10.20.193.195:0/2470043890 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f01f400d7f0 con 0x7f020410e830 2026-02-24T07:20:56.770 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.772+0000 7f01f9ffb640 1 -- 10.20.193.195:0/2470043890 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f01f400fd70 con 0x7f020410e830 2026-02-24T07:20:56.771 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.772+0000 7f020b21f640 1 -- 10.20.193.195:0/2470043890 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02041321f0 con 0x7f020410e830 2026-02-24T07:20:56.771 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.772+0000 7f01f9ffb640 1 -- 10.20.193.195:0/2470043890 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 13) ==== 52870+0+0 (crc 0 0 0) 0x7f01f40026a0 con 0x7f020410e830 2026-02-24T07:20:56.771 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.773+0000 7f01f9ffb640 1 --2- 10.20.193.195:0/2470043890 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f01e003f8e0 0x7f01e005fd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:20:56.771 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.773+0000 7f01f9ffb640 1 -- 10.20.193.195:0/2470043890 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2350+0+0 (crc 0 0 0) 0x7f01f40520d0 con 0x7f020410e830 2026-02-24T07:20:56.771 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.773+0000 7f01fbfff640 1 --2- 10.20.193.195:0/2470043890 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f01e003f8e0 0x7f01e005fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:20:56.771 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.773+0000 7f01fbfff640 1 --2- 10.20.193.195:0/2470043890 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f01e003f8e0 0x7f01e005fd90 crc :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:20:56.773 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.775+0000 7f01f9ffb640 1 -- 10.20.193.195:0/2470043890 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f01f4009520 con 0x7f020410e830 2026-02-24T07:20:56.885 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:20:56.886+0000 7f020b21f640 1 -- 10.20.193.195:0/2470043890 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial195:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f020411e6e0 con 0x7f01e003f8e0 2026-02-24T07:20:56.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:56 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:56.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:56 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:56.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:56 trial022 ceph-mon[39108]: from='osd.2 [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-24T07:20:56.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:56 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:56.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:56 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:56.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:56 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:20:56.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:56 trial022 ceph-mon[39108]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T07:20:56.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:56 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:56.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:56 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:57.851 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:20:57 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2[47154]: 2026-02-24T07:20:57.553+0000 7f53c58a0640 -1 osd.2 0 waiting for initial osdmap 2026-02-24T07:20:57.851 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:20:57 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2[47154]: 2026-02-24T07:20:57.556+0000 7f53c1767640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T07:20:57.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='osd.2 [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: osdmap e16: 3 total, 2 up, 3 in 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='osd.2 [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial195", "root=default"]} : dispatch 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial195:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: osd.default does not exist. Creating it now. 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: Creating OSDs with service ID: default on trial195:['vg_nvme/lv_3'] 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: Marking host: trial195 for OSDSpec preview refresh. 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: Saving service osd.default spec with placement trial195 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:57.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:20:57.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:20:57.994 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:57 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:20:58.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: Detected new or changed devices on trial195 2026-02-24T07:20:58.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: Adjusting osd_memory_target on trial195 to 89167M 2026-02-24T07:20:58.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: from='osd.2 [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial195", "root=default"]}]': finished 2026-02-24T07:20:58.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: osdmap e17: 3 total, 2 up, 3 in 2026-02-24T07:20:58.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:20:58.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:20:58.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: from='client.? 10.20.193.195:0/2081791035' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b659885f-ccd3-4c7e-abd5-16c32191a9a6"} : dispatch 2026-02-24T07:20:58.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: from='client.? 10.20.193.195:0/2081791035' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b659885f-ccd3-4c7e-abd5-16c32191a9a6"}]': finished 2026-02-24T07:20:58.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: osd.2 [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938] boot 2026-02-24T07:20:58.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: osdmap e18: 4 total, 3 up, 4 in 2026-02-24T07:20:58.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:20:58.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:20:58.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T07:20:58.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: from='client.? 10.20.193.195:0/3965400928' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-24T07:20:58.993 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:58 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:20:59.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:59 trial022 ceph-mon[39108]: purged_snaps scrub starts 2026-02-24T07:20:59.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:59 trial022 ceph-mon[39108]: purged_snaps scrub ok 2026-02-24T07:20:59.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:59 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-24T07:20:59.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:59 trial022 ceph-mon[39108]: osdmap e19: 4 total, 3 up, 4 in 2026-02-24T07:20:59.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:59 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:20:59.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:20:59 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-24T07:21:00.717 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:21:00 trial195 sudo[53898]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T07:21:00.717 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:21:00 trial195 sudo[53898]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:21:00.717 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:21:00 trial195 sudo[53898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:21:00.717 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:21:00 trial195 sudo[53898]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:21:00.717 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:21:00 trial195 sudo[53916]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T07:21:00.717 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:21:00 trial195 sudo[53916]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:21:00.718 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:21:00 trial195 sudo[53916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:21:00.718 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:21:00 trial195 sudo[53916]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:21:00.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71602]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-24T07:21:00.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71602]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:21:00.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:21:00.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71602]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:21:00.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71606]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-24T07:21:00.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71606]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:21:00.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:21:00.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71606]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:21:00.993 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71594]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T07:21:00.993 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71594]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:21:00.993 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:21:00.993 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71594]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:21:00.993 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71598]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T07:21:00.993 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71598]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:21:00.993 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:21:00.993 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71598]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:21:00.993 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71586]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-24T07:21:00.994 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71586]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:21:00.994 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:21:00.994 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71586]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:21:00.994 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71590]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-24T07:21:00.994 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71590]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-24T07:21:00.994 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-24T07:21:00.994 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:21:00 trial022 sudo[71590]: pam_unix(sudo:session): session closed for user root 2026-02-24T07:21:01.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-24T07:21:01.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: osdmap e20: 4 total, 3 up, 4 in 2026-02-24T07:21:01.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:21:01.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T07:21:01.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:21:01.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: Deploying daemon osd.3 on trial195 2026-02-24T07:21:01.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: pgmap v31: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T07:21:01.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-24T07:21:01.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:21:01.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: Deploying daemon osd.3 on trial195 2026-02-24T07:21:01.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:01.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:01.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-24T07:21:01.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-24T07:21:01.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T07:21:01.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:01 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:02 trial022 ceph-mon[39108]: osdmap e21: 4 total, 3 up, 4 in 2026-02-24T07:21:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:02 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:21:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:02 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:02.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:02 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:03.037 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:03.037+0000 7f01f9ffb640 1 -- 10.20.193.195:0/2470043890 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f01f400e5c0 con 0x7f020410e830 2026-02-24T07:21:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:03 trial022 ceph-mon[39108]: pgmap v33: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T07:21:04.217 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.218+0000 7f01f9ffb640 1 -- 10.20.193.195:0/2470043890 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (crc 0 0 0) 0x7f020411e6e0 con 0x7f01e003f8e0 2026-02-24T07:21:04.217 INFO:teuthology.orchestra.run.trial195.stdout:Created osd(s) 3 on host 'trial195' 2026-02-24T07:21:04.220 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.221+0000 7f020b21f640 1 -- 10.20.193.195:0/2470043890 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f01e003f8e0 msgr2=0x7f01e005fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:04.220 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.221+0000 7f020b21f640 1 --2- 10.20.193.195:0/2470043890 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f01e003f8e0 0x7f01e005fd90 crc :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:04.220 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.221+0000 7f020b21f640 1 -- 10.20.193.195:0/2470043890 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f020410e830 msgr2=0x7f020411c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:04.220 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.221+0000 7f020b21f640 1 --2- 10.20.193.195:0/2470043890 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f020410e830 0x7f020411c7c0 crc :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:04.221 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.221+0000 7f020b21f640 1 -- 10.20.193.195:0/2470043890 shutdown_connections 2026-02-24T07:21:04.221 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.221+0000 7f020b21f640 1 --2- 10.20.193.195:0/2470043890 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f01e003f8e0 0x7f01e005fd90 unknown :-1 s=CLOSED pgs=38 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:04.221 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.221+0000 7f020b21f640 1 --2- 10.20.193.195:0/2470043890 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f020410e830 0x7f020411c7c0 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:04.221 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.221+0000 7f020b21f640 1 -- 10.20.193.195:0/2470043890 >> 10.20.193.195:0/2470043890 conn(0x7f02040ebf80 msgr2=0x7f020410c360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:04.221 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.221+0000 7f020b21f640 1 -- 10.20.193.195:0/2470043890 shutdown_connections 2026-02-24T07:21:04.221 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:04.221+0000 7f020b21f640 1 -- 10.20.193.195:0/2470043890 wait complete. 2026-02-24T07:21:04.259 DEBUG:teuthology.orchestra.run.trial195:osd.3> sudo journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.3.service 2026-02-24T07:21:04.262 INFO:tasks.cephadm:Waiting for 4 OSDs to come up... 2026-02-24T07:21:04.262 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T07:21:04.288 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:04 trial022 ceph-mon[39108]: mgrmap e14: x(active, since 44s) 2026-02-24T07:21:04.288 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:04 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:04.288 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:04 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:04.384 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.489+0000 7ff1eaff2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.489+0000 7ff1eaff2640 1 -- 10.20.193.22:0/891852823 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff1e4062940 msgr2=0x7ff1e4060fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.489+0000 7ff1eaff2640 1 --2- 10.20.193.22:0/891852823 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff1e4062940 0x7ff1e4060fd0 crc :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=4829420086487757542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.489+0000 7ff1eaff2640 1 -- 10.20.193.22:0/891852823 shutdown_connections 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.489+0000 7ff1eaff2640 1 --2- 10.20.193.22:0/891852823 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff1e4062940 0x7ff1e4060fd0 unknown :-1 s=CLOSED pgs=148 gs=1 cs=0 l=1 c_cookie=4829420086487757542 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.489+0000 7ff1eaff2640 1 -- 10.20.193.22:0/891852823 >> 10.20.193.22:0/891852823 conn(0x7ff1e40ea270 msgr2=0x7ff1e410a680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.489+0000 7ff1eaff2640 1 -- 10.20.193.22:0/891852823 shutdown_connections 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.489+0000 7ff1eaff2640 1 -- 10.20.193.22:0/891852823 wait complete. 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1eaff2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1eaff2640 1 Processor -- start 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1eaff2640 1 -- start start 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1eaff2640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff1e4062940 0x7ff1e411c570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1eaff2640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e411cad0 con 0x7ff1e4062940 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1e8d67640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff1e4062940 0x7ff1e411c570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1e8d67640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff1e4062940 0x7ff1e411c570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46552/0 (socket says 10.20.193.22:46552) 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1e8d67640 1 -- 10.20.193.22:0/2447772745 learned_addr learned my addr 10.20.193.22:0/2447772745 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1e8d67640 1 -- 10.20.193.22:0/2447772745 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e411cc10 con 0x7ff1e4062940 2026-02-24T07:21:04.493 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1e8d67640 1 --2- 10.20.193.22:0/2447772745 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff1e4062940 0x7ff1e411c570 crc :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1d9ffb640 1 -- 10.20.193.22:0/2447772745 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff1d400d690 con 0x7ff1e4062940 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1eaff2640 1 -- 10.20.193.22:0/2447772745 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e411ce60 con 0x7ff1e4062940 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1d9ffb640 1 -- 10.20.193.22:0/2447772745 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7ff1d400d7f0 con 0x7ff1e4062940 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1d9ffb640 1 -- 10.20.193.22:0/2447772745 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff1d400fd70 con 0x7ff1e4062940 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.490+0000 7ff1eaff2640 1 -- 10.20.193.22:0/2447772745 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e411d7d0 con 0x7ff1e4062940 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.491+0000 7ff1eaff2640 1 -- 10.20.193.22:0/2447772745 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e405f3f0 con 0x7ff1e4062940 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.491+0000 7ff1d9ffb640 1 -- 10.20.193.22:0/2447772745 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7ff1d400f6b0 con 0x7ff1e4062940 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.491+0000 7ff1d9ffb640 1 --2- 10.20.193.22:0/2447772745 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff1c003f970 0x7ff1c005fe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.491+0000 7ff1d9ffb640 1 -- 10.20.193.22:0/2447772745 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3258+0+0 (crc 0 0 0) 0x7ff1d40524b0 con 0x7ff1e4062940 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.491+0000 7ff1dbfff640 1 --2- 10.20.193.22:0/2447772745 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff1c003f970 0x7ff1c005fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:04.494 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.492+0000 7ff1dbfff640 1 --2- 10.20.193.22:0/2447772745 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff1c003f970 0x7ff1c005fe20 crc :-1 s=READY pgs=44 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:04.495 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.493+0000 7ff1d9ffb640 1 -- 10.20.193.22:0/2447772745 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7ff1d40071c0 con 0x7ff1e4062940 2026-02-24T07:21:04.601 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.599+0000 7ff1eaff2640 1 -- 10.20.193.22:0/2447772745 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff1e405f600 con 0x7ff1e4062940 2026-02-24T07:21:04.601 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.599+0000 7ff1d9ffb640 1 -- 10.20.193.22:0/2447772745 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v21) ==== 74+0+130 (crc 0 0 0) 0x7ff1d40071c0 con 0x7ff1e4062940 2026-02-24T07:21:04.601 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:04.603 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.600+0000 7ff1eaff2640 1 -- 10.20.193.22:0/2447772745 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff1c003f970 msgr2=0x7ff1c005fe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:04.603 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.600+0000 7ff1eaff2640 1 --2- 10.20.193.22:0/2447772745 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff1c003f970 0x7ff1c005fe20 crc :-1 s=READY pgs=44 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:04.603 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.600+0000 7ff1eaff2640 1 -- 10.20.193.22:0/2447772745 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff1e4062940 msgr2=0x7ff1e411c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:04.603 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.600+0000 7ff1eaff2640 1 --2- 10.20.193.22:0/2447772745 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff1e4062940 0x7ff1e411c570 crc :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:04.603 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.600+0000 7ff1eaff2640 1 -- 10.20.193.22:0/2447772745 shutdown_connections 2026-02-24T07:21:04.603 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.600+0000 7ff1eaff2640 1 --2- 10.20.193.22:0/2447772745 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff1c003f970 0x7ff1c005fe20 unknown :-1 s=CLOSED pgs=44 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:04.603 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.600+0000 7ff1eaff2640 1 --2- 10.20.193.22:0/2447772745 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff1e4062940 0x7ff1e411c570 unknown :-1 s=CLOSED pgs=149 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:04.604 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.600+0000 7ff1eaff2640 1 -- 10.20.193.22:0/2447772745 >> 10.20.193.22:0/2447772745 conn(0x7ff1e40ea270 msgr2=0x7ff1e410a650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:04.604 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.600+0000 7ff1eaff2640 1 -- 10.20.193.22:0/2447772745 shutdown_connections 2026-02-24T07:21:04.604 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:04.600+0000 7ff1eaff2640 1 -- 10.20.193.22:0/2447772745 wait complete. 2026-02-24T07:21:04.639 INFO:teuthology.orchestra.run.trial022.stdout:{"epoch":21,"num_osds":4,"num_up_osds":3,"osd_up_since":1771917658,"num_in_osds":4,"osd_in_since":1771917658,"num_remapped_pgs":0} 2026-02-24T07:21:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:05 trial022 ceph-mon[39108]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T07:21:05.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:05 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:05.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:05 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:05.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:05 trial022 ceph-mon[39108]: from='osd.3 [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-24T07:21:05.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:05 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2447772745' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T07:21:05.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:05 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:05.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:05 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:05.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:05 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:21:05.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:05 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:05.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:05 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:05.641 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T07:21:05.759 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:05.859 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.854+0000 7f33608bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:05.859 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 -- 10.20.193.22:0/3884708973 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f335810ed90 msgr2=0x7f335810f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:05.859 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 --2- 10.20.193.22:0/3884708973 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f335810ed90 0x7f335810f180 crc :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=11766666504430627195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:05.859 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 -- 10.20.193.22:0/3884708973 shutdown_connections 2026-02-24T07:21:05.859 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 --2- 10.20.193.22:0/3884708973 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f335810ed90 0x7f335810f180 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=11766666504430627195 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:05.859 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 -- 10.20.193.22:0/3884708973 >> 10.20.193.22:0/3884708973 conn(0x7f33580ec4e0 msgr2=0x7f335810c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 -- 10.20.193.22:0/3884708973 shutdown_connections 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 -- 10.20.193.22:0/3884708973 wait complete. 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 Processor -- start 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 -- start start 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f335810ed90 0x7f335811cc40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f335811d1a0 con 0x7f335810ed90 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f335e634640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f335810ed90 0x7f335811cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f335e634640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f335810ed90 0x7f335811cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46576/0 (socket says 10.20.193.22:46576) 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f335e634640 1 -- 10.20.193.22:0/2336282861 learned_addr learned my addr 10.20.193.22:0/2336282861 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f335e634640 1 -- 10.20.193.22:0/2336282861 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335811d2e0 con 0x7f335810ed90 2026-02-24T07:21:05.860 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f335e634640 1 --2- 10.20.193.22:0/2336282861 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f335810ed90 0x7f335811cc40 crc :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33437fe640 1 -- 10.20.193.22:0/2336282861 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f335000d690 con 0x7f335810ed90 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33608bf640 1 -- 10.20.193.22:0/2336282861 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335811d530 con 0x7f335810ed90 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.855+0000 7f33437fe640 1 -- 10.20.193.22:0/2336282861 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f335000d7f0 con 0x7f335810ed90 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.856+0000 7f33437fe640 1 -- 10.20.193.22:0/2336282861 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f335000fe70 con 0x7f335810ed90 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.856+0000 7f33608bf640 1 -- 10.20.193.22:0/2336282861 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f335811dea0 con 0x7f335810ed90 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.856+0000 7f33608bf640 1 -- 10.20.193.22:0/2336282861 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335805f3f0 con 0x7f335810ed90 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.856+0000 7f33437fe640 1 -- 10.20.193.22:0/2336282861 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f33500026a0 con 0x7f335810ed90 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.856+0000 7f33437fe640 1 --2- 10.20.193.22:0/2336282861 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f333403f8f0 0x7f333405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.856+0000 7f33437fe640 1 -- 10.20.193.22:0/2336282861 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3279+0+0 (crc 0 0 0) 0x7f3350052670 con 0x7f335810ed90 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.856+0000 7f335de33640 1 --2- 10.20.193.22:0/2336282861 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f333403f8f0 0x7f333405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:05.861 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.857+0000 7f335de33640 1 --2- 10.20.193.22:0/2336282861 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f333403f8f0 0x7f333405fda0 crc :-1 s=READY pgs=45 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:05.862 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.859+0000 7f33437fe640 1 -- 10.20.193.22:0/2336282861 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f335000e5c0 con 0x7f335810ed90 2026-02-24T07:21:05.965 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.963+0000 7f33608bf640 1 -- 10.20.193.22:0/2336282861 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f335805f600 con 0x7f335810ed90 2026-02-24T07:21:05.966 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.964+0000 7f33437fe640 1 -- 10.20.193.22:0/2336282861 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v22) ==== 74+0+130 (crc 0 0 0) 0x7f33500077f0 con 0x7f335810ed90 2026-02-24T07:21:05.966 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:05.967 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.965+0000 7f33608bf640 1 -- 10.20.193.22:0/2336282861 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f333403f8f0 msgr2=0x7f333405fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:05.967 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.965+0000 7f33608bf640 1 --2- 10.20.193.22:0/2336282861 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f333403f8f0 0x7f333405fda0 crc :-1 s=READY pgs=45 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:05.967 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.965+0000 7f33608bf640 1 -- 10.20.193.22:0/2336282861 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f335810ed90 msgr2=0x7f335811cc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:05.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.965+0000 7f33608bf640 1 --2- 10.20.193.22:0/2336282861 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f335810ed90 0x7f335811cc40 crc :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:05.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.965+0000 7f33608bf640 1 -- 10.20.193.22:0/2336282861 shutdown_connections 2026-02-24T07:21:05.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.965+0000 7f33608bf640 1 --2- 10.20.193.22:0/2336282861 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f333403f8f0 0x7f333405fda0 unknown :-1 s=CLOSED pgs=45 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:05.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.965+0000 7f33608bf640 1 --2- 10.20.193.22:0/2336282861 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f335810ed90 0x7f335811cc40 unknown :-1 s=CLOSED pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:05.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.965+0000 7f33608bf640 1 -- 10.20.193.22:0/2336282861 >> 10.20.193.22:0/2336282861 conn(0x7f33580ec4e0 msgr2=0x7f335810c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:05.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.965+0000 7f33608bf640 1 -- 10.20.193.22:0/2336282861 shutdown_connections 2026-02-24T07:21:05.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:05.965+0000 7f33608bf640 1 -- 10.20.193.22:0/2336282861 wait complete. 2026-02-24T07:21:06.001 INFO:teuthology.orchestra.run.trial022.stdout:{"epoch":22,"num_osds":4,"num_up_osds":3,"osd_up_since":1771917658,"num_in_osds":4,"osd_in_since":1771917658,"num_remapped_pgs":0} 2026-02-24T07:21:06.284 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:21:06 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3[55260]: 2026-02-24T07:21:06.222+0000 7f2af6172640 -1 osd.3 0 waiting for initial osdmap 2026-02-24T07:21:06.285 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:21:06 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3[55260]: 2026-02-24T07:21:06.225+0000 7f2aee031640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T07:21:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='osd.3 [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-24T07:21:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: osdmap e22: 4 total, 3 up, 4 in 2026-02-24T07:21:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='osd.3 [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial195", "root=default"]} : dispatch 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2336282861' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:21:06.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-24T07:21:06.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:06 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:21:07.003 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd stat -f json 2026-02-24T07:21:07.118 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1668940000 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8b0810e960 msgr2=0x7f8b0810ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 1 --2- 10.20.193.22:0/1668940000 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8b0810e960 0x7f8b0810ed50 crc :-1 s=READY pgs=152 gs=1 cs=0 l=1 c_cookie=5707215127281162346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1668940000 shutdown_connections 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 1 --2- 10.20.193.22:0/1668940000 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8b0810e960 0x7f8b0810ed50 unknown :-1 s=CLOSED pgs=152 gs=1 cs=0 l=1 c_cookie=5707215127281162346 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1668940000 >> 10.20.193.22:0/1668940000 conn(0x7f8b080ec0d0 msgr2=0x7f8b0810c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1668940000 shutdown_connections 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1668940000 wait complete. 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 1 Processor -- start 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.214+0000 7f8b0cf04640 1 -- start start 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8b0cf04640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8b0810e960 0x7f8b0811c7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8b0cf04640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0811cd30 con 0x7f8b0810e960 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8b06575640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8b0810e960 0x7f8b0811c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8b06575640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8b0810e960 0x7f8b0811c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46602/0 (socket says 10.20.193.22:46602) 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8b06575640 1 -- 10.20.193.22:0/1864285395 learned_addr learned my addr 10.20.193.22:0/1864285395 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8b06575640 1 -- 10.20.193.22:0/1864285395 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0811ce70 con 0x7f8b0810e960 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8b06575640 1 --2- 10.20.193.22:0/1864285395 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8b0810e960 0x7f8b0811c7d0 crc :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:07.216 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8aef7fe640 1 -- 10.20.193.22:0/1864285395 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f8afc00d690 con 0x7f8b0810e960 2026-02-24T07:21:07.217 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1864285395 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0811d0c0 con 0x7f8b0810e960 2026-02-24T07:21:07.217 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8aef7fe640 1 -- 10.20.193.22:0/1864285395 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f8afc00d7f0 con 0x7f8b0810e960 2026-02-24T07:21:07.217 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8aef7fe640 1 -- 10.20.193.22:0/1864285395 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f8afc00fd70 con 0x7f8b0810e960 2026-02-24T07:21:07.217 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.215+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1864285395 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0811da30 con 0x7f8b0810e960 2026-02-24T07:21:07.217 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.216+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1864285395 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b08132320 con 0x7f8b0810e960 2026-02-24T07:21:07.217 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.216+0000 7f8aef7fe640 1 -- 10.20.193.22:0/1864285395 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f8afc00f6b0 con 0x7f8b0810e960 2026-02-24T07:21:07.217 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.216+0000 7f8aef7fe640 1 --2- 10.20.193.22:0/1864285395 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8ae003f920 0x7f8ae005fdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:07.217 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.216+0000 7f8aef7fe640 1 -- 10.20.193.22:0/1864285395 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3295+0+0 (crc 0 0 0) 0x7f8afc0525e0 con 0x7f8b0810e960 2026-02-24T07:21:07.217 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.216+0000 7f8b05d74640 1 --2- 10.20.193.22:0/1864285395 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8ae003f920 0x7f8ae005fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:07.217 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.216+0000 7f8b05d74640 1 --2- 10.20.193.22:0/1864285395 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8ae003f920 0x7f8ae005fdd0 crc :-1 s=READY pgs=47 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:07.220 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.218+0000 7f8aef7fe640 1 -- 10.20.193.22:0/1864285395 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f8afc0071c0 con 0x7f8b0810e960 2026-02-24T07:21:07.323 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.321+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1864285395 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8b0811e7b0 con 0x7f8b0810e960 2026-02-24T07:21:07.323 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:07 trial022 ceph-mon[39108]: Detected new or changed devices on trial195 2026-02-24T07:21:07.323 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:07 trial022 ceph-mon[39108]: Adjusting osd_memory_target on trial195 to 44583M 2026-02-24T07:21:07.324 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:07 trial022 ceph-mon[39108]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T07:21:07.324 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:07 trial022 ceph-mon[39108]: from='osd.3 [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial195", "root=default"]}]': finished 2026-02-24T07:21:07.324 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:07 trial022 ceph-mon[39108]: osdmap e23: 4 total, 3 up, 4 in 2026-02-24T07:21:07.324 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:07 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:21:07.324 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:07 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:21:07.324 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.321+0000 7f8aef7fe640 1 -- 10.20.193.22:0/1864285395 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v24) ==== 74+0+130 (crc 0 0 0) 0x7f8afc0071c0 con 0x7f8b0810e960 2026-02-24T07:21:07.324 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:07.325 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.322+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1864285395 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8ae003f920 msgr2=0x7f8ae005fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:07.325 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.322+0000 7f8b0cf04640 1 --2- 10.20.193.22:0/1864285395 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8ae003f920 0x7f8ae005fdd0 crc :-1 s=READY pgs=47 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.325 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.322+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1864285395 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8b0810e960 msgr2=0x7f8b0811c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:07.325 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.322+0000 7f8b0cf04640 1 --2- 10.20.193.22:0/1864285395 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8b0810e960 0x7f8b0811c7d0 crc :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.325 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.322+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1864285395 shutdown_connections 2026-02-24T07:21:07.325 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.322+0000 7f8b0cf04640 1 --2- 10.20.193.22:0/1864285395 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f8ae003f920 0x7f8ae005fdd0 unknown :-1 s=CLOSED pgs=47 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.325 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.322+0000 7f8b0cf04640 1 --2- 10.20.193.22:0/1864285395 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f8b0810e960 0x7f8b0811c7d0 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.325 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.322+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1864285395 >> 10.20.193.22:0/1864285395 conn(0x7f8b080ec0d0 msgr2=0x7f8b0810c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:07.325 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.322+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1864285395 shutdown_connections 2026-02-24T07:21:07.325 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.322+0000 7f8b0cf04640 1 -- 10.20.193.22:0/1864285395 wait complete. 2026-02-24T07:21:07.378 INFO:teuthology.orchestra.run.trial022.stdout:{"epoch":24,"num_osds":4,"num_up_osds":4,"osd_up_since":1771917667,"num_in_osds":4,"osd_in_since":1771917658,"num_remapped_pgs":1} 2026-02-24T07:21:07.379 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T07:21:07.495 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.595+0000 7fc01f82a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.595+0000 7fc01f82a640 1 -- 10.20.193.22:0/2830599623 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc01810ce60 msgr2=0x7fc01810d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.595+0000 7fc01f82a640 1 --2- 10.20.193.22:0/2830599623 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc01810ce60 0x7fc01810d230 crc :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=5438251136673644952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.595+0000 7fc01f82a640 1 -- 10.20.193.22:0/2830599623 shutdown_connections 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.595+0000 7fc01f82a640 1 --2- 10.20.193.22:0/2830599623 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc01810ce60 0x7fc01810d230 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=5438251136673644952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.595+0000 7fc01f82a640 1 -- 10.20.193.22:0/2830599623 >> 10.20.193.22:0/2830599623 conn(0x7fc0180ea730 msgr2=0x7fc01810ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.595+0000 7fc01f82a640 1 -- 10.20.193.22:0/2830599623 shutdown_connections 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.595+0000 7fc01f82a640 1 -- 10.20.193.22:0/2830599623 wait complete. 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.595+0000 7fc01f82a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.595+0000 7fc01f82a640 1 Processor -- start 2026-02-24T07:21:07.597 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01f82a640 1 -- start start 2026-02-24T07:21:07.598 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01f82a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc01810ce60 0x7fc0180f0c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:07.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01f82a640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc0180f1140 con 0x7fc01810ce60 2026-02-24T07:21:07.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01d59f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc01810ce60 0x7fc0180f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:07.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01d59f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc01810ce60 0x7fc0180f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46616/0 (socket says 10.20.193.22:46616) 2026-02-24T07:21:07.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01d59f640 1 -- 10.20.193.22:0/1783261928 learned_addr learned my addr 10.20.193.22:0/1783261928 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:07.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01d59f640 1 -- 10.20.193.22:0/1783261928 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0180f1280 con 0x7fc01810ce60 2026-02-24T07:21:07.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01d59f640 1 --2- 10.20.193.22:0/1783261928 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc01810ce60 0x7fc0180f0c00 crc :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:07.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc0067fc640 1 -- 10.20.193.22:0/1783261928 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc00800d690 con 0x7fc01810ce60 2026-02-24T07:21:07.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01f82a640 1 -- 10.20.193.22:0/1783261928 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0180f14d0 con 0x7fc01810ce60 2026-02-24T07:21:07.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc0067fc640 1 -- 10.20.193.22:0/1783261928 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fc00800d7f0 con 0x7fc01810ce60 2026-02-24T07:21:07.600 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc0067fc640 1 -- 10.20.193.22:0/1783261928 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc00800fd70 con 0x7fc01810ce60 2026-02-24T07:21:07.600 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01f82a640 1 -- 10.20.193.22:0/1783261928 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0180f6300 con 0x7fc01810ce60 2026-02-24T07:21:07.600 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.596+0000 7fc01f82a640 1 -- 10.20.193.22:0/1783261928 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01810e140 con 0x7fc01810ce60 2026-02-24T07:21:07.600 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.597+0000 7fc0067fc640 1 -- 10.20.193.22:0/1783261928 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7fc0080026a0 con 0x7fc01810ce60 2026-02-24T07:21:07.600 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.597+0000 7fc0067fc640 1 --2- 10.20.193.22:0/1783261928 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbff403f920 0x7fbff405fdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:07.600 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.597+0000 7fc0067fc640 1 -- 10.20.193.22:0/1783261928 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3608+0+0 (crc 0 0 0) 0x7fc008052710 con 0x7fc01810ce60 2026-02-24T07:21:07.600 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.597+0000 7fc01cd9e640 1 --2- 10.20.193.22:0/1783261928 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbff403f920 0x7fbff405fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:07.601 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.597+0000 7fc01cd9e640 1 --2- 10.20.193.22:0/1783261928 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbff403f920 0x7fbff405fdd0 crc :-1 s=READY pgs=49 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:07.601 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.599+0000 7fc0067fc640 1 -- 10.20.193.22:0/1783261928 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fc008015340 con 0x7fc01810ce60 2026-02-24T07:21:07.707 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.705+0000 7fc01f82a640 1 -- 10.20.193.22:0/1783261928 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0181353f0 con 0x7fc01810ce60 2026-02-24T07:21:07.708 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.706+0000 7fc0067fc640 1 -- 10.20.193.22:0/1783261928 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+8663 (crc 0 0 0) 0x7fc008007a50 con 0x7fc01810ce60 2026-02-24T07:21:07.708 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:07.708 INFO:teuthology.orchestra.run.trial022.stdout:{"epoch":24,"fsid":"30400272-1151-11f1-be09-d404e6e7d460","created":"2026-02-24T07:19:58.590745+0000","modified":"2026-02-24T07:21:07.219077+0000","last_up_change":"2026-02-24T07:21:07.219077+0000","last_in_change":"2026-02-24T07:20:58.027518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T07:20:58.403056+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca990aad-309e-4860-89f8-220d9644f458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6802","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6803","nonce":3403491613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6804","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6805","nonce":3403491613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6808","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6809","nonce":3403491613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6806","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6807","nonce":3403491613}]},"public_addr":"10.20.193.22:6803/3403491613","cluster_addr":"10.20.193.22:6805/3403491613","heartbeat_back_addr":"10.20.193.22:6809/3403491613","heartbeat_front_addr":"10.20.193.22:6807/3403491613","state":["exists","up"]},{"osd":1,"uuid":"ca12e232-92e2-4ceb-a1ed-5a9001d238ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6810","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6811","nonce":242124904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6812","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6813","nonce":242124904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6816","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6817","nonce":242124904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6814","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6815","nonce":242124904}]},"public_addr":"10.20.193.22:6811/242124904","cluster_addr":"10.20.193.22:6813/242124904","heartbeat_back_addr":"10.20.193.22:6817/242124904","heartbeat_front_addr":"10.20.193.22:6815/242124904","state":["exists","up"]},{"osd":2,"uuid":"2931f5f7-673d-40d3-bf7a-fd6bc2e0c0d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6800","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6801","nonce":1597504938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6802","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6803","nonce":1597504938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6806","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6807","nonce":1597504938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6804","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6805","nonce":1597504938}]},"public_addr":"10.20.193.195:6801/1597504938","cluster_addr":"10.20.193.195:6803/1597504938","heartbeat_back_addr":"10.20.193.195:6807/1597504938","heartbeat_front_addr":"10.20.193.195:6805/1597504938","state":["exists","up"]},{"osd":3,"uuid":"b659885f-ccd3-4c7e-abd5-16c32191a9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6808","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6809","nonce":3934829113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6810","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6811","nonce":3934829113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6814","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6815","nonce":3934829113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6812","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6813","nonce":3934829113}]},"public_addr":"10.20.193.195:6809/3934829113","cluster_addr":"10.20.193.195:6811/3934829113","heartbeat_back_addr":"10.20.193.195:6815/3934829113","heartbeat_front_addr":"10.20.193.195:6813/3934829113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:20:39.769190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:20:47.514747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:20:56.625083+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"1.0","osds":[0,2,1]}],"primary_temp":[],"blocklist":{"10.20.193.22:0/3439864540":"2026-02-25T07:20:18.196776+0000","10.20.193.22:0/2896310664":"2026-02-25T07:20:18.196776+0000","10.20.193.22:6800/2169717366":"2026-02-25T07:20:18.196776+0000","10.20.193.22:0/125463061":"2026-02-25T07:20:18.196776+0000","10.20.193.22:0/360752884":"2026-02-25T07:20:08.618709+0000","10.20.193.22:0/3319117026":"2026-02-25T07:20:08.618709+0000","10.20.193.22:0/4242395366":"2026-02-25T07:20:08.618709+0000","10.20.193.22:6801/1400318633":"2026-02-25T07:20:08.618709+0000","10.20.193.22:6801/2169717366":"2026-02-25T07:20:18.196776+0000","10.20.193.22:6800/1400318633":"2026-02-25T07:20:08.618709+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T07:21:07.709 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.707+0000 7fc01f82a640 1 -- 10.20.193.22:0/1783261928 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbff403f920 msgr2=0x7fbff405fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:07.709 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.707+0000 7fc01f82a640 1 --2- 10.20.193.22:0/1783261928 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbff403f920 0x7fbff405fdd0 crc :-1 s=READY pgs=49 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.709 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.707+0000 7fc01f82a640 1 -- 10.20.193.22:0/1783261928 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc01810ce60 msgr2=0x7fc0180f0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:07.709 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.707+0000 7fc01f82a640 1 --2- 10.20.193.22:0/1783261928 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc01810ce60 0x7fc0180f0c00 crc :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.709 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.707+0000 7fc01f82a640 1 -- 10.20.193.22:0/1783261928 shutdown_connections 2026-02-24T07:21:07.709 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.707+0000 7fc01f82a640 1 --2- 10.20.193.22:0/1783261928 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbff403f920 0x7fbff405fdd0 unknown :-1 s=CLOSED pgs=49 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.709 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.707+0000 7fc01f82a640 1 --2- 10.20.193.22:0/1783261928 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc01810ce60 0x7fc0180f0c00 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.709 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.707+0000 7fc01f82a640 1 -- 10.20.193.22:0/1783261928 >> 10.20.193.22:0/1783261928 conn(0x7fc0180ea730 msgr2=0x7fc01810b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:07.709 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.707+0000 7fc01f82a640 1 -- 10.20.193.22:0/1783261928 shutdown_connections 2026-02-24T07:21:07.709 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.707+0000 7fc01f82a640 1 -- 10.20.193.22:0/1783261928 wait complete. 2026-02-24T07:21:07.743 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-24T07:20:58.403056+0000', 'flags': 262145, 'flags_names': 'hashpspool,crimson', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.75, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-24T07:21:07.744 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-24T07:21:07.857 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:07.958 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.954+0000 7f4639be8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:07.958 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.954+0000 7f4639be8640 1 -- 10.20.193.22:0/3122646522 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4634060f50 msgr2=0x7f4634061320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:07.958 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.954+0000 7f4639be8640 1 --2- 10.20.193.22:0/3122646522 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4634060f50 0x7f4634061320 crc :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=7256780125033319433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.958 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.954+0000 7f4639be8640 1 -- 10.20.193.22:0/3122646522 shutdown_connections 2026-02-24T07:21:07.959 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.954+0000 7f4639be8640 1 --2- 10.20.193.22:0/3122646522 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4634060f50 0x7f4634061320 unknown :-1 s=CLOSED pgs=156 gs=1 cs=0 l=1 c_cookie=7256780125033319433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:07.959 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.954+0000 7f4639be8640 1 -- 10.20.193.22:0/3122646522 >> 10.20.193.22:0/3122646522 conn(0x7f46340ea740 msgr2=0x7f463410ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:07.959 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.954+0000 7f4639be8640 1 -- 10.20.193.22:0/3122646522 shutdown_connections 2026-02-24T07:21:07.959 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.954+0000 7f4639be8640 1 -- 10.20.193.22:0/3122646522 wait complete. 2026-02-24T07:21:07.959 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f4639be8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:07.959 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f4639be8640 1 Processor -- start 2026-02-24T07:21:07.959 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f4639be8640 1 -- start start 2026-02-24T07:21:07.959 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f4639be8640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4634060f50 0x7f46341177c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:07.959 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f4639be8640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4634117d00 con 0x7f4634060f50 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f46337fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4634060f50 0x7f46341177c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f46337fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4634060f50 0x7f46341177c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46638/0 (socket says 10.20.193.22:46638) 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f46337fe640 1 -- 10.20.193.22:0/49241985 learned_addr learned my addr 10.20.193.22:0/49241985 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f46337fe640 1 -- 10.20.193.22:0/49241985 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4634117e40 con 0x7f4634060f50 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f46337fe640 1 --2- 10.20.193.22:0/49241985 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4634060f50 0x7f46341177c0 crc :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f4630ff9640 1 -- 10.20.193.22:0/49241985 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f462000d690 con 0x7f4634060f50 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f4630ff9640 1 -- 10.20.193.22:0/49241985 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f462000d7f0 con 0x7f4634060f50 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f4639be8640 1 -- 10.20.193.22:0/49241985 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4634118090 con 0x7f4634060f50 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f4630ff9640 1 -- 10.20.193.22:0/49241985 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f462000fd70 con 0x7f4634060f50 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.955+0000 7f4639be8640 1 -- 10.20.193.22:0/49241985 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f463411cec0 con 0x7f4634060f50 2026-02-24T07:21:07.960 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.956+0000 7f4639be8640 1 -- 10.20.193.22:0/49241985 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4634062460 con 0x7f4634060f50 2026-02-24T07:21:07.961 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.956+0000 7f4630ff9640 1 -- 10.20.193.22:0/49241985 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f462000f6b0 con 0x7f4634060f50 2026-02-24T07:21:07.961 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.956+0000 7f4630ff9640 1 --2- 10.20.193.22:0/49241985 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f460803f970 0x7f460805fe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:07.961 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.956+0000 7f4630ff9640 1 -- 10.20.193.22:0/49241985 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3608+0+0 (crc 0 0 0) 0x7f4620052610 con 0x7f4634060f50 2026-02-24T07:21:07.961 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.956+0000 7f4632ffd640 1 --2- 10.20.193.22:0/49241985 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f460803f970 0x7f460805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:07.961 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.956+0000 7f4632ffd640 1 --2- 10.20.193.22:0/49241985 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f460803f970 0x7f460805fe20 crc :-1 s=READY pgs=50 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:07.962 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:07.958+0000 7f4630ff9640 1 -- 10.20.193.22:0/49241985 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f46200071c0 con 0x7f4634060f50 2026-02-24T07:21:08.063 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.062+0000 7f4639be8640 1 -- 10.20.193.22:0/49241985 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f463405f3f0 con 0x7f4634060f50 2026-02-24T07:21:08.063 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.062+0000 7f4630ff9640 1 -- 10.20.193.22:0/49241985 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (crc 0 0 0) 0x7f46200071c0 con 0x7f4634060f50 2026-02-24T07:21:08.063 INFO:teuthology.orchestra.run.trial022.stdout:pg_num: 1 2026-02-24T07:21:08.064 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.063+0000 7f4639be8640 1 -- 10.20.193.22:0/49241985 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f460803f970 msgr2=0x7f460805fe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:08.064 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.063+0000 7f4639be8640 1 --2- 10.20.193.22:0/49241985 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f460803f970 0x7f460805fe20 crc :-1 s=READY pgs=50 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.064 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.063+0000 7f4639be8640 1 -- 10.20.193.22:0/49241985 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4634060f50 msgr2=0x7f46341177c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:08.064 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.063+0000 7f4639be8640 1 --2- 10.20.193.22:0/49241985 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4634060f50 0x7f46341177c0 crc :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.064 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.063+0000 7f4639be8640 1 -- 10.20.193.22:0/49241985 shutdown_connections 2026-02-24T07:21:08.064 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.063+0000 7f4639be8640 1 --2- 10.20.193.22:0/49241985 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f460803f970 0x7f460805fe20 unknown :-1 s=CLOSED pgs=50 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.064 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.063+0000 7f4639be8640 1 --2- 10.20.193.22:0/49241985 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f4634060f50 0x7f46341177c0 unknown :-1 s=CLOSED pgs=157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.064 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.063+0000 7f4639be8640 1 -- 10.20.193.22:0/49241985 >> 10.20.193.22:0/49241985 conn(0x7f46340ea740 msgr2=0x7f463410ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:08.064 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.063+0000 7f4639be8640 1 -- 10.20.193.22:0/49241985 shutdown_connections 2026-02-24T07:21:08.064 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:08.063+0000 7f4639be8640 1 -- 10.20.193.22:0/49241985 wait complete. 2026-02-24T07:21:08.100 INFO:tasks.cephadm:Adding prometheus.a on trial195 2026-02-24T07:21:08.100 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch apply prometheus '1;trial195=a' 2026-02-24T07:21:08.219 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:21:08.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:08.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 -- 10.20.193.195:0/1780315646 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc5e810e8d0 msgr2=0x7fc5e810ecc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:08.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 --2- 10.20.193.195:0/1780315646 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc5e810e8d0 0x7fc5e810ecc0 crc :-1 s=READY pgs=158 gs=1 cs=0 l=1 c_cookie=2648265951890144259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 -- 10.20.193.195:0/1780315646 shutdown_connections 2026-02-24T07:21:08.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 --2- 10.20.193.195:0/1780315646 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc5e810e8d0 0x7fc5e810ecc0 unknown :-1 s=CLOSED pgs=158 gs=1 cs=0 l=1 c_cookie=2648265951890144259 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.321 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 -- 10.20.193.195:0/1780315646 >> 10.20.193.195:0/1780315646 conn(0x7fc5e80ec060 msgr2=0x7fc5e810c470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:08.322 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 -- 10.20.193.195:0/1780315646 shutdown_connections 2026-02-24T07:21:08.322 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 -- 10.20.193.195:0/1780315646 wait complete. 2026-02-24T07:21:08.322 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:08.322 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 Processor -- start 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 -- start start 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc5e810e8d0 0x7fc5e811c810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5eeee3640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e811cd70 con 0x7fc5e810e8d0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5ecc58640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc5e810e8d0 0x7fc5e811c810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5ecc58640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc5e810e8d0 0x7fc5e811c810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.195:44616/0 (socket says 10.20.193.195:44616) 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.322+0000 7fc5ecc58640 1 -- 10.20.193.195:0/2180665412 learned_addr learned my addr 10.20.193.195:0/2180665412 (peer_addr_for_me v2:10.20.193.195:0/0) 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.323+0000 7fc5ecc58640 1 -- 10.20.193.195:0/2180665412 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e811ceb0 con 0x7fc5e810e8d0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.323+0000 7fc5ecc58640 1 --2- 10.20.193.195:0/2180665412 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc5e810e8d0 0x7fc5e811c810 crc :-1 s=READY pgs=159 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.323+0000 7fc5ddffb640 1 -- 10.20.193.195:0/2180665412 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc5d800d690 con 0x7fc5e810e8d0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.323+0000 7fc5ddffb640 1 -- 10.20.193.195:0/2180665412 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fc5d800d7f0 con 0x7fc5e810e8d0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.323+0000 7fc5eeee3640 1 -- 10.20.193.195:0/2180665412 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e811d100 con 0x7fc5e810e8d0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.323+0000 7fc5ddffb640 1 -- 10.20.193.195:0/2180665412 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc5d800fd70 con 0x7fc5e810e8d0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.323+0000 7fc5eeee3640 1 -- 10.20.193.195:0/2180665412 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e811da70 con 0x7fc5e810e8d0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.323+0000 7fc5eeee3640 1 -- 10.20.193.195:0/2180665412 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e8132210 con 0x7fc5e810e8d0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.324+0000 7fc5ddffb640 1 -- 10.20.193.195:0/2180665412 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7fc5d800f6b0 con 0x7fc5e810e8d0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.324+0000 7fc5ddffb640 1 --2- 10.20.193.195:0/2180665412 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc5c403f970 0x7fc5c405fe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.324+0000 7fc5ddffb640 1 -- 10.20.193.195:0/2180665412 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3575+0+0 (crc 0 0 0) 0x7fc5d8052580 con 0x7fc5e810e8d0 2026-02-24T07:21:08.323 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.324+0000 7fc5dffff640 1 --2- 10.20.193.195:0/2180665412 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc5c403f970 0x7fc5c405fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:08.324 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.325+0000 7fc5dffff640 1 --2- 10.20.193.195:0/2180665412 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc5c403f970 0x7fc5c405fe20 crc :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:08.325 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.326+0000 7fc5ddffb640 1 -- 10.20.193.195:0/2180665412 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fc5d80071c0 con 0x7fc5e810e8d0 2026-02-24T07:21:08.436 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.436+0000 7fc5eeee3640 1 -- 10.20.193.195:0/2180665412 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;trial195=a", "target": ["mon-mgr", ""]}) -- 0x7fc5e811e7a0 con 0x7fc5c403f970 2026-02-24T07:21:08.439 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.439+0000 7fc5ddffb640 1 -- 10.20.193.195:0/2180665412 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (crc 0 0 0) 0x7fc5e811e7a0 con 0x7fc5c403f970 2026-02-24T07:21:08.439 INFO:teuthology.orchestra.run.trial195.stdout:Scheduled prometheus update... 2026-02-24T07:21:08.441 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.441+0000 7fc5eeee3640 1 -- 10.20.193.195:0/2180665412 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc5c403f970 msgr2=0x7fc5c405fe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:08.441 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.441+0000 7fc5eeee3640 1 --2- 10.20.193.195:0/2180665412 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc5c403f970 0x7fc5c405fe20 crc :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.441 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.441+0000 7fc5eeee3640 1 -- 10.20.193.195:0/2180665412 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc5e810e8d0 msgr2=0x7fc5e811c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:08.441 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.441+0000 7fc5eeee3640 1 --2- 10.20.193.195:0/2180665412 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc5e810e8d0 0x7fc5e811c810 crc :-1 s=READY pgs=159 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.441 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.441+0000 7fc5eeee3640 1 -- 10.20.193.195:0/2180665412 shutdown_connections 2026-02-24T07:21:08.441 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.441+0000 7fc5eeee3640 1 --2- 10.20.193.195:0/2180665412 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fc5c403f970 0x7fc5c405fe20 unknown :-1 s=CLOSED pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.441 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.441+0000 7fc5eeee3640 1 --2- 10.20.193.195:0/2180665412 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc5e810e8d0 0x7fc5e811c810 unknown :-1 s=CLOSED pgs=159 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.441 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.441+0000 7fc5eeee3640 1 -- 10.20.193.195:0/2180665412 >> 10.20.193.195:0/2180665412 conn(0x7fc5e80ec060 msgr2=0x7fc5e810c440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:08.441 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.441+0000 7fc5eeee3640 1 -- 10.20.193.195:0/2180665412 shutdown_connections 2026-02-24T07:21:08.441 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.441+0000 7fc5eeee3640 1 -- 10.20.193.195:0/2180665412 wait complete. 2026-02-24T07:21:08.478 DEBUG:teuthology.orchestra.run.trial195:prometheus.a> sudo journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@prometheus.a.service 2026-02-24T07:21:08.479 INFO:tasks.cephadm:Adding node-exporter.a on trial022 2026-02-24T07:21:08.479 INFO:tasks.cephadm:Adding node-exporter.b on trial195 2026-02-24T07:21:08.479 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph orch apply node-exporter '2;trial022=a;trial195=b' 2026-02-24T07:21:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:08 trial022 ceph-mon[39108]: purged_snaps scrub starts 2026-02-24T07:21:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:08 trial022 ceph-mon[39108]: purged_snaps scrub ok 2026-02-24T07:21:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:08 trial022 ceph-mon[39108]: osd.3 [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113] boot 2026-02-24T07:21:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:08 trial022 ceph-mon[39108]: osdmap e24: 4 total, 4 up, 4 in 2026-02-24T07:21:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:08 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:21:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:08 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1864285395' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-24T07:21:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:08 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:08 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:08 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1783261928' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T07:21:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:08 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/49241985' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-24T07:21:08.637 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:21:08.745 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.744+0000 7ff2dd56c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:08.745 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.744+0000 7ff2dd56c640 1 -- 10.20.193.195:0/1964308915 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff2d810c650 msgr2=0x7ff2d810ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:08.745 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.744+0000 7ff2dd56c640 1 --2- 10.20.193.195:0/1964308915 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff2d810c650 0x7ff2d810ca40 crc :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=14052748885568547096 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2dd56c640 1 -- 10.20.193.195:0/1964308915 shutdown_connections 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2dd56c640 1 --2- 10.20.193.195:0/1964308915 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff2d810c650 0x7ff2d810ca40 unknown :-1 s=CLOSED pgs=160 gs=1 cs=0 l=1 c_cookie=14052748885568547096 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2dd56c640 1 -- 10.20.193.195:0/1964308915 >> 10.20.193.195:0/1964308915 conn(0x7ff2d80e9de0 msgr2=0x7ff2d810a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2dd56c640 1 -- 10.20.193.195:0/1964308915 shutdown_connections 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2dd56c640 1 -- 10.20.193.195:0/1964308915 wait complete. 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2dd56c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2dd56c640 1 Processor -- start 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2dd56c640 1 -- start start 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2dd56c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff2d810c650 0x7ff2d811a5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2dd56c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d811ab10 con 0x7ff2d810c650 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2d6ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff2d810c650 0x7ff2d811a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2d6ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff2d810c650 0x7ff2d811a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.195:44632/0 (socket says 10.20.193.195:44632) 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.745+0000 7ff2d6ffd640 1 -- 10.20.193.195:0/2594602453 learned_addr learned my addr 10.20.193.195:0/2594602453 (peer_addr_for_me v2:10.20.193.195:0/0) 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.746+0000 7ff2d6ffd640 1 -- 10.20.193.195:0/2594602453 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d811ac50 con 0x7ff2d810c650 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.746+0000 7ff2d6ffd640 1 --2- 10.20.193.195:0/2594602453 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff2d810c650 0x7ff2d811a5b0 crc :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.746+0000 7ff2b7fff640 1 -- 10.20.193.195:0/2594602453 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff2cc00d690 con 0x7ff2d810c650 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.746+0000 7ff2b7fff640 1 -- 10.20.193.195:0/2594602453 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7ff2cc00d7f0 con 0x7ff2d810c650 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.746+0000 7ff2b7fff640 1 -- 10.20.193.195:0/2594602453 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff2cc00fe70 con 0x7ff2d810c650 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.746+0000 7ff2dd56c640 1 -- 10.20.193.195:0/2594602453 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d811aea0 con 0x7ff2d810c650 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.746+0000 7ff2dd56c640 1 -- 10.20.193.195:0/2594602453 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d811b810 con 0x7ff2d810c650 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.746+0000 7ff2dd56c640 1 -- 10.20.193.195:0/2594602453 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d812ff90 con 0x7ff2d810c650 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.747+0000 7ff2b7fff640 1 -- 10.20.193.195:0/2594602453 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7ff2cc0026a0 con 0x7ff2d810c650 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.747+0000 7ff2b7fff640 1 --2- 10.20.193.195:0/2594602453 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff2ac03f950 0x7ff2ac05fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.747+0000 7ff2b7fff640 1 -- 10.20.193.195:0/2594602453 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3575+0+0 (crc 0 0 0) 0x7ff2cc0526f0 con 0x7ff2d810c650 2026-02-24T07:21:08.746 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.747+0000 7ff2d67fc640 1 --2- 10.20.193.195:0/2594602453 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff2ac03f950 0x7ff2ac05fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:08.747 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.748+0000 7ff2d67fc640 1 --2- 10.20.193.195:0/2594602453 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff2ac03f950 0x7ff2ac05fe00 crc :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:08.749 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.749+0000 7ff2b7fff640 1 -- 10.20.193.195:0/2594602453 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7ff2cc00e5c0 con 0x7ff2d810c650 2026-02-24T07:21:08.864 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.864+0000 7ff2dd56c640 1 -- 10.20.193.195:0/2594602453 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;trial022=a;trial195=b", "target": ["mon-mgr", ""]}) -- 0x7ff2d811c590 con 0x7ff2ac03f950 2026-02-24T07:21:08.866 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.866+0000 7ff2b7fff640 1 -- 10.20.193.195:0/2594602453 <== mgr.14154 v2:10.20.193.22:6800/4126627015 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (crc 0 0 0) 0x7ff2d811c590 con 0x7ff2ac03f950 2026-02-24T07:21:08.867 INFO:teuthology.orchestra.run.trial195.stdout:Scheduled node-exporter update... 2026-02-24T07:21:08.869 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.868+0000 7ff2dd56c640 1 -- 10.20.193.195:0/2594602453 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff2ac03f950 msgr2=0x7ff2ac05fe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:08.869 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.868+0000 7ff2dd56c640 1 --2- 10.20.193.195:0/2594602453 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff2ac03f950 0x7ff2ac05fe00 crc :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.869 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.868+0000 7ff2dd56c640 1 -- 10.20.193.195:0/2594602453 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff2d810c650 msgr2=0x7ff2d811a5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:08.869 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.868+0000 7ff2dd56c640 1 --2- 10.20.193.195:0/2594602453 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff2d810c650 0x7ff2d811a5b0 crc :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.869 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.869+0000 7ff2dd56c640 1 -- 10.20.193.195:0/2594602453 shutdown_connections 2026-02-24T07:21:08.869 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.869+0000 7ff2dd56c640 1 --2- 10.20.193.195:0/2594602453 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff2ac03f950 0x7ff2ac05fe00 unknown :-1 s=CLOSED pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.870 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.869+0000 7ff2dd56c640 1 --2- 10.20.193.195:0/2594602453 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff2d810c650 0x7ff2d811a5b0 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:08.870 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.869+0000 7ff2dd56c640 1 -- 10.20.193.195:0/2594602453 >> 10.20.193.195:0/2594602453 conn(0x7ff2d80e9de0 msgr2=0x7ff2d810a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:08.870 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.869+0000 7ff2dd56c640 1 -- 10.20.193.195:0/2594602453 shutdown_connections 2026-02-24T07:21:08.870 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:08.869+0000 7ff2dd56c640 1 -- 10.20.193.195:0/2594602453 wait complete. 2026-02-24T07:21:08.908 DEBUG:teuthology.orchestra.run.trial022:node-exporter.a> sudo journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@node-exporter.a.service 2026-02-24T07:21:08.911 DEBUG:teuthology.orchestra.run.trial195:node-exporter.b> sudo journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@node-exporter.b.service 2026-02-24T07:21:08.917 INFO:tasks.cephadm:Setting up client nodes... 2026-02-24T07:21:08.917 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-24T07:21:09.066 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 -- 10.20.193.22:0/1180472889 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fd73810cae0 msgr2=0x7fd73810ced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 --2- 10.20.193.22:0/1180472889 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fd73810cae0 0x7fd73810ced0 crc :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=14898985515990496215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 -- 10.20.193.22:0/1180472889 shutdown_connections 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 --2- 10.20.193.22:0/1180472889 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fd73810cae0 0x7fd73810ced0 unknown :-1 s=CLOSED pgs=162 gs=1 cs=0 l=1 c_cookie=14898985515990496215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 -- 10.20.193.22:0/1180472889 >> 10.20.193.22:0/1180472889 conn(0x7fd7380ea270 msgr2=0x7fd73810a680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 -- 10.20.193.22:0/1180472889 shutdown_connections 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 -- 10.20.193.22:0/1180472889 wait complete. 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 Processor -- start 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 -- start start 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fd73810cae0 0x7fd73811cd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd73e68a640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd73811d290 con 0x7fd73810cae0 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd737fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fd73810cae0 0x7fd73811cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:09.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd737fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fd73810cae0 0x7fd73811cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46654/0 (socket says 10.20.193.22:46654) 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.172+0000 7fd737fff640 1 -- 10.20.193.22:0/2794449318 learned_addr learned my addr 10.20.193.22:0/2794449318 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.173+0000 7fd737fff640 1 -- 10.20.193.22:0/2794449318 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73811d3d0 con 0x7fd73810cae0 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.173+0000 7fd737fff640 1 --2- 10.20.193.22:0/2794449318 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fd73810cae0 0x7fd73811cd30 crc :-1 s=READY pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.173+0000 7fd7357fa640 1 -- 10.20.193.22:0/2794449318 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fd72400d690 con 0x7fd73810cae0 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.173+0000 7fd73e68a640 1 -- 10.20.193.22:0/2794449318 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73811d620 con 0x7fd73810cae0 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.173+0000 7fd7357fa640 1 -- 10.20.193.22:0/2794449318 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fd72400d7f0 con 0x7fd73810cae0 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.173+0000 7fd7357fa640 1 -- 10.20.193.22:0/2794449318 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fd72400fd70 con 0x7fd73810cae0 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.173+0000 7fd73e68a640 1 -- 10.20.193.22:0/2794449318 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd73811df90 con 0x7fd73810cae0 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.173+0000 7fd73e68a640 1 -- 10.20.193.22:0/2794449318 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd73805f3f0 con 0x7fd73810cae0 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.173+0000 7fd7357fa640 1 -- 10.20.193.22:0/2794449318 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7fd72400e5c0 con 0x7fd73810cae0 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.174+0000 7fd7357fa640 1 --2- 10.20.193.22:0/2794449318 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fd70c03f970 0x7fd70c05fe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:09.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.174+0000 7fd7357fa640 1 -- 10.20.193.22:0/2794449318 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3575+0+0 (crc 0 0 0) 0x7fd724052620 con 0x7fd73810cae0 2026-02-24T07:21:09.176 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.174+0000 7fd7377fe640 1 --2- 10.20.193.22:0/2794449318 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fd70c03f970 0x7fd70c05fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:09.176 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.174+0000 7fd7377fe640 1 --2- 10.20.193.22:0/2794449318 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fd70c03f970 0x7fd70c05fe20 crc :-1 s=READY pgs=54 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:09.177 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.176+0000 7fd7357fa640 1 -- 10.20.193.22:0/2794449318 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fd724015730 con 0x7fd73810cae0 2026-02-24T07:21:09.324 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.322+0000 7fd73e68a640 1 -- 10.20.193.22:0/2794449318 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fd73805f600 con 0x7fd73810cae0 2026-02-24T07:21:09.324 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.323+0000 7fd7357fa640 1 -- 10.20.193.22:0/2794449318 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v8) ==== 170+0+59 (crc 0 0 0) 0x7fd724015730 con 0x7fd73810cae0 2026-02-24T07:21:09.325 INFO:teuthology.orchestra.run.trial022.stdout:[client.0] 2026-02-24T07:21:09.325 INFO:teuthology.orchestra.run.trial022.stdout: key = AQBlUZ1p7TFMExAARjiLaPmjxCW5vFNhyOtoTQ== 2026-02-24T07:21:09.326 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.324+0000 7fd73e68a640 1 -- 10.20.193.22:0/2794449318 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fd70c03f970 msgr2=0x7fd70c05fe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:09.326 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.324+0000 7fd73e68a640 1 --2- 10.20.193.22:0/2794449318 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fd70c03f970 0x7fd70c05fe20 crc :-1 s=READY pgs=54 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.327 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.324+0000 7fd73e68a640 1 -- 10.20.193.22:0/2794449318 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fd73810cae0 msgr2=0x7fd73811cd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:09.327 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.324+0000 7fd73e68a640 1 --2- 10.20.193.22:0/2794449318 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fd73810cae0 0x7fd73811cd30 crc :-1 s=READY pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.327 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.324+0000 7fd73e68a640 1 -- 10.20.193.22:0/2794449318 shutdown_connections 2026-02-24T07:21:09.327 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.324+0000 7fd73e68a640 1 --2- 10.20.193.22:0/2794449318 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fd70c03f970 0x7fd70c05fe20 unknown :-1 s=CLOSED pgs=54 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.327 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.324+0000 7fd73e68a640 1 --2- 10.20.193.22:0/2794449318 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fd73810cae0 0x7fd73811cd30 unknown :-1 s=CLOSED pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.327 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.324+0000 7fd73e68a640 1 -- 10.20.193.22:0/2794449318 >> 10.20.193.22:0/2794449318 conn(0x7fd7380ea270 msgr2=0x7fd73810a650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:09.327 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.324+0000 7fd73e68a640 1 -- 10.20.193.22:0/2794449318 shutdown_connections 2026-02-24T07:21:09.327 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:09.324+0000 7fd73e68a640 1 -- 10.20.193.22:0/2794449318 wait complete. 2026-02-24T07:21:09.361 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:21:09.361 DEBUG:teuthology.orchestra.run.trial022:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-24T07:21:09.361 DEBUG:teuthology.orchestra.run.trial022:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T07:21:09.395 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-24T07:21:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:09 trial022 ceph-mon[39108]: pgmap v39: 1 pgs: 1 unknown; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-24T07:21:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:09 trial022 ceph-mon[39108]: osdmap e25: 4 total, 4 up, 4 in 2026-02-24T07:21:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:09 trial022 ceph-mon[39108]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;trial195=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:21:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:09 trial022 ceph-mon[39108]: Saving service prometheus spec with placement trial195=a;count:1 2026-02-24T07:21:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:09 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:09 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:21:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:09 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:09 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:09 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:09.513 INFO:teuthology.orchestra.run.trial195.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.618+0000 7f6cdf2ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.618+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/4151673612 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6cd810c5b0 msgr2=0x7f6cd810c9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.618+0000 7f6cdf2ea640 1 --2- 10.20.193.195:0/4151673612 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6cd810c5b0 0x7f6cd810c9a0 crc :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=714930951498413523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/4151673612 shutdown_connections 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdf2ea640 1 --2- 10.20.193.195:0/4151673612 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6cd810c5b0 0x7f6cd810c9a0 unknown :-1 s=CLOSED pgs=164 gs=1 cs=0 l=1 c_cookie=714930951498413523 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/4151673612 >> 10.20.193.195:0/4151673612 conn(0x7f6cd80e9d00 msgr2=0x7f6cd810a110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/4151673612 shutdown_connections 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/4151673612 wait complete. 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdf2ea640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdf2ea640 1 Processor -- start 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdf2ea640 1 -- start start 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdf2ea640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6cd810c5b0 0x7f6cd811a570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:09.619 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdf2ea640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd811aad0 con 0x7f6cd810c5b0 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdd05f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6cd810c5b0 0x7f6cd811a570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.619+0000 7f6cdd05f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6cd810c5b0 0x7f6cd811a570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.195:44648/0 (socket says 10.20.193.195:44648) 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.620+0000 7f6cdd05f640 1 -- 10.20.193.195:0/2574907606 learned_addr learned my addr 10.20.193.195:0/2574907606 (peer_addr_for_me v2:10.20.193.195:0/0) 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.620+0000 7f6cdd05f640 1 -- 10.20.193.195:0/2574907606 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd811ac10 con 0x7f6cd810c5b0 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.620+0000 7f6cdd05f640 1 --2- 10.20.193.195:0/2574907606 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6cd810c5b0 0x7f6cd811a570 crc :-1 s=READY pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.620+0000 7f6cc67fc640 1 -- 10.20.193.195:0/2574907606 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f6cc800d690 con 0x7f6cd810c5b0 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.620+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/2574907606 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd811ae60 con 0x7f6cd810c5b0 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.620+0000 7f6cc67fc640 1 -- 10.20.193.195:0/2574907606 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f6cc800d7f0 con 0x7f6cd810c5b0 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.620+0000 7f6cc67fc640 1 -- 10.20.193.195:0/2574907606 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f6cc800fc60 con 0x7f6cd810c5b0 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.620+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/2574907606 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd811b7d0 con 0x7f6cd810c5b0 2026-02-24T07:21:09.620 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.621+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/2574907606 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd812ff70 con 0x7f6cd810c5b0 2026-02-24T07:21:09.621 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.621+0000 7f6cc67fc640 1 -- 10.20.193.195:0/2574907606 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f6cc800f5a0 con 0x7f6cd810c5b0 2026-02-24T07:21:09.621 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.621+0000 7f6cc67fc640 1 --2- 10.20.193.195:0/2574907606 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6cb403f920 0x7f6cb405fdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:09.621 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.621+0000 7f6cc67fc640 1 -- 10.20.193.195:0/2574907606 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7f6cc8052680 con 0x7f6cd810c5b0 2026-02-24T07:21:09.621 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.622+0000 7f6cdc85e640 1 --2- 10.20.193.195:0/2574907606 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6cb403f920 0x7f6cb405fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:09.621 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.622+0000 7f6cdc85e640 1 --2- 10.20.193.195:0/2574907606 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6cb403f920 0x7f6cb405fdd0 crc :-1 s=READY pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:09.623 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.624+0000 7f6cc67fc640 1 -- 10.20.193.195:0/2574907606 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f6cc80079f0 con 0x7f6cd810c5b0 2026-02-24T07:21:09.771 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.771+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/2574907606 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f6cd811c440 con 0x7f6cd810c5b0 2026-02-24T07:21:09.772 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.772+0000 7f6cc67fc640 1 -- 10.20.193.195:0/2574907606 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v9) ==== 170+0+59 (crc 0 0 0) 0x7f6cc80071c0 con 0x7f6cd810c5b0 2026-02-24T07:21:09.772 INFO:teuthology.orchestra.run.trial195.stdout:[client.1] 2026-02-24T07:21:09.772 INFO:teuthology.orchestra.run.trial195.stdout: key = AQBlUZ1pNNj0LRAAKzsCza4X3xG2K/sWZ2BrMQ== 2026-02-24T07:21:09.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.774+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/2574907606 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6cb403f920 msgr2=0x7f6cb405fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:09.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.774+0000 7f6cdf2ea640 1 --2- 10.20.193.195:0/2574907606 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6cb403f920 0x7f6cb405fdd0 crc :-1 s=READY pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.774+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/2574907606 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6cd810c5b0 msgr2=0x7f6cd811a570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:09.775 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.774+0000 7f6cdf2ea640 1 --2- 10.20.193.195:0/2574907606 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6cd810c5b0 0x7f6cd811a570 crc :-1 s=READY pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.776 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.775+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/2574907606 shutdown_connections 2026-02-24T07:21:09.776 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.775+0000 7f6cdf2ea640 1 --2- 10.20.193.195:0/2574907606 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6cb403f920 0x7f6cb405fdd0 unknown :-1 s=CLOSED pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.776 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.775+0000 7f6cdf2ea640 1 --2- 10.20.193.195:0/2574907606 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6cd810c5b0 0x7f6cd811a570 unknown :-1 s=CLOSED pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:09.776 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.775+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/2574907606 >> 10.20.193.195:0/2574907606 conn(0x7f6cd80e9d00 msgr2=0x7f6cd810a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:09.776 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.775+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/2574907606 shutdown_connections 2026-02-24T07:21:09.776 INFO:teuthology.orchestra.run.trial195.stderr:2026-02-24T07:21:09.775+0000 7f6cdf2ea640 1 -- 10.20.193.195:0/2574907606 wait complete. 2026-02-24T07:21:09.812 DEBUG:teuthology.orchestra.run.trial195:> set -ex 2026-02-24T07:21:09.812 DEBUG:teuthology.orchestra.run.trial195:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-24T07:21:09.812 DEBUG:teuthology.orchestra.run.trial195:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-24T07:21:09.848 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-24T07:21:09.965 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:10.066 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:10.066 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 -- 10.20.193.22:0/336920549 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff90410f0f0 msgr2=0x7ff90410f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:10.066 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 --2- 10.20.193.22:0/336920549 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff90410f0f0 0x7ff90410f4c0 crc :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=8051465972717853582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.066 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 -- 10.20.193.22:0/336920549 shutdown_connections 2026-02-24T07:21:10.066 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 --2- 10.20.193.22:0/336920549 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff90410f0f0 0x7ff90410f4c0 unknown :-1 s=CLOSED pgs=166 gs=1 cs=0 l=1 c_cookie=8051465972717853582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.066 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 -- 10.20.193.22:0/336920549 >> 10.20.193.22:0/336920549 conn(0x7ff9040ec9a0 msgr2=0x7ff90410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:10.066 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 -- 10.20.193.22:0/336920549 shutdown_connections 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 -- 10.20.193.22:0/336920549 wait complete. 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 Processor -- start 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 -- start start 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff90410f0f0 0x7ff9040f2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff90b570640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040f3360 con 0x7ff90410f0f0 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff9092e5640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff90410f0f0 0x7ff9040f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff9092e5640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff90410f0f0 0x7ff9040f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46676/0 (socket says 10.20.193.22:46676) 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.064+0000 7ff9092e5640 1 -- 10.20.193.22:0/913151413 learned_addr learned my addr 10.20.193.22:0/913151413 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.065+0000 7ff9092e5640 1 -- 10.20.193.22:0/913151413 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9040f34a0 con 0x7ff90410f0f0 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.065+0000 7ff9092e5640 1 --2- 10.20.193.22:0/913151413 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff90410f0f0 0x7ff9040f2e20 crc :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.065+0000 7ff8f27fc640 1 -- 10.20.193.22:0/913151413 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff8f400d690 con 0x7ff90410f0f0 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.065+0000 7ff8f27fc640 1 -- 10.20.193.22:0/913151413 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7ff8f400d7f0 con 0x7ff90410f0f0 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.065+0000 7ff90b570640 1 -- 10.20.193.22:0/913151413 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9040f36f0 con 0x7ff90410f0f0 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.065+0000 7ff8f27fc640 1 -- 10.20.193.22:0/913151413 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff8f400fd70 con 0x7ff90410f0f0 2026-02-24T07:21:10.067 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.065+0000 7ff90b570640 1 -- 10.20.193.22:0/913151413 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9040f8520 con 0x7ff90410f0f0 2026-02-24T07:21:10.068 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.065+0000 7ff90b570640 1 -- 10.20.193.22:0/913151413 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9041103d0 con 0x7ff90410f0f0 2026-02-24T07:21:10.069 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.065+0000 7ff8f27fc640 1 -- 10.20.193.22:0/913151413 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7ff8f400f6b0 con 0x7ff90410f0f0 2026-02-24T07:21:10.069 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.066+0000 7ff8f27fc640 1 --2- 10.20.193.22:0/913151413 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff8e003f920 0x7ff8e005fdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:10.069 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.066+0000 7ff8f27fc640 1 -- 10.20.193.22:0/913151413 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7ff8f4052700 con 0x7ff90410f0f0 2026-02-24T07:21:10.069 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.066+0000 7ff908ae4640 1 --2- 10.20.193.22:0/913151413 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff8e003f920 0x7ff8e005fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:10.069 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.066+0000 7ff908ae4640 1 --2- 10.20.193.22:0/913151413 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff8e003f920 0x7ff8e005fdd0 crc :-1 s=READY pgs=56 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:10.069 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.068+0000 7ff8f27fc640 1 -- 10.20.193.22:0/913151413 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7ff8f40071c0 con 0x7ff90410f0f0 2026-02-24T07:21:10.173 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.171+0000 7ff90b570640 1 -- 10.20.193.22:0/913151413 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7ff9041375f0 con 0x7ff90410f0f0 2026-02-24T07:21:10.173 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.171+0000 7ff8f27fc640 1 -- 10.20.193.22:0/913151413 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v13) ==== 86+0+188 (crc 0 0 0) 0x7ff8f40071c0 con 0x7ff90410f0f0 2026-02-24T07:21:10.174 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:10.174 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.172+0000 7ff90b570640 1 -- 10.20.193.22:0/913151413 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff8e003f920 msgr2=0x7ff8e005fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:10.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.172+0000 7ff90b570640 1 --2- 10.20.193.22:0/913151413 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff8e003f920 0x7ff8e005fdd0 crc :-1 s=READY pgs=56 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.172+0000 7ff90b570640 1 -- 10.20.193.22:0/913151413 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff90410f0f0 msgr2=0x7ff9040f2e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:10.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.172+0000 7ff90b570640 1 --2- 10.20.193.22:0/913151413 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff90410f0f0 0x7ff9040f2e20 crc :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.172+0000 7ff90b570640 1 -- 10.20.193.22:0/913151413 shutdown_connections 2026-02-24T07:21:10.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.172+0000 7ff90b570640 1 --2- 10.20.193.22:0/913151413 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff8e003f920 0x7ff8e005fdd0 unknown :-1 s=CLOSED pgs=56 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.172+0000 7ff90b570640 1 --2- 10.20.193.22:0/913151413 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff90410f0f0 0x7ff9040f2e20 unknown :-1 s=CLOSED pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.172+0000 7ff90b570640 1 -- 10.20.193.22:0/913151413 >> 10.20.193.22:0/913151413 conn(0x7ff9040ec9a0 msgr2=0x7ff90410d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:10.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.172+0000 7ff90b570640 1 -- 10.20.193.22:0/913151413 shutdown_connections 2026-02-24T07:21:10.175 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.172+0000 7ff90b570640 1 -- 10.20.193.22:0/913151413 wait complete. 2026-02-24T07:21:10.209 INFO:teuthology.orchestra.run.trial022.stdout:[{"version":13,"timestamp":"2026-02-24T07:21:06.035652+0000","name":"","changes":[{"name":"osd/host:trial195/osd_memory_target","previous_value":"93498629324","new_value":"46749314662"}]}] 2026-02-24T07:21:10.210 INFO:tasks.ceph_manager:config epoch is 13 2026-02-24T07:21:10.210 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T07:21:10.210 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-24T07:21:10.210 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-24T07:21:10.324 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:10.418 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.416+0000 7ff9dc415640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:10.418 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.416+0000 7ff9dc415640 1 -- 10.20.193.22:0/1741566285 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff9d4060fb0 msgr2=0x7ff9d4061380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:10.418 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.416+0000 7ff9dc415640 1 --2- 10.20.193.22:0/1741566285 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff9d4060fb0 0x7ff9d4061380 crc :-1 s=READY pgs=168 gs=1 cs=0 l=1 c_cookie=10225207496248875336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.416+0000 7ff9dc415640 1 -- 10.20.193.22:0/1741566285 shutdown_connections 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.416+0000 7ff9dc415640 1 --2- 10.20.193.22:0/1741566285 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff9d4060fb0 0x7ff9d4061380 unknown :-1 s=CLOSED pgs=168 gs=1 cs=0 l=1 c_cookie=10225207496248875336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.416+0000 7ff9dc415640 1 -- 10.20.193.22:0/1741566285 >> 10.20.193.22:0/1741566285 conn(0x7ff9d40ea730 msgr2=0x7ff9d410ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.416+0000 7ff9dc415640 1 -- 10.20.193.22:0/1741566285 shutdown_connections 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.416+0000 7ff9dc415640 1 -- 10.20.193.22:0/1741566285 wait complete. 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9dc415640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9dc415640 1 Processor -- start 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9dc415640 1 -- start start 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9dc415640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff9d4060fb0 0x7ff9d40f0b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9dc415640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d40f1050 con 0x7ff9d4060fb0 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9da18a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff9d4060fb0 0x7ff9d40f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9da18a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff9d4060fb0 0x7ff9d40f0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46708/0 (socket says 10.20.193.22:46708) 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9da18a640 1 -- 10.20.193.22:0/3510311350 learned_addr learned my addr 10.20.193.22:0/3510311350 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9da18a640 1 -- 10.20.193.22:0/3510311350 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d40f1190 con 0x7ff9d4060fb0 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9da18a640 1 --2- 10.20.193.22:0/3510311350 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff9d4060fb0 0x7ff9d40f0b10 crc :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9bb7fe640 1 -- 10.20.193.22:0/3510311350 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff9c400d690 con 0x7ff9d4060fb0 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9bb7fe640 1 -- 10.20.193.22:0/3510311350 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7ff9c400d7f0 con 0x7ff9d4060fb0 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9dc415640 1 -- 10.20.193.22:0/3510311350 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d40f13e0 con 0x7ff9d4060fb0 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9bb7fe640 1 -- 10.20.193.22:0/3510311350 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff9c400fe70 con 0x7ff9d4060fb0 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.417+0000 7ff9dc415640 1 -- 10.20.193.22:0/3510311350 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d40f6210 con 0x7ff9d4060fb0 2026-02-24T07:21:10.419 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.418+0000 7ff9dc415640 1 -- 10.20.193.22:0/3510311350 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d40624c0 con 0x7ff9d4060fb0 2026-02-24T07:21:10.420 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.418+0000 7ff9bb7fe640 1 -- 10.20.193.22:0/3510311350 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7ff9c400e5c0 con 0x7ff9d4060fb0 2026-02-24T07:21:10.420 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.418+0000 7ff9bb7fe640 1 --2- 10.20.193.22:0/3510311350 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff9b003f950 0x7ff9b005fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:10.420 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.418+0000 7ff9bb7fe640 1 -- 10.20.193.22:0/3510311350 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7ff9c40527a0 con 0x7ff9d4060fb0 2026-02-24T07:21:10.420 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.418+0000 7ff9d9989640 1 --2- 10.20.193.22:0/3510311350 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff9b003f950 0x7ff9b005fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:10.420 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.418+0000 7ff9d9989640 1 --2- 10.20.193.22:0/3510311350 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff9b003f950 0x7ff9b005fe00 crc :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:10.421 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.420+0000 7ff9bb7fe640 1 -- 10.20.193.22:0/3510311350 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7ff9c400c800 con 0x7ff9d4060fb0 2026-02-24T07:21:10.438 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;trial022=a;trial195=b", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:21:10.438 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: Saving service node-exporter spec with placement trial022=a;trial195=b;count:2 2026-02-24T07:21:10.438 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: osdmap e26: 4 total, 4 up, 4 in 2026-02-24T07:21:10.438 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2794449318' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T07:21:10.438 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2794449318' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T07:21:10.438 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='client.? 10.20.193.195:0/2574907606' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='client.? 10.20.193.195:0/2574907606' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-24T07:21:10.439 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:10 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/913151413' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-24T07:21:10.555 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.553+0000 7ff9dc415640 1 -- 10.20.193.22:0/3510311350 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff9d405f3f0 con 0x7ff9d4060fb0 2026-02-24T07:21:10.556 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.554+0000 7ff9bb7fe640 1 -- 10.20.193.22:0/3510311350 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v14) ==== 74+0+100296 (crc 0 0 0) 0x7ff9c4015130 con 0x7ff9d4060fb0 2026-02-24T07:21:10.560 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:10.562 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.555+0000 7ff9dc415640 1 -- 10.20.193.22:0/3510311350 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff9b003f950 msgr2=0x7ff9b005fe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:10.562 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.555+0000 7ff9dc415640 1 --2- 10.20.193.22:0/3510311350 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff9b003f950 0x7ff9b005fe00 crc :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.562 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.555+0000 7ff9dc415640 1 -- 10.20.193.22:0/3510311350 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff9d4060fb0 msgr2=0x7ff9d40f0b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:10.563 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.555+0000 7ff9dc415640 1 --2- 10.20.193.22:0/3510311350 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff9d4060fb0 0x7ff9d40f0b10 crc :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.563 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.555+0000 7ff9dc415640 1 -- 10.20.193.22:0/3510311350 shutdown_connections 2026-02-24T07:21:10.563 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.555+0000 7ff9dc415640 1 --2- 10.20.193.22:0/3510311350 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff9b003f950 0x7ff9b005fe00 unknown :-1 s=CLOSED pgs=57 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.563 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.555+0000 7ff9dc415640 1 --2- 10.20.193.22:0/3510311350 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff9d4060fb0 0x7ff9d40f0b10 unknown :-1 s=CLOSED pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.563 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.555+0000 7ff9dc415640 1 -- 10.20.193.22:0/3510311350 >> 10.20.193.22:0/3510311350 conn(0x7ff9d40ea730 msgr2=0x7ff9d4130f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:10.563 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.555+0000 7ff9dc415640 1 -- 10.20.193.22:0/3510311350 shutdown_connections 2026-02-24T07:21:10.563 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.555+0000 7ff9dc415640 1 -- 10.20.193.22:0/3510311350 wait complete. 2026-02-24T07:21:10.593 INFO:teuthology.orchestra.run.trial022.stdout:{"epoch":14,"flags":0,"active_gid":14154,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6800","nonce":4126627015},{"type":"v1","addr":"10.20.193.22:6801","nonce":4126627015}]},"active_addr":"10.20.193.22:6801/4126627015","active_change":"2026-02-24T07:20:18.196877+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.22:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.22:0","nonce":999250685}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.22:0","nonce":2497344761}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.22:0","nonce":133681963}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.22:0","nonce":2144804580}]}]} 2026-02-24T07:21:10.669 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-24T07:21:10.670 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-24T07:21:10.670 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T07:21:10.786 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:10.893 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.890+0000 7fbf6ff39640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:10.893 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.890+0000 7fbf6ff39640 1 -- 10.20.193.22:0/2070697561 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbf6810f0f0 msgr2=0x7fbf6810f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:10.893 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.890+0000 7fbf6ff39640 1 --2- 10.20.193.22:0/2070697561 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbf6810f0f0 0x7fbf6810f4c0 crc :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=11426364541650500625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.893 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.890+0000 7fbf6ff39640 1 -- 10.20.193.22:0/2070697561 shutdown_connections 2026-02-24T07:21:10.893 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.890+0000 7fbf6ff39640 1 --2- 10.20.193.22:0/2070697561 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbf6810f0f0 0x7fbf6810f4c0 unknown :-1 s=CLOSED pgs=170 gs=1 cs=0 l=1 c_cookie=11426364541650500625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:10.893 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.890+0000 7fbf6ff39640 1 -- 10.20.193.22:0/2070697561 >> 10.20.193.22:0/2070697561 conn(0x7fbf680ec9a0 msgr2=0x7fbf6810cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.890+0000 7fbf6ff39640 1 -- 10.20.193.22:0/2070697561 shutdown_connections 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.890+0000 7fbf6ff39640 1 -- 10.20.193.22:0/2070697561 wait complete. 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.890+0000 7fbf6ff39640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6ff39640 1 Processor -- start 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6ff39640 1 -- start start 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6ff39640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbf6810f0f0 0x7fbf680f2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6ff39640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf680f3360 con 0x7fbf6810f0f0 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6dcae640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbf6810f0f0 0x7fbf680f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6dcae640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbf6810f0f0 0x7fbf680f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46724/0 (socket says 10.20.193.22:46724) 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6dcae640 1 -- 10.20.193.22:0/363783644 learned_addr learned my addr 10.20.193.22:0/363783644 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6dcae640 1 -- 10.20.193.22:0/363783644 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf680f34a0 con 0x7fbf6810f0f0 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6dcae640 1 --2- 10.20.193.22:0/363783644 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbf6810f0f0 0x7fbf680f2e20 crc :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf56ffd640 1 -- 10.20.193.22:0/363783644 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fbf5800d690 con 0x7fbf6810f0f0 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf56ffd640 1 -- 10.20.193.22:0/363783644 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fbf5800d7f0 con 0x7fbf6810f0f0 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6ff39640 1 -- 10.20.193.22:0/363783644 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf680f36f0 con 0x7fbf6810f0f0 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf56ffd640 1 -- 10.20.193.22:0/363783644 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fbf5800fd70 con 0x7fbf6810f0f0 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.891+0000 7fbf6ff39640 1 -- 10.20.193.22:0/363783644 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf680f8520 con 0x7fbf6810f0f0 2026-02-24T07:21:10.894 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.892+0000 7fbf6ff39640 1 -- 10.20.193.22:0/363783644 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf681103d0 con 0x7fbf6810f0f0 2026-02-24T07:21:10.895 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.892+0000 7fbf56ffd640 1 -- 10.20.193.22:0/363783644 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7fbf5800f6b0 con 0x7fbf6810f0f0 2026-02-24T07:21:10.895 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.892+0000 7fbf56ffd640 1 --2- 10.20.193.22:0/363783644 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbf4403f920 0x7fbf4405fdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:10.895 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.892+0000 7fbf56ffd640 1 -- 10.20.193.22:0/363783644 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7fbf58052700 con 0x7fbf6810f0f0 2026-02-24T07:21:10.895 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.892+0000 7fbf6d4ad640 1 --2- 10.20.193.22:0/363783644 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbf4403f920 0x7fbf4405fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:10.895 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.892+0000 7fbf6d4ad640 1 --2- 10.20.193.22:0/363783644 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbf4403f920 0x7fbf4405fdd0 crc :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:10.896 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.894+0000 7fbf56ffd640 1 -- 10.20.193.22:0/363783644 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fbf580071c0 con 0x7fbf6810f0f0 2026-02-24T07:21:11.000 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.999+0000 7fbf6ff39640 1 -- 10.20.193.22:0/363783644 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf681375f0 con 0x7fbf6810f0f0 2026-02-24T07:21:11.001 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:10.999+0000 7fbf56ffd640 1 -- 10.20.193.22:0/363783644 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+8658 (crc 0 0 0) 0x7fbf580281e0 con 0x7fbf6810f0f0 2026-02-24T07:21:11.002 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:11.002 INFO:teuthology.orchestra.run.trial022.stdout:{"epoch":26,"fsid":"30400272-1151-11f1-be09-d404e6e7d460","created":"2026-02-24T07:19:58.590745+0000","modified":"2026-02-24T07:21:09.224142+0000","last_up_change":"2026-02-24T07:21:07.219077+0000","last_in_change":"2026-02-24T07:20:58.027518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T07:20:58.403056+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca990aad-309e-4860-89f8-220d9644f458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6802","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6803","nonce":3403491613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6804","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6805","nonce":3403491613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6808","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6809","nonce":3403491613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6806","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6807","nonce":3403491613}]},"public_addr":"10.20.193.22:6803/3403491613","cluster_addr":"10.20.193.22:6805/3403491613","heartbeat_back_addr":"10.20.193.22:6809/3403491613","heartbeat_front_addr":"10.20.193.22:6807/3403491613","state":["exists","up"]},{"osd":1,"uuid":"ca12e232-92e2-4ceb-a1ed-5a9001d238ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6810","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6811","nonce":242124904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6812","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6813","nonce":242124904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6816","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6817","nonce":242124904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6814","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6815","nonce":242124904}]},"public_addr":"10.20.193.22:6811/242124904","cluster_addr":"10.20.193.22:6813/242124904","heartbeat_back_addr":"10.20.193.22:6817/242124904","heartbeat_front_addr":"10.20.193.22:6815/242124904","state":["exists","up"]},{"osd":2,"uuid":"2931f5f7-673d-40d3-bf7a-fd6bc2e0c0d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6800","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6801","nonce":1597504938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6802","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6803","nonce":1597504938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6806","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6807","nonce":1597504938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6804","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6805","nonce":1597504938}]},"public_addr":"10.20.193.195:6801/1597504938","cluster_addr":"10.20.193.195:6803/1597504938","heartbeat_back_addr":"10.20.193.195:6807/1597504938","heartbeat_front_addr":"10.20.193.195:6805/1597504938","state":["exists","up"]},{"osd":3,"uuid":"b659885f-ccd3-4c7e-abd5-16c32191a9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6808","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6809","nonce":3934829113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6810","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6811","nonce":3934829113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6814","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6815","nonce":3934829113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6812","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6813","nonce":3934829113}]},"public_addr":"10.20.193.195:6809/3934829113","cluster_addr":"10.20.193.195:6811/3934829113","heartbeat_back_addr":"10.20.193.195:6815/3934829113","heartbeat_front_addr":"10.20.193.195:6813/3934829113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:20:39.769190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:20:47.514747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:20:56.625083+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:21:05.279025+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.22:0/3439864540":"2026-02-25T07:20:18.196776+0000","10.20.193.22:0/2896310664":"2026-02-25T07:20:18.196776+0000","10.20.193.22:6800/2169717366":"2026-02-25T07:20:18.196776+0000","10.20.193.22:0/125463061":"2026-02-25T07:20:18.196776+0000","10.20.193.22:0/360752884":"2026-02-25T07:20:08.618709+0000","10.20.193.22:0/3319117026":"2026-02-25T07:20:08.618709+0000","10.20.193.22:0/4242395366":"2026-02-25T07:20:08.618709+0000","10.20.193.22:6801/1400318633":"2026-02-25T07:20:08.618709+0000","10.20.193.22:6801/2169717366":"2026-02-25T07:20:18.196776+0000","10.20.193.22:6800/1400318633":"2026-02-25T07:20:08.618709+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T07:21:11.003 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.000+0000 7fbf6ff39640 1 -- 10.20.193.22:0/363783644 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbf4403f920 msgr2=0x7fbf4405fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.003 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.000+0000 7fbf6ff39640 1 --2- 10.20.193.22:0/363783644 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbf4403f920 0x7fbf4405fdd0 crc :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.003 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.000+0000 7fbf6ff39640 1 -- 10.20.193.22:0/363783644 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbf6810f0f0 msgr2=0x7fbf680f2e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.003 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.000+0000 7fbf6ff39640 1 --2- 10.20.193.22:0/363783644 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbf6810f0f0 0x7fbf680f2e20 crc :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.003 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.000+0000 7fbf6ff39640 1 -- 10.20.193.22:0/363783644 shutdown_connections 2026-02-24T07:21:11.004 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.000+0000 7fbf6ff39640 1 --2- 10.20.193.22:0/363783644 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fbf4403f920 0x7fbf4405fdd0 unknown :-1 s=CLOSED pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.004 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.000+0000 7fbf6ff39640 1 --2- 10.20.193.22:0/363783644 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fbf6810f0f0 0x7fbf680f2e20 unknown :-1 s=CLOSED pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.004 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.000+0000 7fbf6ff39640 1 -- 10.20.193.22:0/363783644 >> 10.20.193.22:0/363783644 conn(0x7fbf680ec9a0 msgr2=0x7fbf6810d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.004 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.000+0000 7fbf6ff39640 1 -- 10.20.193.22:0/363783644 shutdown_connections 2026-02-24T07:21:11.004 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.000+0000 7fbf6ff39640 1 -- 10.20.193.22:0/363783644 wait complete. 2026-02-24T07:21:11.038 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-24T07:21:11.038 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd dump --format=json 2026-02-24T07:21:11.152 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:11.258 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.258 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 1 -- 10.20.193.22:0/2704321406 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fdcc0060fb0 msgr2=0x7fdcc0061380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.258 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 1 --2- 10.20.193.22:0/2704321406 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fdcc0060fb0 0x7fdcc0061380 crc :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=9620679590290957792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.258 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 1 -- 10.20.193.22:0/2704321406 shutdown_connections 2026-02-24T07:21:11.258 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 1 --2- 10.20.193.22:0/2704321406 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fdcc0060fb0 0x7fdcc0061380 unknown :-1 s=CLOSED pgs=172 gs=1 cs=0 l=1 c_cookie=9620679590290957792 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.258 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 1 -- 10.20.193.22:0/2704321406 >> 10.20.193.22:0/2704321406 conn(0x7fdcc00ea730 msgr2=0x7fdcc010ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.258 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 1 -- 10.20.193.22:0/2704321406 shutdown_connections 2026-02-24T07:21:11.258 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 1 -- 10.20.193.22:0/2704321406 wait complete. 2026-02-24T07:21:11.258 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:11 trial022 ceph-mon[39108]: Deploying daemon prometheus.a on trial195 2026-02-24T07:21:11.258 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:11 trial022 ceph-mon[39108]: pgmap v42: 1 pgs: 1 unknown; 577 KiB data, 107 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:11.258 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:11 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3510311350' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-24T07:21:11.258 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:11 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/363783644' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T07:21:11.259 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.259 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 1 Processor -- start 2026-02-24T07:21:11.259 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.256+0000 7fdcc5dca640 1 -- start start 2026-02-24T07:21:11.259 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcc5dca640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fdcc0060fb0 0x7fdcc00f0b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.259 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcc5dca640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc00f1050 con 0x7fdcc0060fb0 2026-02-24T07:21:11.259 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcbf7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fdcc0060fb0 0x7fdcc00f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcbf7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fdcc0060fb0 0x7fdcc00f0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46750/0 (socket says 10.20.193.22:46750) 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcbf7fe640 1 -- 10.20.193.22:0/4268975711 learned_addr learned my addr 10.20.193.22:0/4268975711 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcbf7fe640 1 -- 10.20.193.22:0/4268975711 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc00f1190 con 0x7fdcc0060fb0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcbf7fe640 1 --2- 10.20.193.22:0/4268975711 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fdcc0060fb0 0x7fdcc00f0b10 crc :-1 s=READY pgs=173 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcbcff9640 1 -- 10.20.193.22:0/4268975711 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fdcac00d690 con 0x7fdcc0060fb0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcc5dca640 1 -- 10.20.193.22:0/4268975711 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc00f13e0 con 0x7fdcc0060fb0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcbcff9640 1 -- 10.20.193.22:0/4268975711 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fdcac00d7f0 con 0x7fdcc0060fb0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcbcff9640 1 -- 10.20.193.22:0/4268975711 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fdcac00fe70 con 0x7fdcc0060fb0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcc5dca640 1 -- 10.20.193.22:0/4268975711 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc00f6210 con 0x7fdcc0060fb0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.257+0000 7fdcc5dca640 1 -- 10.20.193.22:0/4268975711 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc00624c0 con 0x7fdcc0060fb0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.258+0000 7fdcbcff9640 1 -- 10.20.193.22:0/4268975711 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7fdcac00e5c0 con 0x7fdcc0060fb0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.258+0000 7fdcbcff9640 1 --2- 10.20.193.22:0/4268975711 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fdc9403f8f0 0x7fdc9405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.258+0000 7fdcbcff9640 1 -- 10.20.193.22:0/4268975711 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7fdcac052810 con 0x7fdcc0060fb0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.258+0000 7fdcbeffd640 1 --2- 10.20.193.22:0/4268975711 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fdc9403f8f0 0x7fdc9405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.260 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.258+0000 7fdcbeffd640 1 --2- 10.20.193.22:0/4268975711 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fdc9403f8f0 0x7fdc9405fda0 crc :-1 s=READY pgs=59 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.261 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.260+0000 7fdcbcff9640 1 -- 10.20.193.22:0/4268975711 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fdcac015e40 con 0x7fdcc0060fb0 2026-02-24T07:21:11.367 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.366+0000 7fdcc5dca640 1 -- 10.20.193.22:0/4268975711 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdcc005f3f0 con 0x7fdcc0060fb0 2026-02-24T07:21:11.368 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.367+0000 7fdcbcff9640 1 -- 10.20.193.22:0/4268975711 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+8658 (crc 0 0 0) 0x7fdcac009520 con 0x7fdcc0060fb0 2026-02-24T07:21:11.368 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:11.368 INFO:teuthology.orchestra.run.trial022.stdout:{"epoch":26,"fsid":"30400272-1151-11f1-be09-d404e6e7d460","created":"2026-02-24T07:19:58.590745+0000","modified":"2026-02-24T07:21:09.224142+0000","last_up_change":"2026-02-24T07:21:07.219077+0000","last_in_change":"2026-02-24T07:20:58.027518+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T07:20:58.403056+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ca990aad-309e-4860-89f8-220d9644f458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6802","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6803","nonce":3403491613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6804","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6805","nonce":3403491613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6808","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6809","nonce":3403491613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6806","nonce":3403491613},{"type":"v1","addr":"10.20.193.22:6807","nonce":3403491613}]},"public_addr":"10.20.193.22:6803/3403491613","cluster_addr":"10.20.193.22:6805/3403491613","heartbeat_back_addr":"10.20.193.22:6809/3403491613","heartbeat_front_addr":"10.20.193.22:6807/3403491613","state":["exists","up"]},{"osd":1,"uuid":"ca12e232-92e2-4ceb-a1ed-5a9001d238ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6810","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6811","nonce":242124904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6812","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6813","nonce":242124904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6816","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6817","nonce":242124904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.22:6814","nonce":242124904},{"type":"v1","addr":"10.20.193.22:6815","nonce":242124904}]},"public_addr":"10.20.193.22:6811/242124904","cluster_addr":"10.20.193.22:6813/242124904","heartbeat_back_addr":"10.20.193.22:6817/242124904","heartbeat_front_addr":"10.20.193.22:6815/242124904","state":["exists","up"]},{"osd":2,"uuid":"2931f5f7-673d-40d3-bf7a-fd6bc2e0c0d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6800","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6801","nonce":1597504938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6802","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6803","nonce":1597504938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6806","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6807","nonce":1597504938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6804","nonce":1597504938},{"type":"v1","addr":"10.20.193.195:6805","nonce":1597504938}]},"public_addr":"10.20.193.195:6801/1597504938","cluster_addr":"10.20.193.195:6803/1597504938","heartbeat_back_addr":"10.20.193.195:6807/1597504938","heartbeat_front_addr":"10.20.193.195:6805/1597504938","state":["exists","up"]},{"osd":3,"uuid":"b659885f-ccd3-4c7e-abd5-16c32191a9a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6808","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6809","nonce":3934829113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6810","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6811","nonce":3934829113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6814","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6815","nonce":3934829113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.195:6812","nonce":3934829113},{"type":"v1","addr":"10.20.193.195:6813","nonce":3934829113}]},"public_addr":"10.20.193.195:6809/3934829113","cluster_addr":"10.20.193.195:6811/3934829113","heartbeat_back_addr":"10.20.193.195:6815/3934829113","heartbeat_front_addr":"10.20.193.195:6813/3934829113","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:20:39.769190+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:20:47.514747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:20:56.625083+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T07:21:05.279025+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.22:0/3439864540":"2026-02-25T07:20:18.196776+0000","10.20.193.22:0/2896310664":"2026-02-25T07:20:18.196776+0000","10.20.193.22:6800/2169717366":"2026-02-25T07:20:18.196776+0000","10.20.193.22:0/125463061":"2026-02-25T07:20:18.196776+0000","10.20.193.22:0/360752884":"2026-02-25T07:20:08.618709+0000","10.20.193.22:0/3319117026":"2026-02-25T07:20:08.618709+0000","10.20.193.22:0/4242395366":"2026-02-25T07:20:08.618709+0000","10.20.193.22:6801/1400318633":"2026-02-25T07:20:08.618709+0000","10.20.193.22:6801/2169717366":"2026-02-25T07:20:18.196776+0000","10.20.193.22:6800/1400318633":"2026-02-25T07:20:08.618709+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T07:21:11.369 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.368+0000 7fdcc5dca640 1 -- 10.20.193.22:0/4268975711 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fdc9403f8f0 msgr2=0x7fdc9405fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.369 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.368+0000 7fdcc5dca640 1 --2- 10.20.193.22:0/4268975711 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fdc9403f8f0 0x7fdc9405fda0 crc :-1 s=READY pgs=59 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.369 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.368+0000 7fdcc5dca640 1 -- 10.20.193.22:0/4268975711 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fdcc0060fb0 msgr2=0x7fdcc00f0b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.369 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.368+0000 7fdcc5dca640 1 --2- 10.20.193.22:0/4268975711 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fdcc0060fb0 0x7fdcc00f0b10 crc :-1 s=READY pgs=173 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.369 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.368+0000 7fdcc5dca640 1 -- 10.20.193.22:0/4268975711 shutdown_connections 2026-02-24T07:21:11.369 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.368+0000 7fdcc5dca640 1 --2- 10.20.193.22:0/4268975711 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fdc9403f8f0 0x7fdc9405fda0 unknown :-1 s=CLOSED pgs=59 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.369 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.368+0000 7fdcc5dca640 1 --2- 10.20.193.22:0/4268975711 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fdcc0060fb0 0x7fdcc00f0b10 unknown :-1 s=CLOSED pgs=173 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.369 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.368+0000 7fdcc5dca640 1 -- 10.20.193.22:0/4268975711 >> 10.20.193.22:0/4268975711 conn(0x7fdcc00ea730 msgr2=0x7fdcc0130f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.369 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.368+0000 7fdcc5dca640 1 -- 10.20.193.22:0/4268975711 shutdown_connections 2026-02-24T07:21:11.369 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.368+0000 7fdcc5dca640 1 -- 10.20.193.22:0/4268975711 wait complete. 2026-02-24T07:21:11.404 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-24T07:21:11.404 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-24T07:21:11.404 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-24T07:21:11.405 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-24T07:21:11.522 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:11.523 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:11.523 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:11.524 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:11.629 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.629 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 1 -- 10.20.193.22:0/121943180 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb75410ce60 msgr2=0x7fb75410d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.629 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 1 --2- 10.20.193.22:0/121943180 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb75410ce60 0x7fb75410d230 crc :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=3967272363213484602 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.629 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.627+0000 7f83ad652640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.629 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.627+0000 7f83ad652640 1 -- 10.20.193.22:0/2438961075 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f83a8060fb0 msgr2=0x7f83a8061380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.627+0000 7f83ad652640 1 --2- 10.20.193.22:0/2438961075 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f83a8060fb0 0x7f83a8061380 crc :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=3664931493210800729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.627+0000 7f83ad652640 1 -- 10.20.193.22:0/2438961075 shutdown_connections 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.627+0000 7f83ad652640 1 --2- 10.20.193.22:0/2438961075 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f83a8060fb0 0x7f83a8061380 unknown :-1 s=CLOSED pgs=174 gs=1 cs=0 l=1 c_cookie=3664931493210800729 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.627+0000 7f83ad652640 1 -- 10.20.193.22:0/2438961075 >> 10.20.193.22:0/2438961075 conn(0x7f83a80ea730 msgr2=0x7f83a810ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.627+0000 7f83ad652640 1 -- 10.20.193.22:0/2438961075 shutdown_connections 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.627+0000 7f83ad652640 1 -- 10.20.193.22:0/2438961075 wait complete. 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83ad652640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 1 -- 10.20.193.22:0/121943180 shutdown_connections 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 1 --2- 10.20.193.22:0/121943180 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb75410ce60 0x7fb75410d230 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=3967272363213484602 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 1 -- 10.20.193.22:0/121943180 >> 10.20.193.22:0/121943180 conn(0x7fb7540ea730 msgr2=0x7fb75410ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83ad652640 1 Processor -- start 2026-02-24T07:21:11.630 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83ad652640 1 -- start start 2026-02-24T07:21:11.631 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 1 -- 10.20.193.22:0/121943180 shutdown_connections 2026-02-24T07:21:11.631 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 1 -- 10.20.193.22:0/121943180 wait complete. 2026-02-24T07:21:11.631 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83ad652640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f83a8060fb0 0x7f83a80f0b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.631 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83ad652640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80f1050 con 0x7f83a8060fb0 2026-02-24T07:21:11.631 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83a6ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f83a8060fb0 0x7f83a80f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.631 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83a6ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f83a8060fb0 0x7f83a80f0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46762/0 (socket says 10.20.193.22:46762) 2026-02-24T07:21:11.631 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83a6ffd640 1 -- 10.20.193.22:0/2926778982 learned_addr learned my addr 10.20.193.22:0/2926778982 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:11.631 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.631 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83a6ffd640 1 -- 10.20.193.22:0/2926778982 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a80f1190 con 0x7f83a8060fb0 2026-02-24T07:21:11.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83a6ffd640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f83a8060fb0 0x7f83a80f0b10 crc :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 1 Processor -- start 2026-02-24T07:21:11.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f8387fff640 1 -- 10.20.193.22:0/2926778982 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f839c00d690 con 0x7f83a8060fb0 2026-02-24T07:21:11.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a80f13e0 con 0x7f83a8060fb0 2026-02-24T07:21:11.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f8387fff640 1 -- 10.20.193.22:0/2926778982 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f839c00d7f0 con 0x7f83a8060fb0 2026-02-24T07:21:11.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f8387fff640 1 -- 10.20.193.22:0/2926778982 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f839c00fd70 con 0x7f83a8060fb0 2026-02-24T07:21:11.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a80f6210 con 0x7f83a8060fb0 2026-02-24T07:21:11.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.628+0000 7fb75a692640 1 -- start start 2026-02-24T07:21:11.632 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb75a692640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb75410ce60 0x7fb7540f0a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb75a692640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7540f0f40 con 0x7fb75410ce60 2026-02-24T07:21:11.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83a80532d0 con 0x7f83a8060fb0 2026-02-24T07:21:11.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb753fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb75410ce60 0x7fb7540f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb753fff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb75410ce60 0x7fb7540f0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46770/0 (socket says 10.20.193.22:46770) 2026-02-24T07:21:11.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb753fff640 1 -- 10.20.193.22:0/2796402295 learned_addr learned my addr 10.20.193.22:0/2796402295 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:11.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb753fff640 1 -- 10.20.193.22:0/2796402295 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7540f1080 con 0x7fb75410ce60 2026-02-24T07:21:11.633 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7f8387fff640 1 -- 10.20.193.22:0/2926778982 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f839c00f6b0 con 0x7f83a8060fb0 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb753fff640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb75410ce60 0x7fb7540f0a00 crc :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb7517fa640 1 -- 10.20.193.22:0/2796402295 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fb74000d690 con 0x7fb75410ce60 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb7517fa640 1 -- 10.20.193.22:0/2796402295 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fb74000d7f0 con 0x7fb75410ce60 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7540f12d0 con 0x7fb75410ce60 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb7517fa640 1 -- 10.20.193.22:0/2796402295 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fb74000fe70 con 0x7fb75410ce60 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7540f6100 con 0x7fb75410ce60 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7f8387fff640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f837c03f920 0x7f837c05fdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7f8387fff640 1 -- 10.20.193.22:0/2926778982 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7f839c052700 con 0x7f83a8060fb0 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7f83a67fc640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f837c03f920 0x7f837c05fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7f8387fff640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938] conn(0x7f837c062db0 0x7f837c0831e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7f8387fff640 1 -- 10.20.193.22:0/2926778982 --> [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f837c0838b0 con 0x7f837c062db0 2026-02-24T07:21:11.634 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7f8387fff640 1 -- 10.20.193.22:0/2926778982 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (crc 0 0 0) 0x7f839c016040 con 0x7f83a8060fb0 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.629+0000 7f0d58936640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 -- 10.20.193.22:0/1344671261 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0d5010f0f0 msgr2=0x7f0d5010f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 --2- 10.20.193.22:0/1344671261 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0d5010f0f0 0x7f0d5010f4c0 crc :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=13878187977637972167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7540532d0 con 0x7fb75410ce60 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 -- 10.20.193.22:0/1344671261 shutdown_connections 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 --2- 10.20.193.22:0/1344671261 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0d5010f0f0 0x7f0d5010f4c0 unknown :-1 s=CLOSED pgs=178 gs=1 cs=0 l=1 c_cookie=13878187977637972167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 -- 10.20.193.22:0/1344671261 >> 10.20.193.22:0/1344671261 conn(0x7f0d500ec9a0 msgr2=0x7f0d5010cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 -- 10.20.193.22:0/1344671261 shutdown_connections 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 -- 10.20.193.22:0/1344671261 wait complete. 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f83a67fc640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f837c03f920 0x7f837c05fdd0 crc :-1 s=READY pgs=60 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.635 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7fb7517fa640 1 -- 10.20.193.22:0/2796402295 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7fb7400026a0 con 0x7fb75410ce60 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f83a77fe640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938] conn(0x7f837c062db0 0x7f837c0831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 Processor -- start 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 -- start start 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7fb7517fa640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb72803f950 0x7fb72805fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7fb7517fa640 1 -- 10.20.193.22:0/2796402295 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7fb7400526f0 con 0x7fb75410ce60 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7fb7517fa640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904] conn(0x7fb728062de0 0x7fb728083210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7fb7517fa640 1 -- 10.20.193.22:0/2796402295 --> [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7280838e0 con 0x7fb728062de0 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7fb7517fa640 1 -- 10.20.193.22:0/2796402295 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (crc 0 0 0) 0x7fb740016040 con 0x7fb75410ce60 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7fb7537fe640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb72803f950 0x7fb72805fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0d5010f0f0 0x7f0d500f2e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500f33b0 con 0x7f0d5010f0f0 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d566ab640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0d5010f0f0 0x7f0d500f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.636 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d566ab640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0d5010f0f0 0x7f0d500f2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46788/0 (socket says 10.20.193.22:46788) 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d566ab640 1 -- 10.20.193.22:0/1414550270 learned_addr learned my addr 10.20.193.22:0/1414550270 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f83a77fe640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938] conn(0x7f837c062db0 0x7f837c0831e0 crc :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7fb758c08640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904] conn(0x7fb728062de0 0x7fb728083210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d566ab640 1 -- 10.20.193.22:0/1414550270 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d500f34f0 con 0x7f0d5010f0f0 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7fb7537fe640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb72803f950 0x7fb72805fe00 crc :-1 s=READY pgs=61 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d566ab640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0d5010f0f0 0x7f0d500f2e70 crc :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d3b7fe640 1 -- 10.20.193.22:0/1414550270 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0d4800d690 con 0x7f0d5010f0f0 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d500f3740 con 0x7f0d5010f0f0 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d3b7fe640 1 -- 10.20.193.22:0/1414550270 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f0d4800d7f0 con 0x7f0d5010f0f0 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.630+0000 7f0d3b7fe640 1 -- 10.20.193.22:0/1414550270 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f0d4800fe70 con 0x7f0d5010f0f0 2026-02-24T07:21:11.637 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d500f8570 con 0x7f0d5010f0f0 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7fb758c08640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904] conn(0x7fb728062de0 0x7fb728083210 crc :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d18000f20 con 0x7f0d5010f0f0 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d3b7fe640 1 -- 10.20.193.22:0/1414550270 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f0d480026a0 con 0x7f0d5010f0f0 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f8387fff640 1 -- 10.20.193.22:0/2926778982 <== osd.2 v2:10.20.193.195:6800/1597504938 1 ==== command_reply(tid 1: 0 ) ==== 8+0+34632 (crc 0 0 0) 0x7f837c0838b0 con 0x7f837c062db0 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f8519620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f8519620640 1 -- 10.20.193.22:0/3764844924 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f851410b540 msgr2=0x7f851410b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f8519620640 1 --2- 10.20.193.22:0/3764844924 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f851410b540 0x7f851410b910 crc :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=4847001823022575836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d3b7fe640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0d2c03f8f0 0x7f0d2c05fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d3b7fe640 1 -- 10.20.193.22:0/1414550270 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7f0d480527a0 con 0x7f0d5010f0f0 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7fb7517fa640 1 -- 10.20.193.22:0/2796402295 <== osd.1 v2:10.20.193.22:6810/242124904 1 ==== command_reply(tid 1: 0 ) ==== 8+0+34632 (crc 0 0 0) 0x7fb7280838e0 con 0x7fb728062de0 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d3b7fe640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613] conn(0x7f0d2c062d80 0x7f0d2c0831b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d3b7fe640 1 -- 10.20.193.22:0/1414550270 --> [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d2c083880 con 0x7f0d2c062d80 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d3b7fe640 1 -- 10.20.193.22:0/1414550270 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (crc 0 0 0) 0x7f0d48016040 con 0x7f0d5010f0f0 2026-02-24T07:21:11.638 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d55eaa640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0d2c03f8f0 0x7f0d2c05fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.639 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f8519620640 1 -- 10.20.193.22:0/3764844924 shutdown_connections 2026-02-24T07:21:11.639 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f8519620640 1 --2- 10.20.193.22:0/3764844924 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f851410b540 0x7f851410b910 unknown :-1 s=CLOSED pgs=180 gs=1 cs=0 l=1 c_cookie=4847001823022575836 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.639 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f8519620640 1 -- 10.20.193.22:0/3764844924 >> 10.20.193.22:0/3764844924 conn(0x7f85140e91c0 msgr2=0x7f85141095d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.639 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f8519620640 1 -- 10.20.193.22:0/3764844924 shutdown_connections 2026-02-24T07:21:11.639 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f8519620640 1 -- 10.20.193.22:0/3764844924 wait complete. 2026-02-24T07:21:11.639 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d56eac640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613] conn(0x7f0d2c062d80 0x7f0d2c0831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.639 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.631+0000 7f0d55eaa640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0d2c03f8f0 0x7f0d2c05fda0 crc :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.639 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.632+0000 7f0d56eac640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613] conn(0x7f0d2c062d80 0x7f0d2c0831b0 crc :-1 s=READY pgs=5 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.639 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.632+0000 7f8519620640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.639 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.632+0000 7f0d3b7fe640 1 -- 10.20.193.22:0/1414550270 <== osd.0 v2:10.20.193.22:6802/3403491613 1 ==== command_reply(tid 1: 0 ) ==== 8+0+34632 (crc 0 0 0) 0x7f0d2c083880 con 0x7f0d2c062d80 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.632+0000 7f8519620640 1 Processor -- start 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.632+0000 7f8519620640 1 -- start start 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.632+0000 7f8519620640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f851410b540 0x7f851411a660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f8519620640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f851411aba0 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f8512ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f851410b540 0x7f851411a660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f8512ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f851410b540 0x7f851411a660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46808/0 (socket says 10.20.193.22:46808) 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f8512ffd640 1 -- 10.20.193.22:0/3749702990 learned_addr learned my addr 10.20.193.22:0/3749702990 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f8512ffd640 1 -- 10.20.193.22:0/3749702990 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851411ace0 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f8512ffd640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f851410b540 0x7f851411a660 crc :-1 s=READY pgs=181 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f84f3fff640 1 -- 10.20.193.22:0/3749702990 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f850800d690 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f84f3fff640 1 -- 10.20.193.22:0/3749702990 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f850800d7f0 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f84f3fff640 1 -- 10.20.193.22:0/3749702990 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f850800fd70 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851411af30 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f851411fd60 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.633+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f85140532d0 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.634+0000 7f84f3fff640 1 -- 10.20.193.22:0/3749702990 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f850800e5c0 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.634+0000 7f84f3fff640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f84e803f970 0x7f84e805fe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.634+0000 7f84f3fff640 1 -- 10.20.193.22:0/3749702990 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7f8508051700 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.634+0000 7f85127fc640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f84e803f970 0x7f84e805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.634+0000 7f84f3fff640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113] conn(0x7f84e8063660 0x7f84e8083af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.634+0000 7f84f3fff640 1 -- 10.20.193.22:0/3749702990 --> [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84e8084240 con 0x7f84e8063660 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.634+0000 7f84f3fff640 1 -- 10.20.193.22:0/3749702990 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (crc 0 0 0) 0x7f8508016040 con 0x7f851410b540 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.634+0000 7f85127fc640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f84e803f970 0x7f84e805fe20 crc :-1 s=READY pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.640 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.634+0000 7f85137fe640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113] conn(0x7f84e8063660 0x7f84e8083af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.635+0000 7f85137fe640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113] conn(0x7f84e8063660 0x7f84e8083af0 crc :-1 s=READY pgs=5 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.635+0000 7f84f3fff640 1 -- 10.20.193.22:0/3749702990 <== osd.3 v2:10.20.193.195:6808/3934829113 1 ==== command_reply(tid 1: 0 ) ==== 8+0+34632 (crc 0 0 0) 0x7f84e8084240 con 0x7f84e8063660 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.639+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 --> [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83a81378a0 con 0x7f837c062db0 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.639+0000 7f8387fff640 1 -- 10.20.193.22:0/2926778982 <== osd.2 v2:10.20.193.195:6800/1597504938 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f83a81378a0 con 0x7f837c062db0 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 >> [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938] conn(0x7f837c062db0 msgr2=0x7f837c0831e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938] conn(0x7f837c062db0 0x7f837c0831e0 crc :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f837c03f920 msgr2=0x7f837c05fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f837c03f920 0x7f837c05fdd0 crc :-1 s=READY pgs=60 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f83a8060fb0 msgr2=0x7f83a80f0b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f83a8060fb0 0x7f83a80f0b10 crc :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 shutdown_connections 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.195:6800/1597504938,v1:10.20.193.195:6801/1597504938] conn(0x7f837c062db0 0x7f837c0831e0 unknown :-1 s=CLOSED pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f837c03f920 0x7f837c05fdd0 unknown :-1 s=CLOSED pgs=60 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 --2- 10.20.193.22:0/2926778982 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f83a8060fb0 0x7f83a80f0b10 unknown :-1 s=CLOSED pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 >> 10.20.193.22:0/2926778982 conn(0x7f83a80ea730 msgr2=0x7f83a8130f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 shutdown_connections 2026-02-24T07:21:11.641 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7f83ad652640 1 -- 10.20.193.22:0/2926778982 wait complete. 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 --> [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb754135640 con 0x7fb728062de0 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb7517fa640 1 -- 10.20.193.22:0/2796402295 <== osd.1 v2:10.20.193.22:6810/242124904 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb754135640 con 0x7fb728062de0 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904] conn(0x7fb728062de0 msgr2=0x7fb728083210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904] conn(0x7fb728062de0 0x7fb728083210 crc :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb72803f950 msgr2=0x7fb72805fe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb72803f950 0x7fb72805fe00 crc :-1 s=READY pgs=61 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb75410ce60 msgr2=0x7fb7540f0a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb75410ce60 0x7fb7540f0a00 crc :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 shutdown_connections 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6810/242124904,v1:10.20.193.22:6811/242124904] conn(0x7fb728062de0 0x7fb728083210 unknown :-1 s=CLOSED pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fb72803f950 0x7fb72805fe00 unknown :-1 s=CLOSED pgs=61 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 --2- 10.20.193.22:0/2796402295 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb75410ce60 0x7fb7540f0a00 unknown :-1 s=CLOSED pgs=177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 >> 10.20.193.22:0/2796402295 conn(0x7fb7540ea730 msgr2=0x7fb75410fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.640+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 shutdown_connections 2026-02-24T07:21:11.642 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.641+0000 7fb75a692640 1 -- 10.20.193.22:0/2796402295 wait complete. 2026-02-24T07:21:11.643 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 --> [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d18002c10 con 0x7f0d2c062d80 2026-02-24T07:21:11.643 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d3b7fe640 1 -- 10.20.193.22:0/1414550270 <== osd.0 v2:10.20.193.22:6802/3403491613 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0d18002c10 con 0x7f0d2c062d80 2026-02-24T07:21:11.643 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613] conn(0x7f0d2c062d80 msgr2=0x7f0d2c0831b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.643 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613] conn(0x7f0d2c062d80 0x7f0d2c0831b0 crc :-1 s=READY pgs=5 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0d2c03f8f0 msgr2=0x7f0d2c05fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0d2c03f8f0 0x7f0d2c05fda0 crc :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0d5010f0f0 msgr2=0x7f0d500f2e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0d5010f0f0 0x7f0d500f2e70 crc :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 shutdown_connections 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6802/3403491613,v1:10.20.193.22:6803/3403491613] conn(0x7f0d2c062d80 0x7f0d2c0831b0 unknown :-1 s=CLOSED pgs=5 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f0d2c03f8f0 0x7f0d2c05fda0 unknown :-1 s=CLOSED pgs=62 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 --2- 10.20.193.22:0/1414550270 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f0d5010f0f0 0x7f0d500f2e70 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 >> 10.20.193.22:0/1414550270 conn(0x7f0d500ec9a0 msgr2=0x7f0d5010d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 shutdown_connections 2026-02-24T07:21:11.644 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.642+0000 7f0d58936640 1 -- 10.20.193.22:0/1414550270 wait complete. 2026-02-24T07:21:11.645 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.644+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 --> [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8514136b70 con 0x7f84e8063660 2026-02-24T07:21:11.645 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.644+0000 7f84f3fff640 1 -- 10.20.193.22:0/3749702990 <== osd.3 v2:10.20.193.195:6808/3934829113 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8514136b70 con 0x7f84e8063660 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 >> [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113] conn(0x7f84e8063660 msgr2=0x7f84e8083af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113] conn(0x7f84e8063660 0x7f84e8083af0 crc :-1 s=READY pgs=5 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f84e803f970 msgr2=0x7f84e805fe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f84e803f970 0x7f84e805fe20 crc :-1 s=READY pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f851410b540 msgr2=0x7f851411a660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f851410b540 0x7f851411a660 crc :-1 s=READY pgs=181 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 shutdown_connections 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.195:6808/3934829113,v1:10.20.193.195:6809/3934829113] conn(0x7f84e8063660 0x7f84e8083af0 unknown :-1 s=CLOSED pgs=5 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f84e803f970 0x7f84e805fe20 unknown :-1 s=CLOSED pgs=63 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 --2- 10.20.193.22:0/3749702990 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f851410b540 0x7f851411a660 unknown :-1 s=CLOSED pgs=181 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 >> 10.20.193.22:0/3749702990 conn(0x7f85140e91c0 msgr2=0x7f85141095a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 shutdown_connections 2026-02-24T07:21:11.646 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.645+0000 7f8519620640 1 -- 10.20.193.22:0/3749702990 wait complete. 2026-02-24T07:21:11.684 INFO:teuthology.orchestra.run.trial022.stdout:38654705673 2026-02-24T07:21:11.684 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T07:21:11.688 INFO:teuthology.orchestra.run.trial022.stdout:55834574856 2026-02-24T07:21:11.688 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T07:21:11.689 INFO:teuthology.orchestra.run.trial022.stdout:103079215108 2026-02-24T07:21:11.689 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T07:21:11.694 INFO:teuthology.orchestra.run.trial022.stdout:77309411333 2026-02-24T07:21:11.695 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T07:21:11.801 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:11.852 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:11.855 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:11.896 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:11.912 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.908+0000 7f1ee3a27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.913 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.908+0000 7f1ee3a27640 1 -- 10.20.193.22:0/1551285804 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1edc10f100 msgr2=0x7f1edc10f4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.913 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.908+0000 7f1ee3a27640 1 --2- 10.20.193.22:0/1551285804 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1edc10f100 0x7f1edc10f4d0 crc :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=11520771519893264832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.913 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee3a27640 1 -- 10.20.193.22:0/1551285804 shutdown_connections 2026-02-24T07:21:11.913 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee3a27640 1 --2- 10.20.193.22:0/1551285804 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1edc10f100 0x7f1edc10f4d0 unknown :-1 s=CLOSED pgs=182 gs=1 cs=0 l=1 c_cookie=11520771519893264832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.913 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee3a27640 1 -- 10.20.193.22:0/1551285804 >> 10.20.193.22:0/1551285804 conn(0x7f1edc0ec9b0 msgr2=0x7f1edc10cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.913 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee3a27640 1 -- 10.20.193.22:0/1551285804 shutdown_connections 2026-02-24T07:21:11.913 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee3a27640 1 -- 10.20.193.22:0/1551285804 wait complete. 2026-02-24T07:21:11.913 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee3a27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee3a27640 1 Processor -- start 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee3a27640 1 -- start start 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee3a27640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1edc10f100 0x7f1edc0f2de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee3a27640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc0f3320 con 0x7f1edc10f100 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee179c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1edc10f100 0x7f1edc0f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee179c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1edc10f100 0x7f1edc0f2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46822/0 (socket says 10.20.193.22:46822) 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee179c640 1 -- 10.20.193.22:0/3084522296 learned_addr learned my addr 10.20.193.22:0/3084522296 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee179c640 1 -- 10.20.193.22:0/3084522296 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1edc0f3460 con 0x7f1edc10f100 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.909+0000 7f1ee179c640 1 --2- 10.20.193.22:0/3084522296 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1edc10f100 0x7f1edc0f2de0 crc :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.910+0000 7f1eca7fc640 1 -- 10.20.193.22:0/3084522296 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f1ecc00d690 con 0x7f1edc10f100 2026-02-24T07:21:11.914 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.910+0000 7f1ee3a27640 1 -- 10.20.193.22:0/3084522296 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1edc0f36b0 con 0x7f1edc10f100 2026-02-24T07:21:11.915 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.910+0000 7f1eca7fc640 1 -- 10.20.193.22:0/3084522296 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f1ecc00d7f0 con 0x7f1edc10f100 2026-02-24T07:21:11.915 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.910+0000 7f1eca7fc640 1 -- 10.20.193.22:0/3084522296 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f1ecc00fd70 con 0x7f1edc10f100 2026-02-24T07:21:11.915 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.910+0000 7f1ee3a27640 1 -- 10.20.193.22:0/3084522296 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1edc0f84e0 con 0x7f1edc10f100 2026-02-24T07:21:11.915 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.910+0000 7f1ee3a27640 1 -- 10.20.193.22:0/3084522296 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1edc113c00 con 0x7f1edc10f100 2026-02-24T07:21:11.915 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.910+0000 7f1eca7fc640 1 -- 10.20.193.22:0/3084522296 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f1ecc00f6b0 con 0x7f1edc10f100 2026-02-24T07:21:11.915 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.910+0000 7f1eca7fc640 1 --2- 10.20.193.22:0/3084522296 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1eb803f970 0x7f1eb805fe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.915 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.910+0000 7f1eca7fc640 1 -- 10.20.193.22:0/3084522296 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7f1ecc0525f0 con 0x7f1edc10f100 2026-02-24T07:21:11.915 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.911+0000 7f1ee0f9b640 1 --2- 10.20.193.22:0/3084522296 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1eb803f970 0x7f1eb805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.915 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.911+0000 7f1ee0f9b640 1 --2- 10.20.193.22:0/3084522296 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1eb803f970 0x7f1eb805fe20 crc :-1 s=READY pgs=64 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.916 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.913+0000 7f1eca7fc640 1 -- 10.20.193.22:0/3084522296 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f1ecc0071c0 con 0x7f1edc10f100 2026-02-24T07:21:11.947 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 systemd[1]: Started Ceph prometheus.a for 30400272-1151-11f1-be09-d404e6e7d460. 2026-02-24T07:21:11.961 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.961 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 1 -- 10.20.193.22:0/452671256 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3f0410ce60 msgr2=0x7f3f0410d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.961 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 1 --2- 10.20.193.22:0/452671256 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3f0410ce60 0x7f3f0410d230 crc :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=17921463774938480964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.961 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 1 -- 10.20.193.22:0/452671256 shutdown_connections 2026-02-24T07:21:11.961 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 1 --2- 10.20.193.22:0/452671256 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3f0410ce60 0x7f3f0410d230 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=17921463774938480964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.962 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 1 -- 10.20.193.22:0/452671256 >> 10.20.193.22:0/452671256 conn(0x7f3f040ea730 msgr2=0x7f3f0410ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.962 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f42eaaf4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.962 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 1 -- 10.20.193.22:0/452671256 shutdown_connections 2026-02-24T07:21:11.963 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 1 -- 10.20.193.22:0/452671256 wait complete. 2026-02-24T07:21:11.963 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f42eaaf4640 1 -- 10.20.193.22:0/621450558 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f42e410f0f0 msgr2=0x7f42e410f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:11.963 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f42eaaf4640 1 --2- 10.20.193.22:0/621450558 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f42e410f0f0 0x7f42e410f4c0 crc :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=6756181965952531662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.963 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f42eaaf4640 1 -- 10.20.193.22:0/621450558 shutdown_connections 2026-02-24T07:21:11.963 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f42eaaf4640 1 --2- 10.20.193.22:0/621450558 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f42e410f0f0 0x7f42e410f4c0 unknown :-1 s=CLOSED pgs=185 gs=1 cs=0 l=1 c_cookie=6756181965952531662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:11.963 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f42eaaf4640 1 -- 10.20.193.22:0/621450558 >> 10.20.193.22:0/621450558 conn(0x7f42e40ec9a0 msgr2=0x7f42e410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:11.964 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f42eaaf4640 1 -- 10.20.193.22:0/621450558 shutdown_connections 2026-02-24T07:21:11.964 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.964 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f42eaaf4640 1 -- 10.20.193.22:0/621450558 wait complete. 2026-02-24T07:21:11.965 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f42eaaf4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:11.965 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 1 Processor -- start 2026-02-24T07:21:11.965 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f3f0af9c640 1 -- start start 2026-02-24T07:21:11.966 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.959+0000 7f42eaaf4640 1 Processor -- start 2026-02-24T07:21:11.966 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f42eaaf4640 1 -- start start 2026-02-24T07:21:11.966 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f3f0af9c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3f0410ce60 0x7f3f040f0c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.967 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f3f0af9c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3f040f1140 con 0x7f3f0410ce60 2026-02-24T07:21:11.967 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f3f08d11640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3f0410ce60 0x7f3f040f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.967 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f3f08d11640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3f0410ce60 0x7f3f040f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46842/0 (socket says 10.20.193.22:46842) 2026-02-24T07:21:11.967 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f3f08d11640 1 -- 10.20.193.22:0/1561434772 learned_addr learned my addr 10.20.193.22:0/1561434772 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:11.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f42eaaf4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f42e410f0f0 0x7f42e40f2e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f42eaaf4640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f42e40f33b0 con 0x7f42e410f0f0 2026-02-24T07:21:11.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f42e8869640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f42e410f0f0 0x7f42e40f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f42e8869640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f42e410f0f0 0x7f42e40f2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46854/0 (socket says 10.20.193.22:46854) 2026-02-24T07:21:11.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f42e8869640 1 -- 10.20.193.22:0/2391161687 learned_addr learned my addr 10.20.193.22:0/2391161687 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:11.968 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f3f08d11640 1 -- 10.20.193.22:0/1561434772 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f040f1280 con 0x7f3f0410ce60 2026-02-24T07:21:11.969 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f3f08d11640 1 --2- 10.20.193.22:0/1561434772 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3f0410ce60 0x7f3f040f0c00 crc :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.969 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f42e8869640 1 -- 10.20.193.22:0/2391161687 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e40f34f0 con 0x7f42e410f0f0 2026-02-24T07:21:11.969 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.960+0000 7f42e8869640 1 --2- 10.20.193.22:0/2391161687 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f42e410f0f0 0x7f42e40f2e70 crc :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.970 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f42d9ffb640 1 -- 10.20.193.22:0/2391161687 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f42d400d690 con 0x7f42e410f0f0 2026-02-24T07:21:11.970 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f42eaaf4640 1 -- 10.20.193.22:0/2391161687 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e40f3740 con 0x7f42e410f0f0 2026-02-24T07:21:11.970 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f3ef9ffb640 1 -- 10.20.193.22:0/1561434772 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f3ef400d690 con 0x7f3f0410ce60 2026-02-24T07:21:11.970 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f42d9ffb640 1 -- 10.20.193.22:0/2391161687 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f42d400d7f0 con 0x7f42e410f0f0 2026-02-24T07:21:11.971 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f42d9ffb640 1 -- 10.20.193.22:0/2391161687 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f42d400fe70 con 0x7f42e410f0f0 2026-02-24T07:21:11.971 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f3f0af9c640 1 -- 10.20.193.22:0/1561434772 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f040f14d0 con 0x7f3f0410ce60 2026-02-24T07:21:11.971 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f3ef9ffb640 1 -- 10.20.193.22:0/1561434772 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f3ef400d7f0 con 0x7f3f0410ce60 2026-02-24T07:21:11.971 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f3ef9ffb640 1 -- 10.20.193.22:0/1561434772 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f3ef400fe70 con 0x7f3f0410ce60 2026-02-24T07:21:11.972 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f42eaaf4640 1 -- 10.20.193.22:0/2391161687 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e40f8570 con 0x7f42e410f0f0 2026-02-24T07:21:11.972 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f3f0af9c640 1 -- 10.20.193.22:0/1561434772 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f040f6300 con 0x7f3f0410ce60 2026-02-24T07:21:11.972 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f42eaaf4640 1 -- 10.20.193.22:0/2391161687 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e41103d0 con 0x7f42e410f0f0 2026-02-24T07:21:11.973 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f3f0af9c640 1 -- 10.20.193.22:0/1561434772 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f0410e140 con 0x7f3f0410ce60 2026-02-24T07:21:11.973 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f42d9ffb640 1 -- 10.20.193.22:0/2391161687 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f42d40026a0 con 0x7f42e410f0f0 2026-02-24T07:21:11.974 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.961+0000 7f3ef9ffb640 1 -- 10.20.193.22:0/1561434772 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f3ef400e5c0 con 0x7f3f0410ce60 2026-02-24T07:21:11.974 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.962+0000 7f3ef9ffb640 1 --2- 10.20.193.22:0/1561434772 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f3ee003f8f0 0x7f3ee005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.974 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.962+0000 7f42d9ffb640 1 --2- 10.20.193.22:0/2391161687 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f42c003f950 0x7f42c005fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:11.974 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.962+0000 7f42d9ffb640 1 -- 10.20.193.22:0/2391161687 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7f42d40526f0 con 0x7f42e410f0f0 2026-02-24T07:21:11.975 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.962+0000 7f3ef9ffb640 1 -- 10.20.193.22:0/1561434772 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7f3ef40527e0 con 0x7f3f0410ce60 2026-02-24T07:21:11.975 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.962+0000 7f42dbfff640 1 --2- 10.20.193.22:0/2391161687 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f42c003f950 0x7f42c005fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.975 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.962+0000 7f42dbfff640 1 --2- 10.20.193.22:0/2391161687 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f42c003f950 0x7f42c005fe00 crc :-1 s=READY pgs=65 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.976 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.962+0000 7f3efbfff640 1 --2- 10.20.193.22:0/1561434772 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f3ee003f8f0 0x7f3ee005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:11.976 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.962+0000 7f3efbfff640 1 --2- 10.20.193.22:0/1561434772 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f3ee003f8f0 0x7f3ee005fda0 crc :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:11.976 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.964+0000 7f42d9ffb640 1 -- 10.20.193.22:0/2391161687 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f42d400e5c0 con 0x7f42e410f0f0 2026-02-24T07:21:11.976 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:11.966+0000 7f3ef9ffb640 1 -- 10.20.193.22:0/1561434772 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f3ef4015e40 con 0x7f3f0410ce60 2026-02-24T07:21:12.009 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.007+0000 7f6b05c65640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:12.009 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.007+0000 7f6b05c65640 1 -- 10.20.193.22:0/3182016934 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6b0010f0f0 msgr2=0x7f6b0010f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:12.009 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.007+0000 7f6b05c65640 1 --2- 10.20.193.22:0/3182016934 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6b0010f0f0 0x7f6b0010f4c0 crc :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=1061698273632765169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.009 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.007+0000 7f6b05c65640 1 -- 10.20.193.22:0/3182016934 shutdown_connections 2026-02-24T07:21:12.009 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.007+0000 7f6b05c65640 1 --2- 10.20.193.22:0/3182016934 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6b0010f0f0 0x7f6b0010f4c0 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=1061698273632765169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.009 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.007+0000 7f6b05c65640 1 -- 10.20.193.22:0/3182016934 >> 10.20.193.22:0/3182016934 conn(0x7f6b000ec9a0 msgr2=0x7f6b0010cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:12.009 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.007+0000 7f6b05c65640 1 -- 10.20.193.22:0/3182016934 shutdown_connections 2026-02-24T07:21:12.009 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.007+0000 7f6b05c65640 1 -- 10.20.193.22:0/3182016934 wait complete. 2026-02-24T07:21:12.009 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6b05c65640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:12.010 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6b05c65640 1 Processor -- start 2026-02-24T07:21:12.010 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6b05c65640 1 -- start start 2026-02-24T07:21:12.010 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6b05c65640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6b0010f0f0 0x7f6b000f2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:12.010 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6b05c65640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b000f3360 con 0x7f6b0010f0f0 2026-02-24T07:21:12.010 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6aff7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6b0010f0f0 0x7f6b000f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:12.010 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6aff7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6b0010f0f0 0x7f6b000f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46886/0 (socket says 10.20.193.22:46886) 2026-02-24T07:21:12.010 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6aff7fe640 1 -- 10.20.193.22:0/2863590499 learned_addr learned my addr 10.20.193.22:0/2863590499 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6aff7fe640 1 -- 10.20.193.22:0/2863590499 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b000f34a0 con 0x7f6b0010f0f0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6aff7fe640 1 --2- 10.20.193.22:0/2863590499 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6b0010f0f0 0x7f6b000f2e20 crc :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6afcff9640 1 -- 10.20.193.22:0/2863590499 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f6aec00d690 con 0x7f6b0010f0f0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6b05c65640 1 -- 10.20.193.22:0/2863590499 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b000f36f0 con 0x7f6b0010f0f0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6afcff9640 1 -- 10.20.193.22:0/2863590499 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f6aec00d7f0 con 0x7f6b0010f0f0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6afcff9640 1 -- 10.20.193.22:0/2863590499 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f6aec00fd70 con 0x7f6b0010f0f0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.008+0000 7f6b05c65640 1 -- 10.20.193.22:0/2863590499 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b000f8520 con 0x7f6b0010f0f0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.009+0000 7f6b05c65640 1 -- 10.20.193.22:0/2863590499 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b001103d0 con 0x7f6b0010f0f0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.009+0000 7f6afcff9640 1 -- 10.20.193.22:0/2863590499 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 14) ==== 52926+0+0 (crc 0 0 0) 0x7f6aec00f6b0 con 0x7f6b0010f0f0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.009+0000 7f6afcff9640 1 --2- 10.20.193.22:0/2863590499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6ad403f920 0x7f6ad405fdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.009+0000 7f6afcff9640 1 -- 10.20.193.22:0/2863590499 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7f6aec052700 con 0x7f6b0010f0f0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.009+0000 7f6afeffd640 1 --2- 10.20.193.22:0/2863590499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6ad403f920 0x7f6ad405fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:12.011 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.010+0000 7f6afeffd640 1 --2- 10.20.193.22:0/2863590499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6ad403f920 0x7f6ad405fdd0 crc :-1 s=READY pgs=67 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:12.013 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.012+0000 7f6afcff9640 1 -- 10.20.193.22:0/2863590499 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f6aec0071c0 con 0x7f6b0010f0f0 2026-02-24T07:21:12.024 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.023+0000 7f1ee3a27640 1 -- 10.20.193.22:0/3084522296 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1edc05f110 con 0x7f1edc10f100 2026-02-24T07:21:12.024 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.023+0000 7f1eca7fc640 1 -- 10.20.193.22:0/3084522296 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f1ecc0071c0 con 0x7f1edc10f100 2026-02-24T07:21:12.025 INFO:teuthology.orchestra.run.trial022.stdout:38654705671 2026-02-24T07:21:12.027 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.025+0000 7f1ee3a27640 1 -- 10.20.193.22:0/3084522296 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1eb803f970 msgr2=0x7f1eb805fe20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:12.027 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.025+0000 7f1ee3a27640 1 --2- 10.20.193.22:0/3084522296 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1eb803f970 0x7f1eb805fe20 crc :-1 s=READY pgs=64 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.027 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.025+0000 7f1ee3a27640 1 -- 10.20.193.22:0/3084522296 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1edc10f100 msgr2=0x7f1edc0f2de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:12.027 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.025+0000 7f1ee3a27640 1 --2- 10.20.193.22:0/3084522296 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1edc10f100 0x7f1edc0f2de0 crc :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.027 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.026+0000 7f1ee3a27640 1 -- 10.20.193.22:0/3084522296 shutdown_connections 2026-02-24T07:21:12.027 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.026+0000 7f1ee3a27640 1 --2- 10.20.193.22:0/3084522296 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f1eb803f970 0x7f1eb805fe20 unknown :-1 s=CLOSED pgs=64 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.027 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.026+0000 7f1ee3a27640 1 --2- 10.20.193.22:0/3084522296 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f1edc10f100 0x7f1edc0f2de0 unknown :-1 s=CLOSED pgs=183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.027 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.026+0000 7f1ee3a27640 1 -- 10.20.193.22:0/3084522296 >> 10.20.193.22:0/3084522296 conn(0x7f1edc0ec9b0 msgr2=0x7f1edc13a010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:12.027 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.026+0000 7f1ee3a27640 1 -- 10.20.193.22:0/3084522296 shutdown_connections 2026-02-24T07:21:12.027 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.026+0000 7f1ee3a27640 1 -- 10.20.193.22:0/3084522296 wait complete. 2026-02-24T07:21:12.063 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705673 got 38654705671 for osd.0 2026-02-24T07:21:12.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.071+0000 7f42eaaf4640 1 -- 10.20.193.22:0/2391161687 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f42e4137680 con 0x7f42e410f0f0 2026-02-24T07:21:12.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.071+0000 7f42d9ffb640 1 -- 10.20.193.22:0/2391161687 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f42d4009520 con 0x7f42e410f0f0 2026-02-24T07:21:12.073 INFO:teuthology.orchestra.run.trial022.stdout:55834574855 2026-02-24T07:21:12.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.073+0000 7f42eaaf4640 1 -- 10.20.193.22:0/2391161687 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f42c003f950 msgr2=0x7f42c005fe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:12.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.073+0000 7f42eaaf4640 1 --2- 10.20.193.22:0/2391161687 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f42c003f950 0x7f42c005fe00 crc :-1 s=READY pgs=65 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.073+0000 7f42eaaf4640 1 -- 10.20.193.22:0/2391161687 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f42e410f0f0 msgr2=0x7f42e40f2e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:12.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.073+0000 7f42eaaf4640 1 --2- 10.20.193.22:0/2391161687 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f42e410f0f0 0x7f42e40f2e70 crc :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.073+0000 7f42eaaf4640 1 -- 10.20.193.22:0/2391161687 shutdown_connections 2026-02-24T07:21:12.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.073+0000 7f42eaaf4640 1 --2- 10.20.193.22:0/2391161687 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f42c003f950 0x7f42c005fe00 unknown :-1 s=CLOSED pgs=65 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.073+0000 7f42eaaf4640 1 --2- 10.20.193.22:0/2391161687 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f42e410f0f0 0x7f42e40f2e70 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.073+0000 7f42eaaf4640 1 -- 10.20.193.22:0/2391161687 >> 10.20.193.22:0/2391161687 conn(0x7f42e40ec9a0 msgr2=0x7f42e410d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:12.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.073+0000 7f42eaaf4640 1 -- 10.20.193.22:0/2391161687 shutdown_connections 2026-02-24T07:21:12.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.073+0000 7f42eaaf4640 1 -- 10.20.193.22:0/2391161687 wait complete. 2026-02-24T07:21:12.079 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.078+0000 7f3f0af9c640 1 -- 10.20.193.22:0/1561434772 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3f041353f0 con 0x7f3f0410ce60 2026-02-24T07:21:12.079 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.078+0000 7f3ef9ffb640 1 -- 10.20.193.22:0/1561434772 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (crc 0 0 0) 0x7f3ef4009520 con 0x7f3f0410ce60 2026-02-24T07:21:12.080 INFO:teuthology.orchestra.run.trial022.stdout:103079215107 2026-02-24T07:21:12.082 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.081+0000 7f3f0af9c640 1 -- 10.20.193.22:0/1561434772 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f3ee003f8f0 msgr2=0x7f3ee005fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:12.082 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.081+0000 7f3f0af9c640 1 --2- 10.20.193.22:0/1561434772 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f3ee003f8f0 0x7f3ee005fda0 crc :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.082 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.081+0000 7f3f0af9c640 1 -- 10.20.193.22:0/1561434772 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3f0410ce60 msgr2=0x7f3f040f0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:12.082 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.081+0000 7f3f0af9c640 1 --2- 10.20.193.22:0/1561434772 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3f0410ce60 0x7f3f040f0c00 crc :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.082 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.081+0000 7f3f0af9c640 1 -- 10.20.193.22:0/1561434772 shutdown_connections 2026-02-24T07:21:12.082 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.081+0000 7f3f0af9c640 1 --2- 10.20.193.22:0/1561434772 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f3ee003f8f0 0x7f3ee005fda0 unknown :-1 s=CLOSED pgs=66 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.082 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.081+0000 7f3f0af9c640 1 --2- 10.20.193.22:0/1561434772 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f3f0410ce60 0x7f3f040f0c00 unknown :-1 s=CLOSED pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.082 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.081+0000 7f3f0af9c640 1 -- 10.20.193.22:0/1561434772 >> 10.20.193.22:0/1561434772 conn(0x7f3f040ea730 msgr2=0x7f3f0410b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:12.083 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.081+0000 7f3f0af9c640 1 -- 10.20.193.22:0/1561434772 shutdown_connections 2026-02-24T07:21:12.083 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.081+0000 7f3f0af9c640 1 -- 10.20.193.22:0/1561434772 wait complete. 2026-02-24T07:21:12.112 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2026-02-24T07:21:12.123 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215108 got 103079215107 for osd.3 2026-02-24T07:21:12.124 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.122+0000 7f6b05c65640 1 -- 10.20.193.22:0/2863590499 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6b001375f0 con 0x7f6b0010f0f0 2026-02-24T07:21:12.125 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.122+0000 7f6afcff9640 1 -- 10.20.193.22:0/2863590499 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f6aec0071c0 con 0x7f6b0010f0f0 2026-02-24T07:21:12.125 INFO:teuthology.orchestra.run.trial022.stdout:77309411332 2026-02-24T07:21:12.127 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.124+0000 7f6b05c65640 1 -- 10.20.193.22:0/2863590499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6ad403f920 msgr2=0x7f6ad405fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:12.127 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.124+0000 7f6b05c65640 1 --2- 10.20.193.22:0/2863590499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6ad403f920 0x7f6ad405fdd0 crc :-1 s=READY pgs=67 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.127 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.124+0000 7f6b05c65640 1 -- 10.20.193.22:0/2863590499 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6b0010f0f0 msgr2=0x7f6b000f2e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:12.128 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.124+0000 7f6b05c65640 1 --2- 10.20.193.22:0/2863590499 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6b0010f0f0 0x7f6b000f2e20 crc :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.128 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.124+0000 7f6b05c65640 1 -- 10.20.193.22:0/2863590499 shutdown_connections 2026-02-24T07:21:12.128 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.124+0000 7f6b05c65640 1 --2- 10.20.193.22:0/2863590499 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f6ad403f920 0x7f6ad405fdd0 unknown :-1 s=CLOSED pgs=67 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.128 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.124+0000 7f6b05c65640 1 --2- 10.20.193.22:0/2863590499 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f6b0010f0f0 0x7f6b000f2e20 unknown :-1 s=CLOSED pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:12.128 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.124+0000 7f6b05c65640 1 -- 10.20.193.22:0/2863590499 >> 10.20.193.22:0/2863590499 conn(0x7f6b000ec9a0 msgr2=0x7f6b0010d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:12.128 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.124+0000 7f6b05c65640 1 -- 10.20.193.22:0/2863590499 shutdown_connections 2026-02-24T07:21:12.129 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:12.124+0000 7f6b05c65640 1 -- 10.20.193.22:0/2863590499 wait complete. 2026-02-24T07:21:12.162 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411333 got 77309411332 for osd.2 2026-02-24T07:21:12.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.948Z level=INFO source=main.go:1545 msg="updated GOGC" old=100 new=75 2026-02-24T07:21:12.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.949Z level=INFO source=main.go:677 msg="Leaving GOMAXPROCS=24: CPU quota undefined" component=automaxprocs 2026-02-24T07:21:12.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.949Z level=INFO source=memlimit.go:198 msg="GOMEMLIMIT is updated" component=automemlimit package=github.com/KimMachineGun/automemlimit/memlimit GOMEMLIMIT=120212523417 previous=9223372036854775807 2026-02-24T07:21:12.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.949Z level=INFO source=main.go:770 msg="Starting Prometheus Server" mode=server version="(version=3.6.0, branch=HEAD, revision=491734606591ef8c188f5489c70380805bc868c0)" 2026-02-24T07:21:12.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.949Z level=INFO source=main.go:775 msg="operational information" build_context="(go=go1.24.7, platform=linux/amd64, user=root@bfdf1aa26e4d, date=20250921-19:51:16, tags=netgo,builtinassets)" host_details="(Linux 5.14.0-686.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Feb 19 10:49:27 UTC 2026 x86_64 trial195 (none))" fd_limits="(soft=1048576, hard=1048576)" vm_limits="(soft=unlimited, hard=unlimited)" 2026-02-24T07:21:12.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.950Z level=INFO source=web.go:659 msg="Start listening for connections" component=web address=:9095 2026-02-24T07:21:12.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.950Z level=INFO source=main.go:1289 msg="Starting TSDB ..." 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.951Z level=INFO source=tls_config.go:347 msg="Listening on" component=web address=[::]:9095 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.951Z level=INFO source=tls_config.go:350 msg="TLS is disabled." component=web http2=false address=[::]:9095 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.952Z level=INFO source=head.go:667 msg="Replaying on-disk memory mappable chunks if any" component=tsdb 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.953Z level=INFO source=head.go:754 msg="On-disk memory mappable chunks replay completed" component=tsdb duration=921ns 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.953Z level=INFO source=head.go:762 msg="Replaying WAL, this may take a while" component=tsdb 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.953Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=0 maxSegment=0 duration=182.309µs 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.953Z level=INFO source=head.go:872 msg="WAL replay completed" component=tsdb checkpoint_replay_duration=14.648µs wal_replay_duration=192.127µs wbl_replay_duration=131ns chunk_snapshot_load_duration=0s mmap_chunk_replay_duration=921ns total_replay_duration=232.884µs 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.954Z level=INFO source=main.go:1310 msg="filesystem information" fs_type=XFS_SUPER_MAGIC 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.954Z level=INFO source=main.go:1313 msg="TSDB started" 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.954Z level=INFO source=main.go:1498 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.965Z level=INFO source=main.go:1538 msg="Completed loading of configuration file" db_storage=671ns remote_storage=1.102µs web_handler=331ns query_engine=631ns scrape=293.516µs scrape_sd=38.071µs notify=622ns notify_sd=381ns rules=10.316727ms tracing=4.438µs filename=/etc/prometheus/prometheus.yml totalDuration=10.863915ms 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.965Z level=INFO source=main.go:1274 msg="Server is ready to receive web requests." 2026-02-24T07:21:12.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:11 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:11.965Z level=INFO source=manager.go:176 msg="Starting rule manager..." component="rule manager" 2026-02-24T07:21:12.384 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:12 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4268975711' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-24T07:21:12.384 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:12 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:12.384 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:12 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:12.384 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:12 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' 2026-02-24T07:21:12.384 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:12 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd={"prefix": "mgr module enable", "module": "prometheus"} : dispatch 2026-02-24T07:21:12.384 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:12 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3084522296' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T07:21:12.384 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:12 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2391161687' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T07:21:12.384 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:12 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1561434772' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T07:21:12.384 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:12 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2863590499' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T07:21:13.064 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-24T07:21:13.113 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-24T07:21:13.124 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-24T07:21:13.162 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-24T07:21:13.182 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:13.227 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:13.273 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:13.282 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:13 trial022 ceph-mon[39108]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-24T07:21:13.282 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:13 trial022 ceph-mon[39108]: from='mgr.14154 10.20.193.22:0/3116157275' entity='mgr.x' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-02-24T07:21:13.282 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:13 trial022 ceph-mon[39108]: mgrmap e15: x(active, since 54s) 2026-02-24T07:21:13.282 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:13 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ignoring --setuser ceph since I am not root 2026-02-24T07:21:13.282 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:13 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ignoring --setgroup ceph since I am not root 2026-02-24T07:21:13.282 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:13 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:21:13.014+0000 7f5526682fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.282 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:13 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:21:13.016+0000 7f5526682fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.282 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:13 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:21:13.016+0000 7f5526682fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 -- 10.20.193.22:0/3304549959 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7face810dc30 msgr2=0x7face810e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 --2- 10.20.193.22:0/3304549959 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7face810dc30 0x7face810e000 crc :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=3509338468932526034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 -- 10.20.193.22:0/3304549959 shutdown_connections 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 --2- 10.20.193.22:0/3304549959 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7face810dc30 0x7face810e000 unknown :-1 s=CLOSED pgs=192 gs=1 cs=0 l=1 c_cookie=3509338468932526034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 -- 10.20.193.22:0/3304549959 >> 10.20.193.22:0/3304549959 conn(0x7face80e95f0 msgr2=0x7face8109a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 -- 10.20.193.22:0/3304549959 shutdown_connections 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 -- 10.20.193.22:0/3304549959 wait complete. 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 Processor -- start 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 -- start start 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7face810dc30 0x7face80ef950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facf01c2640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7face80efe90 con 0x7face810dc30 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facedf37640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7face810dc30 0x7face80ef950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facedf37640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7face810dc30 0x7face80ef950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51974/0 (socket says 10.20.193.22:51974) 2026-02-24T07:21:13.297 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.294+0000 7facedf37640 1 -- 10.20.193.22:0/2604817939 learned_addr learned my addr 10.20.193.22:0/2604817939 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.295+0000 7facedf37640 1 -- 10.20.193.22:0/2604817939 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face80effd0 con 0x7face810dc30 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.295+0000 7facedf37640 1 --2- 10.20.193.22:0/2604817939 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7face810dc30 0x7face80ef950 crc :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.295+0000 7facd6ffd640 1 -- 10.20.193.22:0/2604817939 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7facd800d690 con 0x7face810dc30 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.295+0000 7facf01c2640 1 -- 10.20.193.22:0/2604817939 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face80f0220 con 0x7face810dc30 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.295+0000 7facd6ffd640 1 -- 10.20.193.22:0/2604817939 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7facd800d7f0 con 0x7face810dc30 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.295+0000 7facd6ffd640 1 -- 10.20.193.22:0/2604817939 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7facd800fd70 con 0x7face810dc30 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.295+0000 7facf01c2640 1 -- 10.20.193.22:0/2604817939 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face80f5050 con 0x7face810dc30 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.295+0000 7facf01c2640 1 -- 10.20.193.22:0/2604817939 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face8060600 con 0x7face810dc30 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.295+0000 7facd6ffd640 1 -- 10.20.193.22:0/2604817939 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 15) ==== 52940+0+0 (crc 0 0 0) 0x7facd800f6b0 con 0x7face810dc30 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.296+0000 7facd6ffd640 1 --2- 10.20.193.22:0/2604817939 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7facc403f9c0 0x7facc405fe70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.296+0000 7facd6ffd640 1 -- 10.20.193.22:0/2604817939 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7facd8052690 con 0x7face810dc30 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.296+0000 7faced736640 1 -- 10.20.193.22:0/2604817939 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7facc403f9c0 msgr2=0x7facc405fe70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/4126627015 2026-02-24T07:21:13.298 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.296+0000 7faced736640 1 --2- 10.20.193.22:0/2604817939 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7facc403f9c0 0x7facc405fe70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T07:21:13.299 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:13.300 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.298+0000 7facd6ffd640 1 -- 10.20.193.22:0/2604817939 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7facd80071c0 con 0x7face810dc30 2026-02-24T07:21:13.344 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.341+0000 7ff4f266c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.344 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.341+0000 7ff4f266c640 1 -- 10.20.193.22:0/3860477361 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff4ec10f0f0 msgr2=0x7ff4ec10f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:13.344 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.341+0000 7ff4f266c640 1 --2- 10.20.193.22:0/3860477361 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff4ec10f0f0 0x7ff4ec10f4c0 crc :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=9887603167702946842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.344 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.341+0000 7ff4f266c640 1 -- 10.20.193.22:0/3860477361 shutdown_connections 2026-02-24T07:21:13.344 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.341+0000 7ff4f266c640 1 --2- 10.20.193.22:0/3860477361 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff4ec10f0f0 0x7ff4ec10f4c0 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=9887603167702946842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.344 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.341+0000 7ff4f266c640 1 -- 10.20.193.22:0/3860477361 >> 10.20.193.22:0/3860477361 conn(0x7ff4ec0ec9a0 msgr2=0x7ff4ec10cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:13.344 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.341+0000 7ff4f266c640 1 -- 10.20.193.22:0/3860477361 shutdown_connections 2026-02-24T07:21:13.344 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.341+0000 7ff4f266c640 1 -- 10.20.193.22:0/3860477361 wait complete. 2026-02-24T07:21:13.344 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4f266c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4f266c640 1 Processor -- start 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4f266c640 1 -- start start 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4f266c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff4ec10f0f0 0x7ff4ec0f2ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4f266c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec0f30e0 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4ebfff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff4ec10f0f0 0x7ff4ec0f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4ebfff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff4ec10f0f0 0x7ff4ec0f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:51998/0 (socket says 10.20.193.22:51998) 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4ebfff640 1 -- 10.20.193.22:0/4023048752 learned_addr learned my addr 10.20.193.22:0/4023048752 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4ebfff640 1 -- 10.20.193.22:0/4023048752 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec0f3220 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4ebfff640 1 --2- 10.20.193.22:0/4023048752 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff4ec10f0f0 0x7ff4ec0f2ba0 crc :-1 s=READY pgs=195 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4e97fa640 1 -- 10.20.193.22:0/4023048752 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff4d800d690 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4e97fa640 1 -- 10.20.193.22:0/4023048752 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7ff4d800d7f0 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4f266c640 1 -- 10.20.193.22:0/4023048752 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec0f3470 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4e97fa640 1 -- 10.20.193.22:0/4023048752 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff4d800fd70 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.345 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.342+0000 7ff4f266c640 1 -- 10.20.193.22:0/4023048752 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec0f82a0 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.346 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.343+0000 7ff4f266c640 1 -- 10.20.193.22:0/4023048752 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4ec1103d0 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.346 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.343+0000 7ff4e97fa640 1 -- 10.20.193.22:0/4023048752 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 15) ==== 52940+0+0 (crc 0 0 0) 0x7ff4d80026a0 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.346 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.343+0000 7ff4e97fa640 1 --2- 10.20.193.22:0/4023048752 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff4c003f970 0x7ff4c005fe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:13.346 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.343+0000 7ff4eb7fe640 1 -- 10.20.193.22:0/4023048752 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff4c003f970 msgr2=0x7ff4c005fe20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/4126627015 2026-02-24T07:21:13.346 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.343+0000 7ff4e97fa640 1 -- 10.20.193.22:0/4023048752 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7ff4d8052730 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.346 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.343+0000 7ff4eb7fe640 1 --2- 10.20.193.22:0/4023048752 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff4c003f970 0x7ff4c005fe20 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T07:21:13.347 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.345+0000 7ff4e97fa640 1 -- 10.20.193.22:0/4023048752 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7ff4d8015340 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.381+0000 7fa61c42a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.381+0000 7fa61c42a640 1 -- 10.20.193.22:0/2537677780 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fa61410f0f0 msgr2=0x7fa61410f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:13.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.381+0000 7fa61c42a640 1 --2- 10.20.193.22:0/2537677780 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fa61410f0f0 0x7fa61410f4c0 crc :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=14200861824315997002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.381+0000 7fa61c42a640 1 -- 10.20.193.22:0/2537677780 shutdown_connections 2026-02-24T07:21:13.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.381+0000 7fa61c42a640 1 --2- 10.20.193.22:0/2537677780 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fa61410f0f0 0x7fa61410f4c0 unknown :-1 s=CLOSED pgs=196 gs=1 cs=0 l=1 c_cookie=14200861824315997002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.381+0000 7fa61c42a640 1 -- 10.20.193.22:0/2537677780 >> 10.20.193.22:0/2537677780 conn(0x7fa6140ec9a0 msgr2=0x7fa61410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:13.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.381+0000 7fa61c42a640 1 -- 10.20.193.22:0/2537677780 shutdown_connections 2026-02-24T07:21:13.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.381+0000 7fa61c42a640 1 -- 10.20.193.22:0/2537677780 wait complete. 2026-02-24T07:21:13.384 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61c42a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61c42a640 1 Processor -- start 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61c42a640 1 -- start start 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61c42a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fa61410f0f0 0x7fa6140f2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61c42a640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6140f3360 con 0x7fa61410f0f0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61a19f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fa61410f0f0 0x7fa6140f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61a19f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fa61410f0f0 0x7fa6140f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52022/0 (socket says 10.20.193.22:52022) 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61a19f640 1 -- 10.20.193.22:0/156478555 learned_addr learned my addr 10.20.193.22:0/156478555 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61a19f640 1 -- 10.20.193.22:0/156478555 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6140f34a0 con 0x7fa61410f0f0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61a19f640 1 --2- 10.20.193.22:0/156478555 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fa61410f0f0 0x7fa6140f2e20 crc :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa5fb7fe640 1 -- 10.20.193.22:0/156478555 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fa60400d690 con 0x7fa61410f0f0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61c42a640 1 -- 10.20.193.22:0/156478555 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6140f36f0 con 0x7fa61410f0f0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa5fb7fe640 1 -- 10.20.193.22:0/156478555 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fa60400d7f0 con 0x7fa61410f0f0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa5fb7fe640 1 -- 10.20.193.22:0/156478555 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fa60400fc60 con 0x7fa61410f0f0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.382+0000 7fa61c42a640 1 -- 10.20.193.22:0/156478555 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6140f8520 con 0x7fa61410f0f0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.383+0000 7fa61c42a640 1 -- 10.20.193.22:0/156478555 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6141103d0 con 0x7fa61410f0f0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.383+0000 7fa5fb7fe640 1 -- 10.20.193.22:0/156478555 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 15) ==== 52940+0+0 (crc 0 0 0) 0x7fa60400f5a0 con 0x7fa61410f0f0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.383+0000 7fa5fb7fe640 1 --2- 10.20.193.22:0/156478555 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fa5f003f9c0 0x7fa5f005fe70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.383+0000 7fa5fb7fe640 1 -- 10.20.193.22:0/156478555 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7fa6040526c0 con 0x7fa61410f0f0 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.383+0000 7fa61999e640 1 -- 10.20.193.22:0/156478555 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fa5f003f9c0 msgr2=0x7fa5f005fe70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/4126627015 2026-02-24T07:21:13.385 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.383+0000 7fa61999e640 1 --2- 10.20.193.22:0/156478555 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fa5f003f9c0 0x7fa5f005fe70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T07:21:13.387 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.385+0000 7fa5fb7fe640 1 -- 10.20.193.22:0/156478555 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fa60400fe60 con 0x7fa61410f0f0 2026-02-24T07:21:13.389 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.387+0000 7f1969161640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.389 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.387+0000 7f1969161640 1 -- 10.20.193.22:0/338003724 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f196410f0f0 msgr2=0x7f196410f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:13.389 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.387+0000 7f1969161640 1 --2- 10.20.193.22:0/338003724 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f196410f0f0 0x7f196410f4c0 crc :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=4192530916376477579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.387+0000 7f1969161640 1 -- 10.20.193.22:0/338003724 shutdown_connections 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.387+0000 7f1969161640 1 --2- 10.20.193.22:0/338003724 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f196410f0f0 0x7f196410f4c0 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=4192530916376477579 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.387+0000 7f1969161640 1 -- 10.20.193.22:0/338003724 >> 10.20.193.22:0/338003724 conn(0x7f19640ec9a0 msgr2=0x7f196410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.387+0000 7f1969161640 1 -- 10.20.193.22:0/338003724 shutdown_connections 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.387+0000 7f1969161640 1 -- 10.20.193.22:0/338003724 wait complete. 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.387+0000 7f1969161640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.387+0000 7f1969161640 1 Processor -- start 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1969161640 1 -- start start 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1969161640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f196410f0f0 0x7f19640f2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1969161640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19640f3360 con 0x7f196410f0f0 2026-02-24T07:21:13.390 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1962d76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f196410f0f0 0x7f19640f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1962d76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f196410f0f0 0x7f19640f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52040/0 (socket says 10.20.193.22:52040) 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1962d76640 1 -- 10.20.193.22:0/739875191 learned_addr learned my addr 10.20.193.22:0/739875191 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1962d76640 1 -- 10.20.193.22:0/739875191 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19640f34a0 con 0x7f196410f0f0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1962d76640 1 --2- 10.20.193.22:0/739875191 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f196410f0f0 0x7f19640f2e20 crc :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1943fff640 1 -- 10.20.193.22:0/739875191 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f195800d690 con 0x7f196410f0f0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1969161640 1 -- 10.20.193.22:0/739875191 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19640f36f0 con 0x7f196410f0f0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1943fff640 1 -- 10.20.193.22:0/739875191 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f195800d7f0 con 0x7f196410f0f0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1943fff640 1 -- 10.20.193.22:0/739875191 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f195800fe70 con 0x7f196410f0f0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1969161640 1 -- 10.20.193.22:0/739875191 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19640f8520 con 0x7f196410f0f0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.388+0000 7f1969161640 1 -- 10.20.193.22:0/739875191 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19641103d0 con 0x7f196410f0f0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.389+0000 7f1943fff640 1 -- 10.20.193.22:0/739875191 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 15) ==== 52940+0+0 (crc 0 0 0) 0x7f19580026a0 con 0x7f196410f0f0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.389+0000 7f1943fff640 1 --2- 10.20.193.22:0/739875191 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f193803f940 0x7f193805fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.389+0000 7f1943fff640 1 -- 10.20.193.22:0/739875191 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7f1958052810 con 0x7f196410f0f0 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.389+0000 7f1962575640 1 -- 10.20.193.22:0/739875191 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f193803f940 msgr2=0x7f193805fdf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/4126627015 2026-02-24T07:21:13.391 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.389+0000 7f1962575640 1 --2- 10.20.193.22:0/739875191 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f193803f940 0x7f193805fdf0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T07:21:13.393 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.391+0000 7f1943fff640 1 -- 10.20.193.22:0/739875191 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f195800e5c0 con 0x7f196410f0f0 2026-02-24T07:21:13.413 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.410+0000 7facf01c2640 1 -- 10.20.193.22:0/2604817939 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7face805fbb0 con 0x7face810dc30 2026-02-24T07:21:13.413 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.411+0000 7facd6ffd640 1 -- 10.20.193.22:0/2604817939 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7facd80071c0 con 0x7face810dc30 2026-02-24T07:21:13.413 INFO:teuthology.orchestra.run.trial022.stdout:38654705673 2026-02-24T07:21:13.416 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.413+0000 7facf01c2640 1 -- 10.20.193.22:0/2604817939 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7facc403f9c0 msgr2=0x7facc405fe70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T07:21:13.416 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.413+0000 7facf01c2640 1 --2- 10.20.193.22:0/2604817939 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7facc403f9c0 0x7facc405fe70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.416 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.413+0000 7facf01c2640 1 -- 10.20.193.22:0/2604817939 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7face810dc30 msgr2=0x7face80ef950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:13.416 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.413+0000 7facf01c2640 1 --2- 10.20.193.22:0/2604817939 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7face810dc30 0x7face80ef950 crc :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.416 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.413+0000 7facf01c2640 1 -- 10.20.193.22:0/2604817939 shutdown_connections 2026-02-24T07:21:13.416 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.413+0000 7facf01c2640 1 --2- 10.20.193.22:0/2604817939 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7facc403f9c0 0x7facc405fe70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.416 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.413+0000 7facf01c2640 1 --2- 10.20.193.22:0/2604817939 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7face810dc30 0x7face80ef950 unknown :-1 s=CLOSED pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.416 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.414+0000 7facf01c2640 1 -- 10.20.193.22:0/2604817939 >> 10.20.193.22:0/2604817939 conn(0x7face80e95f0 msgr2=0x7face812ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:13.416 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.414+0000 7facf01c2640 1 -- 10.20.193.22:0/2604817939 shutdown_connections 2026-02-24T07:21:13.416 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.414+0000 7facf01c2640 1 -- 10.20.193.22:0/2604817939 wait complete. 2026-02-24T07:21:13.460 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.458+0000 7ff4f266c640 1 -- 10.20.193.22:0/4023048752 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff4ec05f060 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.461 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.458+0000 7ff4e97fa640 1 -- 10.20.193.22:0/4023048752 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7ff4d8007a50 con 0x7ff4ec10f0f0 2026-02-24T07:21:13.461 INFO:teuthology.orchestra.run.trial022.stdout:55834574856 2026-02-24T07:21:13.463 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.461+0000 7ff4f266c640 1 -- 10.20.193.22:0/4023048752 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff4c003f970 msgr2=0x7ff4c005fe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T07:21:13.464 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.461+0000 7ff4f266c640 1 --2- 10.20.193.22:0/4023048752 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff4c003f970 0x7ff4c005fe20 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.464 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.461+0000 7ff4f266c640 1 -- 10.20.193.22:0/4023048752 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff4ec10f0f0 msgr2=0x7ff4ec0f2ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:13.464 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.461+0000 7ff4f266c640 1 --2- 10.20.193.22:0/4023048752 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff4ec10f0f0 0x7ff4ec0f2ba0 crc :-1 s=READY pgs=195 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.464 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.461+0000 7ff4f266c640 1 -- 10.20.193.22:0/4023048752 shutdown_connections 2026-02-24T07:21:13.464 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.461+0000 7ff4f266c640 1 --2- 10.20.193.22:0/4023048752 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7ff4c003f970 0x7ff4c005fe20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.464 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.461+0000 7ff4f266c640 1 --2- 10.20.193.22:0/4023048752 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff4ec10f0f0 0x7ff4ec0f2ba0 unknown :-1 s=CLOSED pgs=195 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.464 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.461+0000 7ff4f266c640 1 -- 10.20.193.22:0/4023048752 >> 10.20.193.22:0/4023048752 conn(0x7ff4ec0ec9a0 msgr2=0x7ff4ec1128b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:13.464 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.461+0000 7ff4f266c640 1 -- 10.20.193.22:0/4023048752 shutdown_connections 2026-02-24T07:21:13.464 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.461+0000 7ff4f266c640 1 -- 10.20.193.22:0/4023048752 wait complete. 2026-02-24T07:21:13.478 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.0 2026-02-24T07:21:13.479 DEBUG:teuthology.parallel:result is None 2026-02-24T07:21:13.502 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2026-02-24T07:21:13.502 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.499+0000 7fa61c42a640 1 -- 10.20.193.22:0/156478555 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa6141375f0 con 0x7fa61410f0f0 2026-02-24T07:21:13.502 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.499+0000 7fa5fb7fe640 1 -- 10.20.193.22:0/156478555 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (crc 0 0 0) 0x7fa6040071c0 con 0x7fa61410f0f0 2026-02-24T07:21:13.503 INFO:teuthology.orchestra.run.trial022.stdout:103079215108 2026-02-24T07:21:13.503 DEBUG:teuthology.parallel:result is None 2026-02-24T07:21:13.504 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.501+0000 7f1969161640 1 -- 10.20.193.22:0/739875191 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f19641375f0 con 0x7f196410f0f0 2026-02-24T07:21:13.504 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.501+0000 7f1943fff640 1 -- 10.20.193.22:0/739875191 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f19580077f0 con 0x7f196410f0f0 2026-02-24T07:21:13.504 INFO:teuthology.orchestra.run.trial022.stdout:77309411333 2026-02-24T07:21:13.505 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.501+0000 7fa61c42a640 1 -- 10.20.193.22:0/156478555 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fa5f003f9c0 msgr2=0x7fa5f005fe70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T07:21:13.505 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.501+0000 7fa61c42a640 1 --2- 10.20.193.22:0/156478555 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fa5f003f9c0 0x7fa5f005fe70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.505 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.501+0000 7fa61c42a640 1 -- 10.20.193.22:0/156478555 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fa61410f0f0 msgr2=0x7fa6140f2e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:13.505 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.501+0000 7fa61c42a640 1 --2- 10.20.193.22:0/156478555 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fa61410f0f0 0x7fa6140f2e20 crc :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.505 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.502+0000 7fa61c42a640 1 -- 10.20.193.22:0/156478555 shutdown_connections 2026-02-24T07:21:13.506 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.502+0000 7fa61c42a640 1 --2- 10.20.193.22:0/156478555 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7fa5f003f9c0 0x7fa5f005fe70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.506 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.502+0000 7fa61c42a640 1 --2- 10.20.193.22:0/156478555 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fa61410f0f0 0x7fa6140f2e20 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.506 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.502+0000 7fa61c42a640 1 -- 10.20.193.22:0/156478555 >> 10.20.193.22:0/156478555 conn(0x7fa6140ec9a0 msgr2=0x7fa61410d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:13.506 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.502+0000 7fa61c42a640 1 -- 10.20.193.22:0/156478555 shutdown_connections 2026-02-24T07:21:13.506 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.502+0000 7fa61c42a640 1 -- 10.20.193.22:0/156478555 wait complete. 2026-02-24T07:21:13.507 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.504+0000 7f1969161640 1 -- 10.20.193.22:0/739875191 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f193803f940 msgr2=0x7f193805fdf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T07:21:13.507 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.504+0000 7f1969161640 1 --2- 10.20.193.22:0/739875191 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f193803f940 0x7f193805fdf0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.507 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.504+0000 7f1969161640 1 -- 10.20.193.22:0/739875191 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f196410f0f0 msgr2=0x7f19640f2e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:13.507 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.504+0000 7f1969161640 1 --2- 10.20.193.22:0/739875191 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f196410f0f0 0x7f19640f2e20 crc :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.507 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.504+0000 7f1969161640 1 -- 10.20.193.22:0/739875191 shutdown_connections 2026-02-24T07:21:13.507 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.504+0000 7f1969161640 1 --2- 10.20.193.22:0/739875191 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f193803f940 0x7f193805fdf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.507 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.504+0000 7f1969161640 1 --2- 10.20.193.22:0/739875191 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f196410f0f0 0x7f19640f2e20 unknown :-1 s=CLOSED pgs=199 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.507 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.504+0000 7f1969161640 1 -- 10.20.193.22:0/739875191 >> 10.20.193.22:0/739875191 conn(0x7f19640ec9a0 msgr2=0x7f196410d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:13.507 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.504+0000 7f1969161640 1 -- 10.20.193.22:0/739875191 shutdown_connections 2026-02-24T07:21:13.508 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.504+0000 7f1969161640 1 -- 10.20.193.22:0/739875191 wait complete. 2026-02-24T07:21:13.542 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215108 got 103079215108 for osd.3 2026-02-24T07:21:13.542 DEBUG:teuthology.parallel:result is None 2026-02-24T07:21:13.545 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411333 got 77309411333 for osd.2 2026-02-24T07:21:13.546 DEBUG:teuthology.parallel:result is None 2026-02-24T07:21:13.546 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-24T07:21:13.546 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:21:13.705 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 -- 10.20.193.22:0/3722205285 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2fe810ce60 msgr2=0x7f2fe810d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 --2- 10.20.193.22:0/3722205285 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2fe810ce60 0x7f2fe810d230 crc :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=6348907478510925024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 -- 10.20.193.22:0/3722205285 shutdown_connections 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 --2- 10.20.193.22:0/3722205285 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2fe810ce60 0x7f2fe810d230 unknown :-1 s=CLOSED pgs=200 gs=1 cs=0 l=1 c_cookie=6348907478510925024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 -- 10.20.193.22:0/3722205285 >> 10.20.193.22:0/3722205285 conn(0x7f2fe80ea730 msgr2=0x7f2fe810ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 -- 10.20.193.22:0/3722205285 shutdown_connections 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 -- 10.20.193.22:0/3722205285 wait complete. 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 Processor -- start 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 -- start start 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2fe810ce60 0x7f2fe80f0c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:13.817 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2ff04e1640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe80f1140 con 0x7f2fe810ce60 2026-02-24T07:21:13.818 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2fee256640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2fe810ce60 0x7f2fe80f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:13.818 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2fee256640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2fe810ce60 0x7f2fe80f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52046/0 (socket says 10.20.193.22:52046) 2026-02-24T07:21:13.818 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.814+0000 7f2fee256640 1 -- 10.20.193.22:0/2918952601 learned_addr learned my addr 10.20.193.22:0/2918952601 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:13.818 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.815+0000 7f2fee256640 1 -- 10.20.193.22:0/2918952601 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe80f1280 con 0x7f2fe810ce60 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.815+0000 7f2fee256640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2fe810ce60 0x7f2fe80f0c00 crc :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.815+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f2fd800d690 con 0x7f2fe810ce60 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.815+0000 7f2ff04e1640 1 -- 10.20.193.22:0/2918952601 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe80f14d0 con 0x7f2fe810ce60 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.815+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f2fd800d7f0 con 0x7f2fe810ce60 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.815+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f2fd800fd70 con 0x7f2fe810ce60 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.815+0000 7f2ff04e1640 1 -- 10.20.193.22:0/2918952601 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe80f6300 con 0x7f2fe810ce60 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.815+0000 7f2ff04e1640 1 -- 10.20.193.22:0/2918952601 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe810e140 con 0x7f2fe810ce60 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.815+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 15) ==== 52940+0+0 (crc 0 0 0) 0x7f2fd800f6b0 con 0x7f2fe810ce60 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.816+0000 7f2fcf7fe640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 0x7f2fc405fe70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.816+0000 7f2feda55640 1 -- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 msgr2=0x7f2fc405fe70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/4126627015 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.816+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3575+0+0 (crc 0 0 0) 0x7f2fd8052690 con 0x7f2fe810ce60 2026-02-24T07:21:13.819 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.816+0000 7f2feda55640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 0x7f2fc405fe70 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-24T07:21:13.820 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.818+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f2fd80071c0 con 0x7f2fe810ce60 2026-02-24T07:21:13.922 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:13.919+0000 7f2ff04e1640 1 -- 10.20.193.22:0/2918952601 --> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fe81353f0 con 0x7f2fc403f9c0 2026-02-24T07:21:14.019 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:14.017+0000 7f2feda55640 1 -- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 msgr2=0x7f2fc405fe70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/4126627015 2026-02-24T07:21:14.020 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:14.017+0000 7f2feda55640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 0x7f2fc405fe70 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-24T07:21:14.230 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:14 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T07:21:14.230 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:14 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T07:21:14.230 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:14 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: from numpy import show_config as show_numpy_config 2026-02-24T07:21:14.421 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:14.418+0000 7f2feda55640 1 -- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 msgr2=0x7f2fc405fe70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/4126627015 2026-02-24T07:21:14.421 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:14.418+0000 7f2feda55640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 0x7f2fc405fe70 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-24T07:21:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:14 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2604817939' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-24T07:21:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:14 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4023048752' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-24T07:21:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:14 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/156478555' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-24T07:21:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:14 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/739875191' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-24T07:21:15.222 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:15.219+0000 7f2feda55640 1 -- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 msgr2=0x7f2fc405fe70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.22:6800/4126627015 2026-02-24T07:21:15.222 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:15.219+0000 7f2feda55640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 0x7f2fc405fe70 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-24T07:21:15.800 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:15.797+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mgrmap(e 16) ==== 52608+0+0 (crc 0 0 0) 0x7f2fd800e5c0 con 0x7f2fe810ce60 2026-02-24T07:21:15.801 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:15.797+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 msgr2=0x7f2fc405fe70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-24T07:21:15.801 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:15.797+0000 7f2fcf7fe640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 0x7f2fc405fe70 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:16.050 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: Active manager daemon x restarted 2026-02-24T07:21:16.051 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: Activating manager daemon x 2026-02-24T07:21:16.051 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: osdmap e27: 4 total, 4 up, 4 in 2026-02-24T07:21:16.051 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: mgrmap e16: x(active, starting, since 0.00305929s) 2026-02-24T07:21:16.051 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-24T07:21:16.051 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-24T07:21:16.051 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-24T07:21:16.051 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-24T07:21:16.051 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-24T07:21:16.051 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-24T07:21:16.051 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-24T07:21:16.052 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-24T07:21:16.052 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-24T07:21:16.052 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:15 trial022 ceph-mon[39108]: Manager daemon x is now available 2026-02-24T07:21:16.803 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.799+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mgrmap(e 17) ==== 52735+0+0 (crc 0 0 0) 0x7f2fd804df50 con 0x7f2fe810ce60 2026-02-24T07:21:16.803 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.799+0000 7f2fcf7fe640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2fc4062e60 0x7f2fc4083240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:16.803 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.799+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 --> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fe81353f0 con 0x7f2fc4062e60 2026-02-24T07:21:16.803 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.799+0000 7f2feda55640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2fc4062e60 0x7f2fc4083240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:16.803 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.800+0000 7f2feda55640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2fc4062e60 0x7f2fc4083240 crc :-1 s=READY pgs=2 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:16.803 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.800+0000 7f2fcf7fe640 1 -- 10.20.193.22:0/2918952601 <== mgr.14284 v2:10.20.193.22:6800/1339855099 1 ==== mgr_command_reply(tid 0: 0 Warning: due to ceph-mgr restart, some PG states may not be up to date 2026-02-24T07:21:16.804 INFO:teuthology.orchestra.run.trial022.stderr:dumped all) ==== 89+0+6765 (crc 0 0 0) 0x7f2fe81353f0 con 0x7f2fc4062e60 2026-02-24T07:21:16.804 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:16.804 INFO:teuthology.orchestra.run.trial022.stderr:Warning: due to ceph-mgr restart, some PG states may not be up to date 2026-02-24T07:21:16.804 INFO:teuthology.orchestra.run.trial022.stderr:dumped all 2026-02-24T07:21:16.806 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 -- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2fc4062e60 msgr2=0x7f2fc4083240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:16.806 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2fc4062e60 0x7f2fc4083240 crc :-1 s=READY pgs=2 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:16.806 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 -- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2fe810ce60 msgr2=0x7f2fe80f0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:16.806 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2fe810ce60 0x7f2fe80f0c00 crc :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:16.806 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 -- 10.20.193.22:0/2918952601 shutdown_connections 2026-02-24T07:21:16.806 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2fc4062e60 0x7f2fc4083240 unknown :-1 s=CLOSED pgs=2 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:16.806 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:6800/4126627015,v1:10.20.193.22:6801/4126627015] conn(0x7f2fc403f9c0 0x7f2fc405fe70 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:16.807 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 --2- 10.20.193.22:0/2918952601 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2fe810ce60 0x7f2fe80f0c00 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:16.807 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 -- 10.20.193.22:0/2918952601 >> 10.20.193.22:0/2918952601 conn(0x7f2fe80ea730 msgr2=0x7f2fe810b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:16.807 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 -- 10.20.193.22:0/2918952601 shutdown_connections 2026-02-24T07:21:16.807 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:16.803+0000 7f2ff04e1640 1 -- 10.20.193.22:0/2918952601 wait complete. 2026-02-24T07:21:16.866 INFO:teuthology.orchestra.run.trial022.stdout:{"pg_ready":false,"pg_map":{"version":2,"stamp":"2026-02-24T07:21:15.802600+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T07:21:15.797363+0000","last_change":"2026-02-24T07:21:15.797363+0000","last_active":"2026-02-24T07:21:15.797363+0000","last_peered":"2026-02-24T07:21:15.797363+0000","last_clean":"2026-02-24T07:21:15.797363+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T07:21:15.797363+0000","last_undegraded":"2026-02-24T07:21:15.797363+0000","last_fullsized":"2026-02-24T07:21:15.797363+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:21:15.797363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:21:15.797363+0000","last_clean_scrub_stamp":"2026-02-24T07:21:15.797363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0}],"osd_stats":[],"pool_statfs":[]}} 2026-02-24T07:21:16.867 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph pg dump --format=json 2026-02-24T07:21:16.982 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:17.089 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.086+0000 7fcb13207640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:17.090 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.086+0000 7fcb13207640 1 -- 10.20.193.22:0/2480406851 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcb0c10ce60 msgr2=0x7fcb0c10d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:17.090 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.086+0000 7fcb13207640 1 --2- 10.20.193.22:0/2480406851 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcb0c10ce60 0x7fcb0c10d230 crc :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=13363790813875508247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.090 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.086+0000 7fcb13207640 1 -- 10.20.193.22:0/2480406851 shutdown_connections 2026-02-24T07:21:17.090 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.086+0000 7fcb13207640 1 --2- 10.20.193.22:0/2480406851 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcb0c10ce60 0x7fcb0c10d230 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=13363790813875508247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.090 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.086+0000 7fcb13207640 1 -- 10.20.193.22:0/2480406851 >> 10.20.193.22:0/2480406851 conn(0x7fcb0c0ea730 msgr2=0x7fcb0c10ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:17.090 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.086+0000 7fcb13207640 1 -- 10.20.193.22:0/2480406851 shutdown_connections 2026-02-24T07:21:17.090 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.086+0000 7fcb13207640 1 -- 10.20.193.22:0/2480406851 wait complete. 2026-02-24T07:21:17.091 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:21:17.091 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.091 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:21:17.091 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-24T07:21:17.091 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-24T07:21:17.091 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-24T07:21:17.091 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.092 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.092 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.092 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.092 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:16 trial022 ceph-mon[39108]: mgrmap e17: x(active, since 1.00497s) 2026-02-24T07:21:17.092 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.086+0000 7fcb13207640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:17.093 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:16 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: [24/Feb/2026:07:21:16] ENGINE Bus STARTING 2026-02-24T07:21:17.093 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:16 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: CherryPy Checker: 2026-02-24T07:21:17.093 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:16 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: The Application mounted at '' has an empty config. 2026-02-24T07:21:17.093 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:16 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: 2026-02-24T07:21:17.093 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:16 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: [24/Feb/2026:07:21:16] ENGINE Serving on http://:::9283 2026-02-24T07:21:17.093 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:16 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: [24/Feb/2026:07:21:16] ENGINE Bus STARTED 2026-02-24T07:21:17.096 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb13207640 1 Processor -- start 2026-02-24T07:21:17.096 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb13207640 1 -- start start 2026-02-24T07:21:17.096 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb13207640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcb0c10ce60 0x7fcb0c11b550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:17.096 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb13207640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c11ba90 con 0x7fcb0c10ce60 2026-02-24T07:21:17.096 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb10f7c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcb0c10ce60 0x7fcb0c11b550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:17.096 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb10f7c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcb0c10ce60 0x7fcb0c11b550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52102/0 (socket says 10.20.193.22:52102) 2026-02-24T07:21:17.096 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb10f7c640 1 -- 10.20.193.22:0/3297215307 learned_addr learned my addr 10.20.193.22:0/3297215307 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:17.097 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb10f7c640 1 -- 10.20.193.22:0/3297215307 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0c11bbd0 con 0x7fcb0c10ce60 2026-02-24T07:21:17.097 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb10f7c640 1 --2- 10.20.193.22:0/3297215307 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcb0c10ce60 0x7fcb0c11b550 crc :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:17.097 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb01ffb640 1 -- 10.20.193.22:0/3297215307 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fcafc00d690 con 0x7fcb0c10ce60 2026-02-24T07:21:17.097 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb01ffb640 1 -- 10.20.193.22:0/3297215307 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fcafc00d7f0 con 0x7fcb0c10ce60 2026-02-24T07:21:17.097 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb13207640 1 -- 10.20.193.22:0/3297215307 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0c11be20 con 0x7fcb0c10ce60 2026-02-24T07:21:17.097 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb01ffb640 1 -- 10.20.193.22:0/3297215307 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fcafc00fd70 con 0x7fcb0c10ce60 2026-02-24T07:21:17.097 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.087+0000 7fcb13207640 1 -- 10.20.193.22:0/3297215307 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb0c120c50 con 0x7fcb0c10ce60 2026-02-24T07:21:17.097 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.088+0000 7fcb13207640 1 -- 10.20.193.22:0/3297215307 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb0c10e140 con 0x7fcb0c10ce60 2026-02-24T07:21:17.097 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.088+0000 7fcb01ffb640 1 -- 10.20.193.22:0/3297215307 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 17) ==== 52735+0+0 (crc 0 0 0) 0x7fcafc00e5c0 con 0x7fcb0c10ce60 2026-02-24T07:21:17.097 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.088+0000 7fcb01ffb640 1 --2- 10.20.193.22:0/3297215307 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fcae803f720 0x7fcae805fbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:17.098 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.088+0000 7fcb01ffb640 1 -- 10.20.193.22:0/3297215307 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3833+0+0 (crc 0 0 0) 0x7fcafc052490 con 0x7fcb0c10ce60 2026-02-24T07:21:17.098 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.088+0000 7fcb03fff640 1 --2- 10.20.193.22:0/3297215307 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fcae803f720 0x7fcae805fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:17.098 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.088+0000 7fcb03fff640 1 --2- 10.20.193.22:0/3297215307 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fcae803f720 0x7fcae805fbd0 crc :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:17.098 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.091+0000 7fcb01ffb640 1 -- 10.20.193.22:0/3297215307 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fcafc015e40 con 0x7fcb0c10ce60 2026-02-24T07:21:17.201 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.198+0000 7fcb13207640 1 -- 10.20.193.22:0/3297215307 --> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb0c05f3f0 con 0x7fcae803f720 2026-02-24T07:21:17.201 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.198+0000 7fcb01ffb640 1 -- 10.20.193.22:0/3297215307 <== mgr.14284 v2:10.20.193.22:6800/1339855099 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+10640 (crc 0 0 0) 0x7fcb0c05f3f0 con 0x7fcae803f720 2026-02-24T07:21:17.202 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:17.203 INFO:teuthology.orchestra.run.trial022.stderr:dumped all 2026-02-24T07:21:17.203 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.199+0000 7fcb13207640 1 -- 10.20.193.22:0/3297215307 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fcae803f720 msgr2=0x7fcae805fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:17.203 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.199+0000 7fcb13207640 1 --2- 10.20.193.22:0/3297215307 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fcae803f720 0x7fcae805fbd0 crc :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.203 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.199+0000 7fcb13207640 1 -- 10.20.193.22:0/3297215307 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcb0c10ce60 msgr2=0x7fcb0c11b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:17.204 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.199+0000 7fcb13207640 1 --2- 10.20.193.22:0/3297215307 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcb0c10ce60 0x7fcb0c11b550 crc :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.204 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.199+0000 7fcb13207640 1 -- 10.20.193.22:0/3297215307 shutdown_connections 2026-02-24T07:21:17.204 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.199+0000 7fcb13207640 1 --2- 10.20.193.22:0/3297215307 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fcae803f720 0x7fcae805fbd0 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.204 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.199+0000 7fcb13207640 1 --2- 10.20.193.22:0/3297215307 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fcb0c10ce60 0x7fcb0c11b550 unknown :-1 s=CLOSED pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.204 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.199+0000 7fcb13207640 1 -- 10.20.193.22:0/3297215307 >> 10.20.193.22:0/3297215307 conn(0x7fcb0c0ea730 msgr2=0x7fcb0c10ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:17.204 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.199+0000 7fcb13207640 1 -- 10.20.193.22:0/3297215307 shutdown_connections 2026-02-24T07:21:17.204 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.199+0000 7fcb13207640 1 -- 10.20.193.22:0/3297215307 wait complete. 2026-02-24T07:21:17.238 INFO:teuthology.orchestra.run.trial022.stdout:{"pg_ready":true,"pg_map":{"version":3,"stamp":"2026-02-24T07:21:16.803971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":3,"kb":2936012800,"kb_used":110476,"kb_used_data":2620,"kb_used_omap":39,"kb_used_meta":107736,"kb_avail":2935902324,"statfs":{"total":3006477107200,"available":3006363979776,"internally_reserved":0,"allocated":2682880,"data_stored":2076042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40310,"internal_metadata":110322314},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2026-02-24T07:21:16.389983+0000","last_change":"2026-02-24T07:21:09.235881+0000","last_active":"2026-02-24T07:21:16.389983+0000","last_peered":"2026-02-24T07:21:16.389983+0000","last_clean":"2026-02-24T07:21:16.389983+0000","last_became_active":"2026-02-24T07:21:09.231998+0000","last_became_peered":"2026-02-24T07:21:09.231998+0000","last_unstale":"2026-02-24T07:21:16.389983+0000","last_undegraded":"2026-02-24T07:21:16.389983+0000","last_fullsized":"2026-02-24T07:21:16.389983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T07:20:59.028055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T07:20:59.028055+0000","last_clean_scrub_stamp":"2026-02-24T07:20:59.028055+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T13:58:06.112124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":24,"seq":103079215109,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":664457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":27585139},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411334,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":668748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10075,"internal_metadata":27580581},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27188,"kb_used_data":224,"kb_used_omap":11,"kb_used_meta":26932,"kb_avail":733976012,"statfs":{"total":751619276800,"available":751591436288,"internally_reserved":0,"allocated":229376,"data_stored":78380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11375,"internal_metadata":27579281},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705674,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":13,"kb_used_meta":26930,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":664457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13343,"internal_metadata":27577313},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T07:21:17.240 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-24T07:21:17.240 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T07:21:17.240 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-24T07:21:17.240 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph health --format=json 2026-02-24T07:21:17.357 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:17.467 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:17.468 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 -- 10.20.193.22:0/292384693 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f895810f0f0 msgr2=0x7f895810f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:17.468 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 --2- 10.20.193.22:0/292384693 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f895810f0f0 0x7f895810f4c0 crc :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=1590141737491536839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.468 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 -- 10.20.193.22:0/292384693 shutdown_connections 2026-02-24T07:21:17.468 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 --2- 10.20.193.22:0/292384693 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f895810f0f0 0x7f895810f4c0 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=1590141737491536839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.468 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 -- 10.20.193.22:0/292384693 >> 10.20.193.22:0/292384693 conn(0x7f89580ec9a0 msgr2=0x7f895810cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:17.468 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 -- 10.20.193.22:0/292384693 shutdown_connections 2026-02-24T07:21:17.468 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 -- 10.20.193.22:0/292384693 wait complete. 2026-02-24T07:21:17.468 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 Processor -- start 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 -- start start 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f895810f0f0 0x7f89580efd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895fb27640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f89580f0240 con 0x7f895810f0f0 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895d89c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f895810f0f0 0x7f89580efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895d89c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f895810f0f0 0x7f89580efd00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52116/0 (socket says 10.20.193.22:52116) 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895d89c640 1 -- 10.20.193.22:0/1247014485 learned_addr learned my addr 10.20.193.22:0/1247014485 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895d89c640 1 -- 10.20.193.22:0/1247014485 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89580f0380 con 0x7f895810f0f0 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.463+0000 7f895d89c640 1 --2- 10.20.193.22:0/1247014485 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f895810f0f0 0x7f89580efd00 crc :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.464+0000 7f8946ffd640 1 -- 10.20.193.22:0/1247014485 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f894800d690 con 0x7f895810f0f0 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.464+0000 7f8946ffd640 1 -- 10.20.193.22:0/1247014485 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f894800d7f0 con 0x7f895810f0f0 2026-02-24T07:21:17.469 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.464+0000 7f895fb27640 1 -- 10.20.193.22:0/1247014485 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89580f05d0 con 0x7f895810f0f0 2026-02-24T07:21:17.470 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.464+0000 7f8946ffd640 1 -- 10.20.193.22:0/1247014485 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f894800fd70 con 0x7f895810f0f0 2026-02-24T07:21:17.470 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.464+0000 7f895fb27640 1 -- 10.20.193.22:0/1247014485 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89580f5400 con 0x7f895810f0f0 2026-02-24T07:21:17.470 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.464+0000 7f895fb27640 1 -- 10.20.193.22:0/1247014485 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8958112510 con 0x7f895810f0f0 2026-02-24T07:21:17.470 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.464+0000 7f8946ffd640 1 -- 10.20.193.22:0/1247014485 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 17) ==== 52735+0+0 (crc 0 0 0) 0x7f894800f6b0 con 0x7f895810f0f0 2026-02-24T07:21:17.470 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.464+0000 7f8946ffd640 1 --2- 10.20.193.22:0/1247014485 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f893403f770 0x7f893405fc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:17.470 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.464+0000 7f8946ffd640 1 -- 10.20.193.22:0/1247014485 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3833+0+0 (crc 0 0 0) 0x7f89480523a0 con 0x7f895810f0f0 2026-02-24T07:21:17.470 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.465+0000 7f895d09b640 1 --2- 10.20.193.22:0/1247014485 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f893403f770 0x7f893405fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:17.470 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.465+0000 7f895d09b640 1 --2- 10.20.193.22:0/1247014485 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f893403f770 0x7f893405fc20 crc :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:17.471 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.467+0000 7f8946ffd640 1 -- 10.20.193.22:0/1247014485 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f89480071c0 con 0x7f895810f0f0 2026-02-24T07:21:17.605 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.602+0000 7f895fb27640 1 -- 10.20.193.22:0/1247014485 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f895805f060 con 0x7f895810f0f0 2026-02-24T07:21:17.605 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.602+0000 7f8946ffd640 1 -- 10.20.193.22:0/1247014485 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7f89480071c0 con 0x7f895810f0f0 2026-02-24T07:21:17.606 INFO:teuthology.orchestra.run.trial022.stdout: 2026-02-24T07:21:17.606 INFO:teuthology.orchestra.run.trial022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T07:21:17.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.604+0000 7f895fb27640 1 -- 10.20.193.22:0/1247014485 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f893403f770 msgr2=0x7f893405fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:17.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.604+0000 7f895fb27640 1 --2- 10.20.193.22:0/1247014485 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f893403f770 0x7f893405fc20 crc :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.604+0000 7f895fb27640 1 -- 10.20.193.22:0/1247014485 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f895810f0f0 msgr2=0x7f89580efd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:17.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.604+0000 7f895fb27640 1 --2- 10.20.193.22:0/1247014485 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f895810f0f0 0x7f89580efd00 crc :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.608 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.604+0000 7f895fb27640 1 -- 10.20.193.22:0/1247014485 shutdown_connections 2026-02-24T07:21:17.608 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.604+0000 7f895fb27640 1 --2- 10.20.193.22:0/1247014485 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f893403f770 0x7f893405fc20 unknown :-1 s=CLOSED pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.608 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.604+0000 7f895fb27640 1 --2- 10.20.193.22:0/1247014485 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f895810f0f0 0x7f89580efd00 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:17.608 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.604+0000 7f895fb27640 1 -- 10.20.193.22:0/1247014485 >> 10.20.193.22:0/1247014485 conn(0x7f89580ec9a0 msgr2=0x7f895813a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:17.608 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.604+0000 7f895fb27640 1 -- 10.20.193.22:0/1247014485 shutdown_connections 2026-02-24T07:21:17.608 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:17.604+0000 7f895fb27640 1 -- 10.20.193.22:0/1247014485 wait complete. 2026-02-24T07:21:17.746 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-24T07:21:17.746 INFO:tasks.cephadm:Setup complete, yielding 2026-02-24T07:21:17.746 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-24T07:21:17.755 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial022.front.sepia.ceph.com 2026-02-24T07:21:17.755 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-24T07:21:17.954 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:17.977 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:17 trial022 bash[75844]: Trying to pull quay.io/prometheus/node-exporter:v1.9.1... 2026-02-24T07:21:17.977 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: [24/Feb/2026:07:21:16] ENGINE Bus STARTING 2026-02-24T07:21:17.977 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: [24/Feb/2026:07:21:16] ENGINE Serving on https://10.20.193.22:7150 2026-02-24T07:21:17.977 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: [24/Feb/2026:07:21:16] ENGINE Client ('10.20.193.22', 40142) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-24T07:21:17.977 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: [24/Feb/2026:07:21:16] ENGINE Serving on http://10.20.193.22:8765 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: [24/Feb/2026:07:21:16] ENGINE Bus STARTED 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='client.14294 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T07:21:17.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: Adjusting osd_memory_target on trial195 to 44071M 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: Updating trial022:/etc/ceph/ceph.conf 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: Updating trial195:/etc/ceph/ceph.conf 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.979 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:17.980 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:17 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1247014485' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-24T07:21:18.071 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:18.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 -- 10.20.193.22:0/3935307065 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff89410f0f0 msgr2=0x7ff89410f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:18.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 --2- 10.20.193.22:0/3935307065 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff89410f0f0 0x7ff89410f4c0 crc :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=17972975606312696226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 -- 10.20.193.22:0/3935307065 shutdown_connections 2026-02-24T07:21:18.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 --2- 10.20.193.22:0/3935307065 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff89410f0f0 0x7ff89410f4c0 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=17972975606312696226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 -- 10.20.193.22:0/3935307065 >> 10.20.193.22:0/3935307065 conn(0x7ff8940ec9a0 msgr2=0x7ff89410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:18.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 -- 10.20.193.22:0/3935307065 shutdown_connections 2026-02-24T07:21:18.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 -- 10.20.193.22:0/3935307065 wait complete. 2026-02-24T07:21:18.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:18.072 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 Processor -- start 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 -- start start 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff89410f0f0 0x7ff8940f2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff89b330640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8940f3360 con 0x7ff89410f0f0 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff8990a5640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff89410f0f0 0x7ff8940f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff8990a5640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff89410f0f0 0x7ff8940f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52156/0 (socket says 10.20.193.22:52156) 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.067+0000 7ff8990a5640 1 -- 10.20.193.22:0/4283253664 learned_addr learned my addr 10.20.193.22:0/4283253664 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.068+0000 7ff8990a5640 1 -- 10.20.193.22:0/4283253664 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8940f34a0 con 0x7ff89410f0f0 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.068+0000 7ff8990a5640 1 --2- 10.20.193.22:0/4283253664 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff89410f0f0 0x7ff8940f2e20 crc :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.068+0000 7ff8827fc640 1 -- 10.20.193.22:0/4283253664 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff88400d690 con 0x7ff89410f0f0 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.068+0000 7ff89b330640 1 -- 10.20.193.22:0/4283253664 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8940f36f0 con 0x7ff89410f0f0 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.068+0000 7ff8827fc640 1 -- 10.20.193.22:0/4283253664 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7ff88400d7f0 con 0x7ff89410f0f0 2026-02-24T07:21:18.073 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.068+0000 7ff8827fc640 1 -- 10.20.193.22:0/4283253664 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff88400fd70 con 0x7ff89410f0f0 2026-02-24T07:21:18.074 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.068+0000 7ff89b330640 1 -- 10.20.193.22:0/4283253664 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8940f8520 con 0x7ff89410f0f0 2026-02-24T07:21:18.074 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.068+0000 7ff89b330640 1 -- 10.20.193.22:0/4283253664 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8941103d0 con 0x7ff89410f0f0 2026-02-24T07:21:18.074 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.068+0000 7ff8827fc640 1 -- 10.20.193.22:0/4283253664 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 17) ==== 52735+0+0 (crc 0 0 0) 0x7ff88400f6b0 con 0x7ff89410f0f0 2026-02-24T07:21:18.074 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.069+0000 7ff8827fc640 1 --2- 10.20.193.22:0/4283253664 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff87003f770 0x7ff87005fc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:18.074 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.069+0000 7ff8827fc640 1 -- 10.20.193.22:0/4283253664 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3833+0+0 (crc 0 0 0) 0x7ff8840523a0 con 0x7ff89410f0f0 2026-02-24T07:21:18.074 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.069+0000 7ff8988a4640 1 --2- 10.20.193.22:0/4283253664 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff87003f770 0x7ff87005fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:18.074 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.069+0000 7ff8988a4640 1 --2- 10.20.193.22:0/4283253664 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff87003f770 0x7ff87005fc20 crc :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:18.075 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.071+0000 7ff8827fc640 1 -- 10.20.193.22:0/4283253664 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7ff8840071c0 con 0x7ff89410f0f0 2026-02-24T07:21:18.184 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.182+0000 7ff89b330640 1 -- 10.20.193.22:0/4283253664 --> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7ff8941375f0 con 0x7ff87003f770 2026-02-24T07:21:18.185 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.183+0000 7ff8827fc640 1 -- 10.20.193.22:0/4283253664 <== mgr.14284 v2:10.20.193.22:6800/1339855099 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (crc 0 0 0) 0x7ff8941375f0 con 0x7ff87003f770 2026-02-24T07:21:18.185 INFO:teuthology.orchestra.run.trial022.stdout:Backend: cephadm 2026-02-24T07:21:18.185 INFO:teuthology.orchestra.run.trial022.stdout:Available: Yes 2026-02-24T07:21:18.185 INFO:teuthology.orchestra.run.trial022.stdout:Paused: No 2026-02-24T07:21:18.186 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.184+0000 7ff89b330640 1 -- 10.20.193.22:0/4283253664 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff87003f770 msgr2=0x7ff87005fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:18.186 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.184+0000 7ff89b330640 1 --2- 10.20.193.22:0/4283253664 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff87003f770 0x7ff87005fc20 crc :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.186 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.184+0000 7ff89b330640 1 -- 10.20.193.22:0/4283253664 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff89410f0f0 msgr2=0x7ff8940f2e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:18.186 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.184+0000 7ff89b330640 1 --2- 10.20.193.22:0/4283253664 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff89410f0f0 0x7ff8940f2e20 crc :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.186 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.184+0000 7ff89b330640 1 -- 10.20.193.22:0/4283253664 shutdown_connections 2026-02-24T07:21:18.186 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.184+0000 7ff89b330640 1 --2- 10.20.193.22:0/4283253664 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff87003f770 0x7ff87005fc20 unknown :-1 s=CLOSED pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.186 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.184+0000 7ff89b330640 1 --2- 10.20.193.22:0/4283253664 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff89410f0f0 0x7ff8940f2e20 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.186 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.184+0000 7ff89b330640 1 -- 10.20.193.22:0/4283253664 >> 10.20.193.22:0/4283253664 conn(0x7ff8940ec9a0 msgr2=0x7ff89410d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:18.186 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.184+0000 7ff89b330640 1 -- 10.20.193.22:0/4283253664 shutdown_connections 2026-02-24T07:21:18.186 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.184+0000 7ff89b330640 1 -- 10.20.193.22:0/4283253664 wait complete. 2026-02-24T07:21:18.244 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-24T07:21:18.360 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:18.471 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.465+0000 7febb124c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:18.471 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 -- 10.20.193.22:0/3517309484 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7febac060f50 msgr2=0x7febac061320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:18.472 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 --2- 10.20.193.22:0/3517309484 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7febac060f50 0x7febac061320 crc :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=5934194552014761820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.472 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 -- 10.20.193.22:0/3517309484 shutdown_connections 2026-02-24T07:21:18.472 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 --2- 10.20.193.22:0/3517309484 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7febac060f50 0x7febac061320 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=5934194552014761820 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.472 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 -- 10.20.193.22:0/3517309484 >> 10.20.193.22:0/3517309484 conn(0x7febac0ea730 msgr2=0x7febac10ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:18.472 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 -- 10.20.193.22:0/3517309484 shutdown_connections 2026-02-24T07:21:18.472 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 -- 10.20.193.22:0/3517309484 wait complete. 2026-02-24T07:21:18.472 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:18.472 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 Processor -- start 2026-02-24T07:21:18.472 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 -- start start 2026-02-24T07:21:18.472 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7febac060f50 0x7febac0f0ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:18.473 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febb124c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7febac0f1020 con 0x7febac060f50 2026-02-24T07:21:18.473 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febaad76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7febac060f50 0x7febac0f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:18.473 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febaad76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7febac060f50 0x7febac0f0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52182/0 (socket says 10.20.193.22:52182) 2026-02-24T07:21:18.473 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febaad76640 1 -- 10.20.193.22:0/1397260454 learned_addr learned my addr 10.20.193.22:0/1397260454 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:18.473 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febaad76640 1 -- 10.20.193.22:0/1397260454 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac0f1160 con 0x7febac060f50 2026-02-24T07:21:18.473 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.466+0000 7febaad76640 1 --2- 10.20.193.22:0/1397260454 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7febac060f50 0x7febac0f0ae0 crc :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:18.473 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.467+0000 7feb8bfff640 1 -- 10.20.193.22:0/1397260454 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7feba000d690 con 0x7febac060f50 2026-02-24T07:21:18.473 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.467+0000 7feb8bfff640 1 -- 10.20.193.22:0/1397260454 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7feba000d7f0 con 0x7febac060f50 2026-02-24T07:21:18.473 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.467+0000 7febb124c640 1 -- 10.20.193.22:0/1397260454 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febac0f13b0 con 0x7febac060f50 2026-02-24T07:21:18.474 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.467+0000 7feb8bfff640 1 -- 10.20.193.22:0/1397260454 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7feba000fe70 con 0x7febac060f50 2026-02-24T07:21:18.474 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.467+0000 7febb124c640 1 -- 10.20.193.22:0/1397260454 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febac0f61e0 con 0x7febac060f50 2026-02-24T07:21:18.474 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.467+0000 7febb124c640 1 -- 10.20.193.22:0/1397260454 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febac062460 con 0x7febac060f50 2026-02-24T07:21:18.474 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.467+0000 7feb8bfff640 1 -- 10.20.193.22:0/1397260454 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 18) ==== 52927+0+0 (crc 0 0 0) 0x7feba000e5c0 con 0x7febac060f50 2026-02-24T07:21:18.474 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.467+0000 7feb8bfff640 1 --2- 10.20.193.22:0/1397260454 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7feb8003f9b0 0x7feb8005fe60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:18.474 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.468+0000 7feb8bfff640 1 -- 10.20.193.22:0/1397260454 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3833+0+0 (crc 0 0 0) 0x7feba0052800 con 0x7febac060f50 2026-02-24T07:21:18.474 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.468+0000 7febaa575640 1 --2- 10.20.193.22:0/1397260454 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7feb8003f9b0 0x7feb8005fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:18.474 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.468+0000 7febaa575640 1 --2- 10.20.193.22:0/1397260454 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7feb8003f9b0 0x7feb8005fe60 crc :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:18.475 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.470+0000 7feb8bfff640 1 -- 10.20.193.22:0/1397260454 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7feba0009520 con 0x7febac060f50 2026-02-24T07:21:18.593 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 bash[75844]: Getting image source signatures 2026-02-24T07:21:18.593 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 bash[75844]: Copying blob sha256:9fa9226be034e47923c0457d916aa68474cdfb23af8d4525e9baeebc4760977a 2026-02-24T07:21:18.593 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 bash[75844]: Copying blob sha256:1617e25568b2231fdd0d5caff63b06f6f7738d8d961f031c80e47d35aaec9733 2026-02-24T07:21:18.594 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 bash[75844]: Copying blob sha256:c6e37428e3b36731b2b7a99979e0dbb27ce0849df0c23fb2b73e99bdbcd7ca33 2026-02-24T07:21:18.594 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.590+0000 7febb124c640 1 -- 10.20.193.22:0/1397260454 --> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7febac05f3f0 con 0x7feb8003f9b0 2026-02-24T07:21:18.596 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.593+0000 7feb8bfff640 1 -- 10.20.193.22:0/1397260454 <== mgr.14284 v2:10.20.193.22:6800/1339855099 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1104 (crc 0 0 0) 0x7febac05f3f0 con 0x7feb8003f9b0 2026-02-24T07:21:18.596 INFO:teuthology.orchestra.run.trial022.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-24T07:21:18.596 INFO:teuthology.orchestra.run.trial022.stdout:mgr.x trial022 *:9283,8765 running (78s) 2s ago 78s 510M - 20.3.0-5440-gff63f3d9 3992f70354a3 4c50eaeca39a 2026-02-24T07:21:18.596 INFO:teuthology.orchestra.run.trial022.stdout:mon.a trial022 running (79s) 2s ago 80s 43.5M 2048M 20.3.0-5440-gff63f3d9 3992f70354a3 82efd26da905 2026-02-24T07:21:18.596 INFO:teuthology.orchestra.run.trial022.stdout:osd.0 trial022 running (40s) 2s ago 42s 40.6M 41.0G 20.3.0-5440-gff63f3d9 3992f70354a3 14c67a3df4af 2026-02-24T07:21:18.597 INFO:teuthology.orchestra.run.trial022.stdout:osd.1 trial022 running (32s) 2s ago 32s 40.8M 41.0G 20.3.0-5440-gff63f3d9 3992f70354a3 3a21be25ea4e 2026-02-24T07:21:18.597 INFO:teuthology.orchestra.run.trial022.stdout:osd.2 trial195 running (23s) 2s ago 25s 41.2M 43.0G 20.3.0-5440-gff63f3d9 3992f70354a3 00190146add9 2026-02-24T07:21:18.597 INFO:teuthology.orchestra.run.trial022.stdout:osd.3 trial195 running (14s) 2s ago 16s 39.7M 43.0G 20.3.0-5440-gff63f3d9 3992f70354a3 7b235b784b60 2026-02-24T07:21:18.597 INFO:teuthology.orchestra.run.trial022.stdout:prometheus.a trial195 *:9095 running (6s) 2s ago 6s 30.4M - 3.6.0 4fcecf061b74 1843f11d1e56 2026-02-24T07:21:18.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.596+0000 7febb124c640 1 -- 10.20.193.22:0/1397260454 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7feb8003f9b0 msgr2=0x7feb8005fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:18.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.596+0000 7febb124c640 1 --2- 10.20.193.22:0/1397260454 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7feb8003f9b0 0x7feb8005fe60 crc :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.596+0000 7febb124c640 1 -- 10.20.193.22:0/1397260454 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7febac060f50 msgr2=0x7febac0f0ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:18.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.596+0000 7febb124c640 1 --2- 10.20.193.22:0/1397260454 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7febac060f50 0x7febac0f0ae0 crc :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.596+0000 7febb124c640 1 -- 10.20.193.22:0/1397260454 shutdown_connections 2026-02-24T07:21:18.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.596+0000 7febb124c640 1 --2- 10.20.193.22:0/1397260454 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7feb8003f9b0 0x7feb8005fe60 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.596+0000 7febb124c640 1 --2- 10.20.193.22:0/1397260454 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7febac060f50 0x7febac0f0ae0 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.596+0000 7febb124c640 1 -- 10.20.193.22:0/1397260454 >> 10.20.193.22:0/1397260454 conn(0x7febac0ea730 msgr2=0x7febac130ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:18.599 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.596+0000 7febb124c640 1 -- 10.20.193.22:0/1397260454 shutdown_connections 2026-02-24T07:21:18.600 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.596+0000 7febb124c640 1 -- 10.20.193.22:0/1397260454 wait complete. 2026-02-24T07:21:18.637 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-24T07:21:18.757 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:18.864 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.860+0000 7fe3628ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:18.864 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.860+0000 7fe3628ca640 1 -- 10.20.193.22:0/2863458146 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe35c066d80 msgr2=0x7fe35c062e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:18.864 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.860+0000 7fe3628ca640 1 --2- 10.20.193.22:0/2863458146 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe35c066d80 0x7fe35c062e30 crc :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=14172074192044185379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.864 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.860+0000 7fe3628ca640 1 -- 10.20.193.22:0/2863458146 shutdown_connections 2026-02-24T07:21:18.864 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.860+0000 7fe3628ca640 1 --2- 10.20.193.22:0/2863458146 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe35c066d80 0x7fe35c062e30 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=14172074192044185379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.864 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.860+0000 7fe3628ca640 1 -- 10.20.193.22:0/2863458146 >> 10.20.193.22:0/2863458146 conn(0x7fe35c0ec9a0 msgr2=0x7fe35c10cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:18.865 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.860+0000 7fe3628ca640 1 -- 10.20.193.22:0/2863458146 shutdown_connections 2026-02-24T07:21:18.865 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.860+0000 7fe3628ca640 1 -- 10.20.193.22:0/2863458146 wait complete. 2026-02-24T07:21:18.865 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe3628ca640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:18.865 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 bash[75844]: Copying config sha256:255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 2026-02-24T07:21:18.865 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 bash[75844]: Writing manifest to image destination 2026-02-24T07:21:18.865 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 podman[75844]: 2026-02-24 07:21:18.665974643 +0000 UTC m=+0.715433138 container create 5a7748f749f826883e26c106f970422cd3e178bda9497d82fb8c06f5dd8d837b (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-24T07:21:18.866 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 podman[75844]: 2026-02-24 07:21:18.695386956 +0000 UTC m=+0.744845451 container init 5a7748f749f826883e26c106f970422cd3e178bda9497d82fb8c06f5dd8d837b (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-24T07:21:18.866 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 podman[75844]: 2026-02-24 07:21:18.69748275 +0000 UTC m=+0.746941245 container start 5a7748f749f826883e26c106f970422cd3e178bda9497d82fb8c06f5dd8d837b (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-24T07:21:18.866 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 bash[75844]: 5a7748f749f826883e26c106f970422cd3e178bda9497d82fb8c06f5dd8d837b 2026-02-24T07:21:18.866 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 podman[75844]: 2026-02-24 07:21:18.660969895 +0000 UTC m=+0.710428390 image pull 255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 quay.io/prometheus/node-exporter:v1.9.1 2026-02-24T07:21:18.866 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.701Z level=INFO source=node_exporter.go:216 msg="Starting node_exporter" version="(version=1.9.1, branch=HEAD, revision=f2ec547b49af53815038a50265aa2adcd1275959)" 2026-02-24T07:21:18.866 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.701Z level=INFO source=node_exporter.go:217 msg="Build context" build_context="(go=go1.23.7, platform=linux/amd64, user=root@7023beaa563a, date=20250401-15:19:01, tags=unknown)" 2026-02-24T07:21:18.866 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 systemd[1]: Started Ceph node-exporter.a for 30400272-1151-11f1-be09-d404e6e7d460. 2026-02-24T07:21:18.866 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.701Z level=INFO source=filesystem_common.go:265 msg="Parsed flag --collector.filesystem.mount-points-exclude" collector=filesystem flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2026-02-24T07:21:18.866 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.701Z level=INFO source=filesystem_common.go:294 msg="Parsed flag --collector.filesystem.fs-types-exclude" collector=filesystem flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2026-02-24T07:21:18.866 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=diskstats_common.go:110 msg="Parsed flag --collector.diskstats.device-exclude" collector=diskstats flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2026-02-24T07:21:18.867 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=ERROR source=diskstats_linux.go:264 msg="Failed to open directory, disabling udev device properties" collector=diskstats path=/run/udev/data 2026-02-24T07:21:18.867 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:135 msg="Enabled collectors" 2026-02-24T07:21:18.867 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=arp 2026-02-24T07:21:18.868 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe3628ca640 1 Processor -- start 2026-02-24T07:21:18.868 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe3628ca640 1 -- start start 2026-02-24T07:21:18.868 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe3628ca640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe35c066d80 0x7fe35c11f0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:18.868 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe3628ca640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c11f5e0 con 0x7fe35c066d80 2026-02-24T07:21:18.868 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe35bfff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe35c066d80 0x7fe35c11f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:18.869 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe35bfff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe35c066d80 0x7fe35c11f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52190/0 (socket says 10.20.193.22:52190) 2026-02-24T07:21:18.869 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe35bfff640 1 -- 10.20.193.22:0/905911662 learned_addr learned my addr 10.20.193.22:0/905911662 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:18.869 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=bcache 2026-02-24T07:21:18.869 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=bonding 2026-02-24T07:21:18.869 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=btrfs 2026-02-24T07:21:18.869 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=conntrack 2026-02-24T07:21:18.870 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=cpu 2026-02-24T07:21:18.870 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=cpufreq 2026-02-24T07:21:18.870 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=diskstats 2026-02-24T07:21:18.870 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=dmi 2026-02-24T07:21:18.870 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=edac 2026-02-24T07:21:18.870 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=entropy 2026-02-24T07:21:18.870 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=fibrechannel 2026-02-24T07:21:18.870 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=filefd 2026-02-24T07:21:18.870 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=filesystem 2026-02-24T07:21:18.870 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=hwmon 2026-02-24T07:21:18.871 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=infiniband 2026-02-24T07:21:18.871 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=ipvs 2026-02-24T07:21:18.871 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=loadavg 2026-02-24T07:21:18.871 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=mdadm 2026-02-24T07:21:18.871 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=meminfo 2026-02-24T07:21:18.871 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=netclass 2026-02-24T07:21:18.871 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=netdev 2026-02-24T07:21:18.871 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=netstat 2026-02-24T07:21:18.871 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=nfs 2026-02-24T07:21:18.871 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=nfsd 2026-02-24T07:21:18.872 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe35bfff640 1 -- 10.20.193.22:0/905911662 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35c11f720 con 0x7fe35c066d80 2026-02-24T07:21:18.872 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe35bfff640 1 --2- 10.20.193.22:0/905911662 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe35c066d80 0x7fe35c11f0a0 crc :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:18.873 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe3597fa640 1 -- 10.20.193.22:0/905911662 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe34800d690 con 0x7fe35c066d80 2026-02-24T07:21:18.873 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe3628ca640 1 -- 10.20.193.22:0/905911662 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35c11f970 con 0x7fe35c066d80 2026-02-24T07:21:18.873 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe3597fa640 1 -- 10.20.193.22:0/905911662 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fe34800d7f0 con 0x7fe35c066d80 2026-02-24T07:21:18.873 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe3597fa640 1 -- 10.20.193.22:0/905911662 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe34800fe70 con 0x7fe35c066d80 2026-02-24T07:21:18.873 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=nvme 2026-02-24T07:21:18.873 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=os 2026-02-24T07:21:18.873 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=powersupplyclass 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=pressure 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=rapl 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=schedstat 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=selinux 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=sockstat 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=softnet 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=stat 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=tapestats 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=textfile 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=thermal_zone 2026-02-24T07:21:18.874 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=time 2026-02-24T07:21:18.875 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=udp_queues 2026-02-24T07:21:18.875 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=uname 2026-02-24T07:21:18.875 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=vmstat 2026-02-24T07:21:18.875 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=watchdog 2026-02-24T07:21:18.875 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=xfs 2026-02-24T07:21:18.875 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=node_exporter.go:141 msg=zfs 2026-02-24T07:21:18.875 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=tls_config.go:347 msg="Listening on" address=[::]:9100 2026-02-24T07:21:18.875 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a[76169]: time=2026-02-24T07:21:18.702Z level=INFO source=tls_config.go:350 msg="TLS is disabled." http2=false address=[::]:9100 2026-02-24T07:21:18.876 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.861+0000 7fe3628ca640 1 -- 10.20.193.22:0/905911662 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35c1247a0 con 0x7fe35c066d80 2026-02-24T07:21:18.876 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.862+0000 7fe3628ca640 1 -- 10.20.193.22:0/905911662 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe35c064340 con 0x7fe35c066d80 2026-02-24T07:21:18.877 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.862+0000 7fe3597fa640 1 -- 10.20.193.22:0/905911662 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 18) ==== 52927+0+0 (crc 0 0 0) 0x7fe3480026a0 con 0x7fe35c066d80 2026-02-24T07:21:18.877 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.862+0000 7fe3597fa640 1 --2- 10.20.193.22:0/905911662 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe33003f9b0 0x7fe33005fe60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:18.877 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.862+0000 7fe3597fa640 1 -- 10.20.193.22:0/905911662 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3833+0+0 (crc 0 0 0) 0x7fe3480527f0 con 0x7fe35c066d80 2026-02-24T07:21:18.877 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.862+0000 7fe35b7fe640 1 --2- 10.20.193.22:0/905911662 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe33003f9b0 0x7fe33005fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:18.877 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.863+0000 7fe35b7fe640 1 --2- 10.20.193.22:0/905911662 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe33003f9b0 0x7fe33005fe60 crc :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:18.877 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.865+0000 7fe3597fa640 1 -- 10.20.193.22:0/905911662 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fe34800e5c0 con 0x7fe35c066d80 2026-02-24T07:21:18.977 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.975+0000 7fe3628ca640 1 -- 10.20.193.22:0/905911662 --> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fe35c13bad0 con 0x7fe33003f9b0 2026-02-24T07:21:18.979 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.977+0000 7fe3597fa640 1 -- 10.20.193.22:0/905911662 <== mgr.14284 v2:10.20.193.22:6800/1339855099 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+492 (crc 0 0 0) 0x7fe35c13bad0 con 0x7fe33003f9b0 2026-02-24T07:21:18.979 INFO:teuthology.orchestra.run.trial022.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-24T07:21:18.980 INFO:teuthology.orchestra.run.trial022.stdout:mgr 1/1 2s ago 50s trial022=x;count:1 2026-02-24T07:21:18.980 INFO:teuthology.orchestra.run.trial022.stdout:mon 1/1 2s ago 52s trial022:10.20.193.22=a;count:1 2026-02-24T07:21:18.980 INFO:teuthology.orchestra.run.trial022.stdout:node-exporter ?:9100 0/2 - 10s trial022=a;trial195=b;count:2 2026-02-24T07:21:18.980 INFO:teuthology.orchestra.run.trial022.stdout:osd.default 4 2s ago 22s trial195 2026-02-24T07:21:18.980 INFO:teuthology.orchestra.run.trial022.stdout:prometheus ?:9095 1/1 2s ago 10s trial195=a;count:1 2026-02-24T07:21:18.981 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.978+0000 7fe3628ca640 1 -- 10.20.193.22:0/905911662 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe33003f9b0 msgr2=0x7fe33005fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:18.981 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.978+0000 7fe3628ca640 1 --2- 10.20.193.22:0/905911662 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe33003f9b0 0x7fe33005fe60 crc :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.982 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.978+0000 7fe3628ca640 1 -- 10.20.193.22:0/905911662 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe35c066d80 msgr2=0x7fe35c11f0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:18.982 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.978+0000 7fe3628ca640 1 --2- 10.20.193.22:0/905911662 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe35c066d80 0x7fe35c11f0a0 crc :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.982 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.978+0000 7fe3628ca640 1 -- 10.20.193.22:0/905911662 shutdown_connections 2026-02-24T07:21:18.982 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.978+0000 7fe3628ca640 1 --2- 10.20.193.22:0/905911662 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe33003f9b0 0x7fe33005fe60 unknown :-1 s=CLOSED pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.982 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.978+0000 7fe3628ca640 1 --2- 10.20.193.22:0/905911662 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe35c066d80 0x7fe35c11f0a0 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:18.982 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.978+0000 7fe3628ca640 1 -- 10.20.193.22:0/905911662 >> 10.20.193.22:0/905911662 conn(0x7fe35c0ec9a0 msgr2=0x7fe35c10cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:18.982 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.978+0000 7fe3628ca640 1 -- 10.20.193.22:0/905911662 shutdown_connections 2026-02-24T07:21:18.982 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:18.978+0000 7fe3628ca640 1 -- 10.20.193.22:0/905911662 wait complete. 2026-02-24T07:21:19.017 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-24T07:21:19.134 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:19.157 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: Updating trial022:/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:21:19.157 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: Updating trial195:/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.conf 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: Updating trial022:/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: Updating trial195:/etc/ceph/ceph.client.admin.keyring 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: from='client.14302 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: Updating trial195:/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: Updating trial022:/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: Deploying daemon node-exporter.a on trial022 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: mgrmap e18: x(active, since 2s) 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:19.158 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:18 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:19.241 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:19.241 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 -- 10.20.193.22:0/3961618014 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f014410f0f0 msgr2=0x7f014410f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:19.241 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 --2- 10.20.193.22:0/3961618014 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f014410f0f0 0x7f014410f4c0 crc :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=17883616802482611140 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.241 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 -- 10.20.193.22:0/3961618014 shutdown_connections 2026-02-24T07:21:19.241 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 --2- 10.20.193.22:0/3961618014 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f014410f0f0 0x7f014410f4c0 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=17883616802482611140 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.241 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 -- 10.20.193.22:0/3961618014 >> 10.20.193.22:0/3961618014 conn(0x7f01440ec9a0 msgr2=0x7f014410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:19.241 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 -- 10.20.193.22:0/3961618014 shutdown_connections 2026-02-24T07:21:19.241 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 -- 10.20.193.22:0/3961618014 wait complete. 2026-02-24T07:21:19.241 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 Processor -- start 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 -- start start 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f014410f0f0 0x7f01440f2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.236+0000 7f014984d640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01440f3360 con 0x7f014410f0f0 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f0142ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f014410f0f0 0x7f01440f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f0142ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f014410f0f0 0x7f01440f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52202/0 (socket says 10.20.193.22:52202) 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f0142ffd640 1 -- 10.20.193.22:0/3993667540 learned_addr learned my addr 10.20.193.22:0/3993667540 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f0142ffd640 1 -- 10.20.193.22:0/3993667540 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01440f34a0 con 0x7f014410f0f0 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f0142ffd640 1 --2- 10.20.193.22:0/3993667540 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f014410f0f0 0x7f01440f2e20 crc :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f014884b640 1 -- 10.20.193.22:0/3993667540 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f013800d690 con 0x7f014410f0f0 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f014984d640 1 -- 10.20.193.22:0/3993667540 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01440f36f0 con 0x7f014410f0f0 2026-02-24T07:21:19.242 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f014884b640 1 -- 10.20.193.22:0/3993667540 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f013800d7f0 con 0x7f014410f0f0 2026-02-24T07:21:19.243 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f014884b640 1 -- 10.20.193.22:0/3993667540 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f013800fd70 con 0x7f014410f0f0 2026-02-24T07:21:19.243 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f014984d640 1 -- 10.20.193.22:0/3993667540 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01440f8520 con 0x7f014410f0f0 2026-02-24T07:21:19.243 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f014984d640 1 -- 10.20.193.22:0/3993667540 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01441103d0 con 0x7f014410f0f0 2026-02-24T07:21:19.243 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.237+0000 7f014884b640 1 -- 10.20.193.22:0/3993667540 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 18) ==== 52927+0+0 (crc 0 0 0) 0x7f01380026a0 con 0x7f014410f0f0 2026-02-24T07:21:19.243 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.238+0000 7f014884b640 1 --2- 10.20.193.22:0/3993667540 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f011803f980 0x7f011805fe30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:19.243 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.238+0000 7f014884b640 1 -- 10.20.193.22:0/3993667540 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3833+0+0 (crc 0 0 0) 0x7f0138052830 con 0x7f014410f0f0 2026-02-24T07:21:19.243 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.238+0000 7f01427fc640 1 --2- 10.20.193.22:0/3993667540 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f011803f980 0x7f011805fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:19.243 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.238+0000 7f01427fc640 1 --2- 10.20.193.22:0/3993667540 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f011803f980 0x7f011805fe30 crc :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:19.244 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.240+0000 7f014884b640 1 -- 10.20.193.22:0/3993667540 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f0138007c30 con 0x7f014410f0f0 2026-02-24T07:21:19.348 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.345+0000 7f014984d640 1 -- 10.20.193.22:0/3993667540 --> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f01441375f0 con 0x7f011803f980 2026-02-24T07:21:19.349 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.346+0000 7f014884b640 1 -- 10.20.193.22:0/3993667540 <== mgr.14284 v2:10.20.193.22:6800/1339855099 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+145 (crc 0 0 0) 0x7f01441375f0 con 0x7f011803f980 2026-02-24T07:21:19.349 INFO:teuthology.orchestra.run.trial022.stdout:HOST ADDR LABELS STATUS 2026-02-24T07:21:19.349 INFO:teuthology.orchestra.run.trial022.stdout:trial022 10.20.193.22 2026-02-24T07:21:19.349 INFO:teuthology.orchestra.run.trial022.stdout:trial195 10.20.193.195 2026-02-24T07:21:19.349 INFO:teuthology.orchestra.run.trial022.stdout:2 hosts in cluster 2026-02-24T07:21:19.350 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.347+0000 7f014984d640 1 -- 10.20.193.22:0/3993667540 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f011803f980 msgr2=0x7f011805fe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:19.350 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.347+0000 7f014984d640 1 --2- 10.20.193.22:0/3993667540 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f011803f980 0x7f011805fe30 crc :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.350 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.347+0000 7f014984d640 1 -- 10.20.193.22:0/3993667540 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f014410f0f0 msgr2=0x7f01440f2e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:19.350 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.347+0000 7f014984d640 1 --2- 10.20.193.22:0/3993667540 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f014410f0f0 0x7f01440f2e20 crc :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.350 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.347+0000 7f014984d640 1 -- 10.20.193.22:0/3993667540 shutdown_connections 2026-02-24T07:21:19.350 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.347+0000 7f014984d640 1 --2- 10.20.193.22:0/3993667540 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f011803f980 0x7f011805fe30 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.350 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.347+0000 7f014984d640 1 --2- 10.20.193.22:0/3993667540 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f014410f0f0 0x7f01440f2e20 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.350 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.347+0000 7f014984d640 1 -- 10.20.193.22:0/3993667540 >> 10.20.193.22:0/3993667540 conn(0x7f01440ec9a0 msgr2=0x7f014410d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:19.350 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.347+0000 7f014984d640 1 -- 10.20.193.22:0/3993667540 shutdown_connections 2026-02-24T07:21:19.350 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.347+0000 7f014984d640 1 -- 10.20.193.22:0/3993667540 wait complete. 2026-02-24T07:21:19.386 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-24T07:21:19.499 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:21:19.605 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:19.605 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 1 -- 10.20.193.22:0/3768416765 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f17fc10f0f0 msgr2=0x7f17fc10f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:19.605 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 1 --2- 10.20.193.22:0/3768416765 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f17fc10f0f0 0x7f17fc10f4c0 crc :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=1457146796056545646 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.605 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 1 -- 10.20.193.22:0/3768416765 shutdown_connections 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 1 --2- 10.20.193.22:0/3768416765 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f17fc10f0f0 0x7f17fc10f4c0 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=1457146796056545646 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 1 -- 10.20.193.22:0/3768416765 >> 10.20.193.22:0/3768416765 conn(0x7f17fc0ec9a0 msgr2=0x7f17fc10cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 1 -- 10.20.193.22:0/3768416765 shutdown_connections 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 1 -- 10.20.193.22:0/3768416765 wait complete. 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 1 Processor -- start 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.600+0000 7f18014d5640 1 -- start start 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f18014d5640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f17fc10f0f0 0x7f17fc0f2e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f18014d5640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc0f3360 con 0x7f17fc10f0f0 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f17faffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f17fc10f0f0 0x7f17fc0f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:19.606 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f17faffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f17fc10f0f0 0x7f17fc0f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:52226/0 (socket says 10.20.193.22:52226) 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f17faffd640 1 -- 10.20.193.22:0/1751758137 learned_addr learned my addr 10.20.193.22:0/1751758137 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f17faffd640 1 -- 10.20.193.22:0/1751758137 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc0f34a0 con 0x7f17fc10f0f0 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f17faffd640 1 --2- 10.20.193.22:0/1751758137 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f17fc10f0f0 0x7f17fc0f2e20 crc :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f17dbfff640 1 -- 10.20.193.22:0/1751758137 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f17f000d690 con 0x7f17fc10f0f0 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f18014d5640 1 -- 10.20.193.22:0/1751758137 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17fc0f36f0 con 0x7f17fc10f0f0 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f17dbfff640 1 -- 10.20.193.22:0/1751758137 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f17f000d7f0 con 0x7f17fc10f0f0 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f17dbfff640 1 -- 10.20.193.22:0/1751758137 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f17f000fe70 con 0x7f17fc10f0f0 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f18014d5640 1 -- 10.20.193.22:0/1751758137 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17fc0f8520 con 0x7f17fc10f0f0 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.601+0000 7f18014d5640 1 -- 10.20.193.22:0/1751758137 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17fc1103d0 con 0x7f17fc10f0f0 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.602+0000 7f17dbfff640 1 -- 10.20.193.22:0/1751758137 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 18) ==== 52927+0+0 (crc 0 0 0) 0x7f17f000e5c0 con 0x7f17fc10f0f0 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.602+0000 7f17dbfff640 1 --2- 10.20.193.22:0/1751758137 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f17d003f950 0x7f17d005fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.602+0000 7f17dbfff640 1 -- 10.20.193.22:0/1751758137 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3833+0+0 (crc 0 0 0) 0x7f17f0052900 con 0x7f17fc10f0f0 2026-02-24T07:21:19.607 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.602+0000 7f17fa7fc640 1 --2- 10.20.193.22:0/1751758137 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f17d003f950 0x7f17d005fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:21:19.608 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.602+0000 7f17fa7fc640 1 --2- 10.20.193.22:0/1751758137 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f17d003f950 0x7f17d005fe00 crc :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:21:19.608 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.604+0000 7f17dbfff640 1 -- 10.20.193.22:0/1751758137 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f17f0009520 con 0x7f17fc10f0f0 2026-02-24T07:21:19.627 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 bash[65399]: Trying to pull quay.io/prometheus/node-exporter:v1.9.1... 2026-02-24T07:21:19.714 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.711+0000 7f18014d5640 1 -- 10.20.193.22:0/1751758137 --> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f17fc1375f0 con 0x7f17d003f950 2026-02-24T07:21:19.715 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.713+0000 7f17dbfff640 1 -- 10.20.193.22:0/1751758137 <== mgr.14284 v2:10.20.193.22:6800/1339855099 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+650 (crc 0 0 0) 0x7f17fc1375f0 con 0x7f17d003f950 2026-02-24T07:21:19.716 INFO:teuthology.orchestra.run.trial022.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-24T07:21:19.716 INFO:teuthology.orchestra.run.trial022.stdout:trial022 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB5187 1788G No 29s ago Has a FileSystem, LVM detected 2026-02-24T07:21:19.716 INFO:teuthology.orchestra.run.trial022.stdout:trial022 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB517C 1788G No 29s ago Has a FileSystem, LVM detected 2026-02-24T07:21:19.716 INFO:teuthology.orchestra.run.trial022.stdout:trial195 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47DBE 1788G No 9s ago Has a FileSystem, LVM detected 2026-02-24T07:21:19.716 INFO:teuthology.orchestra.run.trial022.stdout:trial195 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47EB3 1788G No 9s ago Has a FileSystem, LVM detected 2026-02-24T07:21:19.717 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.714+0000 7f18014d5640 1 -- 10.20.193.22:0/1751758137 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f17d003f950 msgr2=0x7f17d005fe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:19.717 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.714+0000 7f18014d5640 1 --2- 10.20.193.22:0/1751758137 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f17d003f950 0x7f17d005fe00 crc :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.717 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.714+0000 7f18014d5640 1 -- 10.20.193.22:0/1751758137 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f17fc10f0f0 msgr2=0x7f17fc0f2e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:21:19.717 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.714+0000 7f18014d5640 1 --2- 10.20.193.22:0/1751758137 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f17fc10f0f0 0x7f17fc0f2e20 crc :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.717 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.714+0000 7f18014d5640 1 -- 10.20.193.22:0/1751758137 shutdown_connections 2026-02-24T07:21:19.717 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.714+0000 7f18014d5640 1 --2- 10.20.193.22:0/1751758137 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f17d003f950 0x7f17d005fe00 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.718 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.714+0000 7f18014d5640 1 --2- 10.20.193.22:0/1751758137 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f17fc10f0f0 0x7f17fc0f2e20 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:21:19.718 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.714+0000 7f18014d5640 1 -- 10.20.193.22:0/1751758137 >> 10.20.193.22:0/1751758137 conn(0x7f17fc0ec9a0 msgr2=0x7f17fc10d560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:21:19.718 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.714+0000 7f18014d5640 1 -- 10.20.193.22:0/1751758137 shutdown_connections 2026-02-24T07:21:19.718 INFO:teuthology.orchestra.run.trial022.stderr:2026-02-24T07:21:19.714+0000 7f18014d5640 1 -- 10.20.193.22:0/1751758137 wait complete. 2026-02-24T07:21:19.752 INFO:teuthology.run_tasks:Running task workunit... 2026-02-24T07:21:19.781 INFO:tasks.workunit:Pulling workunits from ref a78040ddef3ba5a489697ca2fe95df59a7d8bd08 2026-02-24T07:21:19.782 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-24T07:21:19.782 DEBUG:teuthology.orchestra.run.trial022:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-24T07:21:19.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:21:19.800 INFO:teuthology.orchestra.run.trial022.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-24T07:21:19.800 DEBUG:teuthology.orchestra.run.trial022:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-24T07:21:19.857 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-24T07:21:19.858 DEBUG:teuthology.orchestra.run.trial022:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-24T07:21:19.914 INFO:tasks.workunit:timeout=3h 2026-02-24T07:21:19.914 INFO:tasks.workunit:cleanup=True 2026-02-24T07:21:19.914 DEBUG:teuthology.orchestra.run.trial022:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/shraddhaag/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a78040ddef3ba5a489697ca2fe95df59a7d8bd08 2026-02-24T07:21:19.978 INFO:tasks.workunit.client.0.trial022.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-24T07:21:19.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:19 trial022 ceph-mon[39108]: from='client.14308 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:21:19.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:19 trial022 ceph-mon[39108]: from='client.14310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:21:19.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:19 trial022 ceph-mon[39108]: Deploying daemon node-exporter.b on trial195 2026-02-24T07:21:19.978 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:19 trial022 ceph-mon[39108]: from='client.14312 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:21:20.128 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 bash[65399]: Getting image source signatures 2026-02-24T07:21:20.128 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 bash[65399]: Copying blob sha256:9fa9226be034e47923c0457d916aa68474cdfb23af8d4525e9baeebc4760977a 2026-02-24T07:21:20.128 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 bash[65399]: Copying blob sha256:c6e37428e3b36731b2b7a99979e0dbb27ce0849df0c23fb2b73e99bdbcd7ca33 2026-02-24T07:21:20.128 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 bash[65399]: Copying blob sha256:1617e25568b2231fdd0d5caff63b06f6f7738d8d961f031c80e47d35aaec9733 2026-02-24T07:21:20.128 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 bash[65399]: Copying config sha256:255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 2026-02-24T07:21:20.128 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 bash[65399]: Writing manifest to image destination 2026-02-24T07:21:20.128 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 podman[65399]: 2026-02-24 07:21:19.869594977 +0000 UTC m=+0.564945893 container create 5917178f2808cdf33f5580d262b679fabed548aec68bf8143499493c673f7592 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T07:21:20.128 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 podman[65399]: 2026-02-24 07:21:19.898795983 +0000 UTC m=+0.594146909 container init 5917178f2808cdf33f5580d262b679fabed548aec68bf8143499493c673f7592 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 podman[65399]: 2026-02-24 07:21:19.900833595 +0000 UTC m=+0.596184511 container start 5917178f2808cdf33f5580d262b679fabed548aec68bf8143499493c673f7592 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 bash[65399]: 5917178f2808cdf33f5580d262b679fabed548aec68bf8143499493c673f7592 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 podman[65399]: 2026-02-24 07:21:19.863237748 +0000 UTC m=+0.558588674 image pull 255ec253085fb105696533b31864a5e3b64f1f1e2147b5ec368100cbf3ec9b80 quay.io/prometheus/node-exporter:v1.9.1 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.904Z level=INFO source=node_exporter.go:216 msg="Starting node_exporter" version="(version=1.9.1, branch=HEAD, revision=f2ec547b49af53815038a50265aa2adcd1275959)" 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.904Z level=INFO source=node_exporter.go:217 msg="Build context" build_context="(go=go1.23.7, platform=linux/amd64, user=root@7023beaa563a, date=20250401-15:19:01, tags=unknown)" 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.904Z level=INFO source=filesystem_common.go:265 msg="Parsed flag --collector.filesystem.mount-points-exclude" collector=filesystem flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.904Z level=INFO source=filesystem_common.go:294 msg="Parsed flag --collector.filesystem.fs-types-exclude" collector=filesystem flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 systemd[1]: Started Ceph node-exporter.b for 30400272-1151-11f1-be09-d404e6e7d460. 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.904Z level=INFO source=diskstats_common.go:110 msg="Parsed flag --collector.diskstats.device-exclude" collector=diskstats flag=^(z?ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.904Z level=ERROR source=diskstats_linux.go:264 msg="Failed to open directory, disabling udev device properties" collector=diskstats path=/run/udev/data 2026-02-24T07:21:20.129 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:135 msg="Enabled collectors" 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=arp 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=bcache 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=bonding 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=btrfs 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=conntrack 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=cpu 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=cpufreq 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=diskstats 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=dmi 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=edac 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=entropy 2026-02-24T07:21:20.130 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=fibrechannel 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=filefd 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=filesystem 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=hwmon 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=infiniband 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=ipvs 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=loadavg 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=mdadm 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=meminfo 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=netclass 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=netdev 2026-02-24T07:21:20.131 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=netstat 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=nfs 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=nfsd 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=nvme 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=os 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=powersupplyclass 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=pressure 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=rapl 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=schedstat 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=selinux 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=sockstat 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=softnet 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=stat 2026-02-24T07:21:20.132 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=tapestats 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=textfile 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=thermal_zone 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=time 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=udp_queues 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=uname 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=vmstat 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=watchdog 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=xfs 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=node_exporter.go:141 msg=zfs 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=tls_config.go:347 msg="Listening on" address=[::]:9100 2026-02-24T07:21:20.133 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:21:19 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b[65445]: time=2026-02-24T07:21:19.905Z level=INFO source=tls_config.go:350 msg="TLS is disabled." http2=false address=[::]:9100 2026-02-24T07:21:20.974 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 systemd[1]: Stopping Ceph prometheus.a for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:21:20.974 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=WARN source=main.go:1076 msg="Received an OS signal, exiting gracefully..." signal=terminated 2026-02-24T07:21:20.974 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=main.go:1101 msg="Stopping scrape discovery manager..." 2026-02-24T07:21:20.974 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=main.go:1115 msg="Stopping notify discovery manager..." 2026-02-24T07:21:20.974 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=manager.go:190 msg="Stopping rule manager..." component="rule manager" 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=main.go:1097 msg="Scrape discovery manager stopped" 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=main.go:1111 msg="Notify discovery manager stopped" 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=manager.go:206 msg="Rule manager stopped" component="rule manager" 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=main.go:1152 msg="Stopping scrape manager..." 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=main.go:1144 msg="Scrape manager stopped" 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=manager.go:543 msg="Stopping notification manager..." component=notifier 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=manager.go:285 msg="Draining any remaining notifications..." component=notifier 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=manager.go:291 msg="Remaining notifications drained" component=notifier 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=manager.go:218 msg="Notification manager stopped" component=notifier 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=main.go:1422 msg="Notifier manager stopped" 2026-02-24T07:21:20.975 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[64010]: time=2026-02-24T07:21:20.905Z level=INFO source=main.go:1436 msg="See you next time!" 2026-02-24T07:21:20.976 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 podman[66098]: 2026-02-24 07:21:20.915686072 +0000 UTC m=+0.023850351 container died 1843f11d1e569f667cd490ff11b7584dd6ad6c32c4ff72a54b2a4027339e228f (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T07:21:20.976 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 podman[66098]: 2026-02-24 07:21:20.9235474 +0000 UTC m=+0.031711679 container remove 1843f11d1e569f667cd490ff11b7584dd6ad6c32c4ff72a54b2a4027339e228f (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a, org.opencontainers.image.source=https://github.com/prometheus/prometheus, maintainer=The Prometheus Authors ) 2026-02-24T07:21:20.976 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 bash[66098]: ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a 2026-02-24T07:21:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='client.14314 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:21:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='client.14316 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-24T07:21:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: mgrmap e19: x(active, since 4s) 2026-02-24T07:21:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:21:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:21.243 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:21.243 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:21:21.243 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:21:21.243 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:21.243 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:20 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:21:21.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 systemd[1]: ceph-30400272-1151-11f1-be09-d404e6e7d460@prometheus.a.service: Deactivated successfully. 2026-02-24T07:21:21.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:20 trial195 systemd[1]: Stopped Ceph prometheus.a for 30400272-1151-11f1-be09-d404e6e7d460. 2026-02-24T07:21:21.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 systemd[1]: Starting Ceph prometheus.a for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:21:21.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 podman[66229]: 2026-02-24 07:21:21.081879666 +0000 UTC m=+0.019109819 container create 444edfbf0c0cbd428a197a83c1757c88de69134637a1892c18017c3b5dfcfa74 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T07:21:21.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 podman[66229]: 2026-02-24 07:21:21.106729666 +0000 UTC m=+0.043959819 container init 444edfbf0c0cbd428a197a83c1757c88de69134637a1892c18017c3b5dfcfa74 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T07:21:21.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 podman[66229]: 2026-02-24 07:21:21.108955828 +0000 UTC m=+0.046185991 container start 444edfbf0c0cbd428a197a83c1757c88de69134637a1892c18017c3b5dfcfa74 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T07:21:21.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 bash[66229]: 444edfbf0c0cbd428a197a83c1757c88de69134637a1892c18017c3b5dfcfa74 2026-02-24T07:21:21.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 podman[66229]: 2026-02-24 07:21:21.074317645 +0000 UTC m=+0.011547809 image pull 4fcecf061b747d0b5dc55bc7efdba26f87768d058d403b5bcc3f0904cf49f973 quay.io/prometheus/prometheus:v3.6.0 2026-02-24T07:21:21.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 systemd[1]: Started Ceph prometheus.a for 30400272-1151-11f1-be09-d404e6e7d460. 2026-02-24T07:21:21.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.131Z level=INFO source=main.go:1545 msg="updated GOGC" old=100 new=75 2026-02-24T07:21:21.378 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.132Z level=INFO source=main.go:677 msg="Leaving GOMAXPROCS=24: CPU quota undefined" component=automaxprocs 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.132Z level=INFO source=memlimit.go:198 msg="GOMEMLIMIT is updated" component=automemlimit package=github.com/KimMachineGun/automemlimit/memlimit GOMEMLIMIT=120212523417 previous=9223372036854775807 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.132Z level=INFO source=main.go:770 msg="Starting Prometheus Server" mode=server version="(version=3.6.0, branch=HEAD, revision=491734606591ef8c188f5489c70380805bc868c0)" 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.132Z level=INFO source=main.go:775 msg="operational information" build_context="(go=go1.24.7, platform=linux/amd64, user=root@bfdf1aa26e4d, date=20250921-19:51:16, tags=netgo,builtinassets)" host_details="(Linux 5.14.0-686.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Feb 19 10:49:27 UTC 2026 x86_64 trial195 (none))" fd_limits="(soft=1048576, hard=1048576)" vm_limits="(soft=unlimited, hard=unlimited)" 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.133Z level=INFO source=web.go:659 msg="Start listening for connections" component=web address=:9095 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.133Z level=INFO source=main.go:1289 msg="Starting TSDB ..." 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.134Z level=INFO source=tls_config.go:347 msg="Listening on" component=web address=[::]:9095 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.134Z level=INFO source=tls_config.go:350 msg="TLS is disabled." component=web http2=false address=[::]:9095 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.135Z level=INFO source=head.go:667 msg="Replaying on-disk memory mappable chunks if any" component=tsdb 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.135Z level=INFO source=head.go:754 msg="On-disk memory mappable chunks replay completed" component=tsdb duration=511ns 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.135Z level=INFO source=head.go:762 msg="Replaying WAL, this may take a while" component=tsdb 2026-02-24T07:21:21.379 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.135Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=0 maxSegment=1 duration=148.586µs 2026-02-24T07:21:21.380 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.136Z level=INFO source=head.go:835 msg="WAL segment loaded" component=tsdb segment=1 maxSegment=1 duration=783.177µs 2026-02-24T07:21:21.380 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.136Z level=INFO source=head.go:872 msg="WAL replay completed" component=tsdb checkpoint_replay_duration=11.381µs wal_replay_duration=961.318µs wbl_replay_duration=120ns chunk_snapshot_load_duration=0s mmap_chunk_replay_duration=511ns total_replay_duration=994.901µs 2026-02-24T07:21:21.380 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.137Z level=INFO source=main.go:1310 msg="filesystem information" fs_type=XFS_SUPER_MAGIC 2026-02-24T07:21:21.380 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.137Z level=INFO source=main.go:1313 msg="TSDB started" 2026-02-24T07:21:21.380 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.137Z level=INFO source=main.go:1498 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2026-02-24T07:21:21.380 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.147Z level=INFO source=main.go:1538 msg="Completed loading of configuration file" db_storage=521ns remote_storage=722ns web_handler=211ns query_engine=441ns scrape=309.867µs scrape_sd=37.83µs notify=621ns notify_sd=371ns rules=9.024753ms tracing=5.059µs filename=/etc/prometheus/prometheus.yml totalDuration=9.53367ms 2026-02-24T07:21:21.380 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.147Z level=INFO source=main.go:1274 msg="Server is ready to receive web requests." 2026-02-24T07:21:21.380 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:21 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:21.147Z level=INFO source=manager.go:176 msg="Starting rule manager..." component="rule manager" 2026-02-24T07:21:21.741 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:21 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: [24/Feb/2026:07:21:21] ENGINE Bus STOPPING 2026-02-24T07:21:21.741 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:21 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: [24/Feb/2026:07:21:21] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2026-02-24T07:21:21.741 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:21 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: [24/Feb/2026:07:21:21] ENGINE Bus STOPPED 2026-02-24T07:21:21.741 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:21 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: [24/Feb/2026:07:21:21] ENGINE Bus STARTING 2026-02-24T07:21:21.742 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:21 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: [24/Feb/2026:07:21:21] ENGINE Serving on http://:::9283 2026-02-24T07:21:21.742 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:21 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: [24/Feb/2026:07:21:21] ENGINE Bus STARTED 2026-02-24T07:21:22.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: Reconfiguring prometheus.a deps ['8765', 'alertmanager_configured:False', 'ceph-exporter_configured:False', 'ingress_configured:False', 'mgmt-gateway_configured:False', 'mgr.x', 'nfs_configured:False', 'node-exporter_configured:False', 'nvmeof_configured:False', 'oauth2-proxy_configured:False', 'secure_monitoring_stack:False', 'smb_configured:False'] -> ['8765', 'alertmanager_configured:False', 'ceph-exporter_configured:False', 'ingress_configured:False', 'mgmt-gateway_configured:False', 'mgr.x', 'nfs_configured:False', 'node-exporter_configured:True', 'nvmeof_configured:False', 'oauth2-proxy_configured:False', 'secure_monitoring_stack:False', 'smb_configured:False'] (diff {'node-exporter_configured:True', 'node-exporter_configured:False'}) 2026-02-24T07:21:22.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: Reconfiguring daemon prometheus.a on trial195 2026-02-24T07:21:22.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "dashboard get-prometheus-api-host"} : dispatch 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "dashboard set-prometheus-api-host", "value": "http://trial195:9095"} : dispatch 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "orch get-security-config"} : dispatch 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:22.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:21:22.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:21:22.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:21:22.493 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:21:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:23 trial022 ceph-mon[39108]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-24T07:21:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:23 trial022 ceph-mon[39108]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial195:9095"}]: dispatch 2026-02-24T07:21:23.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:23 trial022 ceph-mon[39108]: Certificate for "cephadm-signed_agent_cert (trial022)" is still valid for 1824 days. 2026-02-24T07:21:23.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:23 trial022 ceph-mon[39108]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch get-security-config"}]: dispatch 2026-02-24T07:21:23.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:23 trial022 ceph-mon[39108]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:25 trial022 ceph-mon[39108]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2026-02-24T07:21:27.293 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:27 trial022 ceph-mon[39108]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2026-02-24T07:21:29.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:29 trial022 ceph-mon[39108]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2026-02-24T07:21:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:31 trial022 ceph-mon[39108]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-24T07:21:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:31 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:21:31.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:21:30] "GET /metrics HTTP/1.1" 200 3645 "" "Prometheus/3.6.0" 2026-02-24T07:21:31.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:30.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:21:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:33 trial022 ceph-mon[39108]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-24T07:21:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:35 trial022 ceph-mon[39108]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-24T07:21:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:37 trial022 ceph-mon[39108]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:39.427 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:39 trial022 ceph-mon[39108]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:40.322 INFO:tasks.workunit.client.0.trial022.stderr:Note: switching to 'a78040ddef3ba5a489697ca2fe95df59a7d8bd08'. 2026-02-24T07:21:40.322 INFO:tasks.workunit.client.0.trial022.stderr: 2026-02-24T07:21:40.322 INFO:tasks.workunit.client.0.trial022.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-24T07:21:40.322 INFO:tasks.workunit.client.0.trial022.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-24T07:21:40.322 INFO:tasks.workunit.client.0.trial022.stderr:state without impacting any branches by switching back to a branch. 2026-02-24T07:21:40.322 INFO:tasks.workunit.client.0.trial022.stderr: 2026-02-24T07:21:40.322 INFO:tasks.workunit.client.0.trial022.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-24T07:21:40.322 INFO:tasks.workunit.client.0.trial022.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-24T07:21:40.323 INFO:tasks.workunit.client.0.trial022.stderr: 2026-02-24T07:21:40.323 INFO:tasks.workunit.client.0.trial022.stderr: git switch -c 2026-02-24T07:21:40.323 INFO:tasks.workunit.client.0.trial022.stderr: 2026-02-24T07:21:40.323 INFO:tasks.workunit.client.0.trial022.stderr:Or undo this operation with: 2026-02-24T07:21:40.323 INFO:tasks.workunit.client.0.trial022.stderr: 2026-02-24T07:21:40.323 INFO:tasks.workunit.client.0.trial022.stderr: git switch - 2026-02-24T07:21:40.323 INFO:tasks.workunit.client.0.trial022.stderr: 2026-02-24T07:21:40.323 INFO:tasks.workunit.client.0.trial022.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-24T07:21:40.323 INFO:tasks.workunit.client.0.trial022.stderr: 2026-02-24T07:21:40.323 INFO:tasks.workunit.client.0.trial022.stderr:HEAD is now at a78040ddef3 qa/suites/crimson-rados: enable cephadm tests 2026-02-24T07:21:40.325 DEBUG:teuthology.orchestra.run.trial022:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-24T07:21:40.383 INFO:tasks.workunit.client.0.trial022.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-24T07:21:40.385 INFO:tasks.workunit.client.0.trial022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T07:21:40.385 INFO:tasks.workunit.client.0.trial022.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-24T07:21:40.482 INFO:tasks.workunit.client.0.trial022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-24T07:21:40.514 INFO:tasks.workunit.client.0.trial022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-24T07:21:40.540 INFO:tasks.workunit.client.0.trial022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T07:21:40.542 INFO:tasks.workunit.client.0.trial022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T07:21:40.542 INFO:tasks.workunit.client.0.trial022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-24T07:21:40.568 INFO:tasks.workunit.client.0.trial022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T07:21:40.572 DEBUG:teuthology.orchestra.run.trial022:> set -ex 2026-02-24T07:21:40.572 DEBUG:teuthology.orchestra.run.trial022:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-24T07:21:40.630 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2026-02-24T07:21:40.633 INFO:tasks.workunit:Running workunit rados/test.sh... 2026-02-24T07:21:40.633 DEBUG:teuthology.orchestra.run.trial022:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a78040ddef3ba5a489697ca2fe95df59a7d8bd08 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2026-02-24T07:21:40.693 INFO:tasks.workunit.client.0.trial022.stderr:+ RADOS_TESTS=(api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel) 2026-02-24T07:21:40.694 INFO:tasks.workunit.client.0.trial022.stderr:+ NEORADOS_TESTS=(cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations) 2026-02-24T07:21:40.694 INFO:tasks.workunit.client.0.trial022.stderr:+ parallel=1 2026-02-24T07:21:40.694 INFO:tasks.workunit.client.0.trial022.stderr:+ crimson=0 2026-02-24T07:21:40.694 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' --crimson = --serial ']' 2026-02-24T07:21:40.694 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' --crimson = --crimson ']' 2026-02-24T07:21:40.694 INFO:tasks.workunit.client.0.trial022.stderr:+ parallel=0 2026-02-24T07:21:40.694 INFO:tasks.workunit.client.0.trial022.stderr:+ crimson=1 2026-02-24T07:21:40.694 INFO:tasks.workunit.client.0.trial022.stderr:+ shift 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout=5400 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' '' = --timeout ']' 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ color= 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' -t 1 ']' 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ vstart=0 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' '' = --vstart ']' 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ declare -A pids 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ declare -A test_type 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ ret=0 2026-02-24T07:21:40.695 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:21:40.696 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:21:40.696 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_aio 2026-02-24T07:21:40.696 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:21:40.696 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:21:40.696 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_aio 2026-02-24T07:21:40.708 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:21:40.708 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 45 tests from 2 test suites. 2026-02-24T07:21:40.708 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:21:40.708 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 29 tests from LibRadosAio 2026-02-24T07:21:40.708 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.TooBig 2026-02-24T07:21:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:41 trial022 ceph-mon[39108]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:21:40] "GET /metrics HTTP/1.1" 200 3907 "" "Prometheus/3.6.0" 2026-02-24T07:21:41.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:40.954Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:21:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:42 trial022 ceph-mon[39108]: osdmap e28: 4 total, 4 up, 4 in 2026-02-24T07:21:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2020766236' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBig_trial022-77142-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:21:43.023 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.TooBig (2315 ms) 2026-02-24T07:21:43.023 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.SimpleWrite 2026-02-24T07:21:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:43 trial022 ceph-mon[39108]: pgmap v17: 33 pgs: 19 creating+peering, 13 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:43 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2020766236' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_trial022-77142-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:21:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:43 trial022 ceph-mon[39108]: osdmap e29: 4 total, 4 up, 4 in 2026-02-24T07:21:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:44 trial022 ceph-mon[39108]: osdmap e30: 4 total, 4 up, 4 in 2026-02-24T07:21:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:45 trial022 ceph-mon[39108]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:45 trial022 ceph-mon[39108]: osdmap e31: 4 total, 4 up, 4 in 2026-02-24T07:21:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:45 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1094035544' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWrite_trial022-77142-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:21:46.028 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.SimpleWrite (3004 ms) 2026-02-24T07:21:46.028 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.WaitForSafe 2026-02-24T07:21:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:46 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1094035544' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_trial022-77142-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:21:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:46 trial022 ceph-mon[39108]: osdmap e32: 4 total, 4 up, 4 in 2026-02-24T07:21:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:46 trial022 ceph-mon[39108]: pgmap v23: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:46 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:21:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:47 trial022 ceph-mon[39108]: osdmap e33: 4 total, 4 up, 4 in 2026-02-24T07:21:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:48 trial022 ceph-mon[39108]: osdmap e34: 4 total, 4 up, 4 in 2026-02-24T07:21:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:48 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/664196295' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial022-77142-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:21:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:48 trial022 ceph-mon[39108]: pgmap v26: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:49.036 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.WaitForSafe (3008 ms) 2026-02-24T07:21:49.036 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTrip 2026-02-24T07:21:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:49 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/664196295' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_trial022-77142-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:21:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:49 trial022 ceph-mon[39108]: osdmap e35: 4 total, 4 up, 4 in 2026-02-24T07:21:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:50 trial022 ceph-mon[39108]: osdmap e36: 4 total, 4 up, 4 in 2026-02-24T07:21:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:50 trial022 ceph-mon[39108]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:51 trial022 ceph-mon[39108]: osdmap e37: 4 total, 4 up, 4 in 2026-02-24T07:21:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:51 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1414020721' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_trial022-77142-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:21:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:21:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:21:50] "GET /metrics HTTP/1.1" 200 4176 "" "Prometheus/3.6.0" 2026-02-24T07:21:51.287 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:21:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:21:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:21:52.043 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTrip (3006 ms) 2026-02-24T07:21:52.043 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTrip2 2026-02-24T07:21:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:52 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1414020721' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_trial022-77142-4","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:21:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:52 trial022 ceph-mon[39108]: osdmap e38: 4 total, 4 up, 4 in 2026-02-24T07:21:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:52 trial022 ceph-mon[39108]: pgmap v32: 33 pgs: 33 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2026-02-24T07:21:53.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:53 trial022 ceph-mon[39108]: osdmap e39: 4 total, 4 up, 4 in 2026-02-24T07:21:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:54 trial022 ceph-mon[39108]: osdmap e40: 4 total, 4 up, 4 in 2026-02-24T07:21:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:54 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2859648917' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip2_trial022-77142-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:21:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:54 trial022 ceph-mon[39108]: pgmap v35: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:55.047 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTrip2 (3004 ms) 2026-02-24T07:21:55.048 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTrip3 2026-02-24T07:21:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:55 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2859648917' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_trial022-77142-5","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:21:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:55 trial022 ceph-mon[39108]: osdmap e41: 4 total, 4 up, 4 in 2026-02-24T07:21:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:56 trial022 ceph-mon[39108]: osdmap e42: 4 total, 4 up, 4 in 2026-02-24T07:21:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:56 trial022 ceph-mon[39108]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:57.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:57 trial022 ceph-mon[39108]: osdmap e43: 4 total, 4 up, 4 in 2026-02-24T07:21:57.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:57 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1581771301' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip3_trial022-77142-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:21:58.056 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTrip3 (3008 ms) 2026-02-24T07:21:58.056 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2026-02-24T07:21:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:58 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1581771301' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_trial022-77142-6","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:21:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:58 trial022 ceph-mon[39108]: osdmap e44: 4 total, 4 up, 4 in 2026-02-24T07:21:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:58 trial022 ceph-mon[39108]: pgmap v41: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:21:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:21:59 trial022 ceph-mon[39108]: osdmap e45: 4 total, 4 up, 4 in 2026-02-24T07:22:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:00 trial022 ceph-mon[39108]: osdmap e46: 4 total, 4 up, 4 in 2026-02-24T07:22:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:00 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1588487403' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppend_trial022-77142-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:00 trial022 ceph-mon[39108]: pgmap v44: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:01.060 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripAppend (3004 ms) 2026-02-24T07:22:01.060 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RemoveTest 2026-02-24T07:22:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:01 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1588487403' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_trial022-77142-7","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:01 trial022 ceph-mon[39108]: osdmap e47: 4 total, 4 up, 4 in 2026-02-24T07:22:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:01 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:22:01.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:22:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:22:00] "GET /metrics HTTP/1.1" 200 4176 "" "Prometheus/3.6.0" 2026-02-24T07:22:01.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:22:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:22:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:22:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:02 trial022 ceph-mon[39108]: osdmap e48: 4 total, 4 up, 4 in 2026-02-24T07:22:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:02 trial022 ceph-mon[39108]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:03 trial022 ceph-mon[39108]: osdmap e49: 4 total, 4 up, 4 in 2026-02-24T07:22:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:03 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1751021598' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTest_trial022-77142-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:04.068 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RemoveTest (3007 ms) 2026-02-24T07:22:04.068 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2026-02-24T07:22:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:04 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1751021598' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_trial022-77142-8","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:04 trial022 ceph-mon[39108]: osdmap e50: 4 total, 4 up, 4 in 2026-02-24T07:22:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:04 trial022 ceph-mon[39108]: pgmap v50: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:05 trial022 ceph-mon[39108]: osdmap e51: 4 total, 4 up, 4 in 2026-02-24T07:22:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:06 trial022 ceph-mon[39108]: osdmap e52: 4 total, 4 up, 4 in 2026-02-24T07:22:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:06 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4086820605' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTrip_trial022-77142-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:06 trial022 ceph-mon[39108]: pgmap v53: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:07.074 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3006 ms) 2026-02-24T07:22:07.074 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RmXattr 2026-02-24T07:22:07.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:07 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4086820605' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_trial022-77142-9","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:07.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:07 trial022 ceph-mon[39108]: osdmap e53: 4 total, 4 up, 4 in 2026-02-24T07:22:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:08 trial022 ceph-mon[39108]: osdmap e54: 4 total, 4 up, 4 in 2026-02-24T07:22:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:08 trial022 ceph-mon[39108]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:09 trial022 ceph-mon[39108]: osdmap e55: 4 total, 4 up, 4 in 2026-02-24T07:22:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:09 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1732932598' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattr_trial022-77142-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:10.080 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RmXattr (3005 ms) 2026-02-24T07:22:10.080 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.XattrIter 2026-02-24T07:22:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:10 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1732932598' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_trial022-77142-10","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:10 trial022 ceph-mon[39108]: osdmap e56: 4 total, 4 up, 4 in 2026-02-24T07:22:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:10 trial022 ceph-mon[39108]: pgmap v59: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:11.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:11 trial022 ceph-mon[39108]: osdmap e57: 4 total, 4 up, 4 in 2026-02-24T07:22:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:22:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:22:10] "GET /metrics HTTP/1.1" 200 4173 "" "Prometheus/3.6.0" 2026-02-24T07:22:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:22:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:22:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:22:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:12 trial022 ceph-mon[39108]: osdmap e58: 4 total, 4 up, 4 in 2026-02-24T07:22:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:12 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2804073707' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrIter_trial022-77142-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:12 trial022 ceph-mon[39108]: pgmap v62: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:13.089 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.XattrIter (3008 ms) 2026-02-24T07:22:13.089 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.IsComplete 2026-02-24T07:22:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:13 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2804073707' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_trial022-77142-11","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:13 trial022 ceph-mon[39108]: osdmap e59: 4 total, 4 up, 4 in 2026-02-24T07:22:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:14 trial022 ceph-mon[39108]: osdmap e60: 4 total, 4 up, 4 in 2026-02-24T07:22:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:14 trial022 ceph-mon[39108]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:15 trial022 ceph-mon[39108]: osdmap e61: 4 total, 4 up, 4 in 2026-02-24T07:22:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:15 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2093704017' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsComplete_trial022-77142-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:16.096 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.IsComplete (3007 ms) 2026-02-24T07:22:16.096 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.IsSafe 2026-02-24T07:22:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:16 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2093704017' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_trial022-77142-12","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:16 trial022 ceph-mon[39108]: osdmap e62: 4 total, 4 up, 4 in 2026-02-24T07:22:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:16 trial022 ceph-mon[39108]: pgmap v68: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:22:17.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:17 trial022 ceph-mon[39108]: osdmap e63: 4 total, 4 up, 4 in 2026-02-24T07:22:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:18 trial022 ceph-mon[39108]: osdmap e64: 4 total, 4 up, 4 in 2026-02-24T07:22:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:18 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1684877835' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafe_trial022-77142-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:18 trial022 ceph-mon[39108]: pgmap v71: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:19.105 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.IsSafe (3009 ms) 2026-02-24T07:22:19.106 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.ReturnValue 2026-02-24T07:22:19.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:19 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1684877835' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_trial022-77142-13","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:19.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:19 trial022 ceph-mon[39108]: osdmap e65: 4 total, 4 up, 4 in 2026-02-24T07:22:20.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:20 trial022 ceph-mon[39108]: osdmap e66: 4 total, 4 up, 4 in 2026-02-24T07:22:20.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:20 trial022 ceph-mon[39108]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:21 trial022 ceph-mon[39108]: osdmap e67: 4 total, 4 up, 4 in 2026-02-24T07:22:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:21 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2881478346' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValue_trial022-77142-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:22:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:22:20] "GET /metrics HTTP/1.1" 200 4169 "" "Prometheus/3.6.0" 2026-02-24T07:22:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:22:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:22:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:22:22.112 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.ReturnValue (3006 ms) 2026-02-24T07:22:22.112 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.Flush 2026-02-24T07:22:22.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:22 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2881478346' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_trial022-77142-14","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:22.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:22 trial022 ceph-mon[39108]: osdmap e68: 4 total, 4 up, 4 in 2026-02-24T07:22:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:22 trial022 ceph-mon[39108]: pgmap v77: 33 pgs: 33 active+clean; 577 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:22:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:22:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:22:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:22:22.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:22:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:23 trial022 ceph-mon[39108]: osdmap e69: 4 total, 4 up, 4 in 2026-02-24T07:22:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:24 trial022 ceph-mon[39108]: osdmap e70: 4 total, 4 up, 4 in 2026-02-24T07:22:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:24 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3284484522' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Flush_trial022-77142-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:24 trial022 ceph-mon[39108]: pgmap v80: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:25.117 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.Flush (3005 ms) 2026-02-24T07:22:25.118 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.FlushAsync 2026-02-24T07:22:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:25 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3284484522' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_trial022-77142-15","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:25 trial022 ceph-mon[39108]: osdmap e71: 4 total, 4 up, 4 in 2026-02-24T07:22:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:26 trial022 ceph-mon[39108]: osdmap e72: 4 total, 4 up, 4 in 2026-02-24T07:22:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:26 trial022 ceph-mon[39108]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:27 trial022 ceph-mon[39108]: osdmap e73: 4 total, 4 up, 4 in 2026-02-24T07:22:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:27 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/557020968' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsync_trial022-77142-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:28.126 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.FlushAsync (3008 ms) 2026-02-24T07:22:28.126 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2026-02-24T07:22:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:28 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/557020968' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_trial022-77142-16","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:28 trial022 ceph-mon[39108]: osdmap e74: 4 total, 4 up, 4 in 2026-02-24T07:22:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:28 trial022 ceph-mon[39108]: pgmap v86: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:29.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:29 trial022 ceph-mon[39108]: osdmap e75: 4 total, 4 up, 4 in 2026-02-24T07:22:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:30 trial022 ceph-mon[39108]: osdmap e76: 4 total, 4 up, 4 in 2026-02-24T07:22:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:30 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/801671791' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFull_trial022-77142-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:30 trial022 ceph-mon[39108]: pgmap v89: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:31.135 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3008 ms) 2026-02-24T07:22:31.135 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2026-02-24T07:22:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:31 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/801671791' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_trial022-77142-17","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:31 trial022 ceph-mon[39108]: osdmap e77: 4 total, 4 up, 4 in 2026-02-24T07:22:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:31 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:22:31.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:22:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:22:30] "GET /metrics HTTP/1.1" 200 4169 "" "Prometheus/3.6.0" 2026-02-24T07:22:31.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:22:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:22:30.954Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:22:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:32 trial022 ceph-mon[39108]: osdmap e78: 4 total, 4 up, 4 in 2026-02-24T07:22:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:32 trial022 ceph-mon[39108]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:33 trial022 ceph-mon[39108]: osdmap e79: 4 total, 4 up, 4 in 2026-02-24T07:22:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:33 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/864717245' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSame_trial022-77142-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:34.140 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (3005 ms) 2026-02-24T07:22:34.141 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.SimpleStat 2026-02-24T07:22:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:34 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/864717245' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_trial022-77142-18","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:34 trial022 ceph-mon[39108]: osdmap e80: 4 total, 4 up, 4 in 2026-02-24T07:22:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:34 trial022 ceph-mon[39108]: pgmap v95: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:35 trial022 ceph-mon[39108]: osdmap e81: 4 total, 4 up, 4 in 2026-02-24T07:22:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:36 trial022 ceph-mon[39108]: osdmap e82: 4 total, 4 up, 4 in 2026-02-24T07:22:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:36 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3676900881' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStat_trial022-77142-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:36 trial022 ceph-mon[39108]: pgmap v98: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 110 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:37.149 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.SimpleStat (3008 ms) 2026-02-24T07:22:37.150 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.OperateMtime 2026-02-24T07:22:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:37 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3676900881' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_trial022-77142-19","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:37 trial022 ceph-mon[39108]: osdmap e83: 4 total, 4 up, 4 in 2026-02-24T07:22:38.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:38 trial022 ceph-mon[39108]: osdmap e84: 4 total, 4 up, 4 in 2026-02-24T07:22:38.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:38 trial022 ceph-mon[39108]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:39 trial022 ceph-mon[39108]: osdmap e85: 4 total, 4 up, 4 in 2026-02-24T07:22:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:39 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2722254549' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_trial022-77142-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:40.156 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.OperateMtime (3006 ms) 2026-02-24T07:22:40.156 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2026-02-24T07:22:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:40 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2722254549' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_trial022-77142-20","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:40 trial022 ceph-mon[39108]: osdmap e86: 4 total, 4 up, 4 in 2026-02-24T07:22:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:40 trial022 ceph-mon[39108]: pgmap v104: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:41 trial022 ceph-mon[39108]: osdmap e87: 4 total, 4 up, 4 in 2026-02-24T07:22:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:22:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:22:40] "GET /metrics HTTP/1.1" 200 4184 "" "Prometheus/3.6.0" 2026-02-24T07:22:41.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:22:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:22:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:22:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:42 trial022 ceph-mon[39108]: osdmap e88: 4 total, 4 up, 4 in 2026-02-24T07:22:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1531644265' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "Operate2Mtime_trial022-77142-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:42 trial022 ceph-mon[39108]: pgmap v107: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:43.162 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.Operate2Mtime (3006 ms) 2026-02-24T07:22:43.162 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2026-02-24T07:22:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:43 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1531644265' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_trial022-77142-21","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:43 trial022 ceph-mon[39108]: osdmap e89: 4 total, 4 up, 4 in 2026-02-24T07:22:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:44 trial022 ceph-mon[39108]: osdmap e90: 4 total, 4 up, 4 in 2026-02-24T07:22:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:44 trial022 ceph-mon[39108]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:45 trial022 ceph-mon[39108]: osdmap e91: 4 total, 4 up, 4 in 2026-02-24T07:22:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:45 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1225284634' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatNS_trial022-77142-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:46.169 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.SimpleStatNS (3006 ms) 2026-02-24T07:22:46.169 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.StatRemove 2026-02-24T07:22:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:46 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1225284634' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_trial022-77142-22","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:46 trial022 ceph-mon[39108]: osdmap e92: 4 total, 4 up, 4 in 2026-02-24T07:22:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:46 trial022 ceph-mon[39108]: pgmap v113: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:46 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:22:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:47 trial022 ceph-mon[39108]: osdmap e93: 4 total, 4 up, 4 in 2026-02-24T07:22:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:48 trial022 ceph-mon[39108]: osdmap e94: 4 total, 4 up, 4 in 2026-02-24T07:22:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:48 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1608869482' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemove_trial022-77142-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:48 trial022 ceph-mon[39108]: pgmap v116: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:49.176 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.StatRemove (3007 ms) 2026-02-24T07:22:49.176 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.ExecuteClass 2026-02-24T07:22:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:49 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1608869482' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_trial022-77142-23","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:49 trial022 ceph-mon[39108]: osdmap e95: 4 total, 4 up, 4 in 2026-02-24T07:22:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:50 trial022 ceph-mon[39108]: osdmap e96: 4 total, 4 up, 4 in 2026-02-24T07:22:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:50 trial022 ceph-mon[39108]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:51 trial022 ceph-mon[39108]: osdmap e97: 4 total, 4 up, 4 in 2026-02-24T07:22:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:51 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1334419706' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClass_trial022-77142-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:22:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:22:50] "GET /metrics HTTP/1.1" 200 4186 "" "Prometheus/3.6.0" 2026-02-24T07:22:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:22:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:22:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:22:52.183 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.ExecuteClass (3007 ms) 2026-02-24T07:22:52.184 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.MultiWrite 2026-02-24T07:22:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:52 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1334419706' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_trial022-77142-24","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:52 trial022 ceph-mon[39108]: osdmap e98: 4 total, 4 up, 4 in 2026-02-24T07:22:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:52 trial022 ceph-mon[39108]: pgmap v122: 33 pgs: 33 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:22:53.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:53 trial022 ceph-mon[39108]: osdmap e99: 4 total, 4 up, 4 in 2026-02-24T07:22:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:54 trial022 ceph-mon[39108]: osdmap e100: 4 total, 4 up, 4 in 2026-02-24T07:22:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:54 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/428337356' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWrite_trial022-77142-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:54 trial022 ceph-mon[39108]: pgmap v125: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:55.189 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.MultiWrite (3005 ms) 2026-02-24T07:22:55.189 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.AioUnlock 2026-02-24T07:22:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:55 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/428337356' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_trial022-77142-25","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:55 trial022 ceph-mon[39108]: osdmap e101: 4 total, 4 up, 4 in 2026-02-24T07:22:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:56 trial022 ceph-mon[39108]: osdmap e102: 4 total, 4 up, 4 in 2026-02-24T07:22:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:56 trial022 ceph-mon[39108]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:57.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:57 trial022 ceph-mon[39108]: osdmap e103: 4 total, 4 up, 4 in 2026-02-24T07:22:57.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:57 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3766887558' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlock_trial022-77142-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:22:58.197 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.AioUnlock (3008 ms) 2026-02-24T07:22:58.197 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.CancelBeforeSubmit 2026-02-24T07:22:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:58 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3766887558' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_trial022-77142-26","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:22:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:58 trial022 ceph-mon[39108]: osdmap e104: 4 total, 4 up, 4 in 2026-02-24T07:22:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:58 trial022 ceph-mon[39108]: pgmap v131: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:22:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:22:59 trial022 ceph-mon[39108]: osdmap e105: 4 total, 4 up, 4 in 2026-02-24T07:23:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:00 trial022 ceph-mon[39108]: osdmap e106: 4 total, 4 up, 4 in 2026-02-24T07:23:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:00 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2749930539' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CancelBeforeSubmit_trial022-77142-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:00 trial022 ceph-mon[39108]: pgmap v134: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 111 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:01.203 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.CancelBeforeSubmit (3005 ms) 2026-02-24T07:23:01.203 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.CancelBeforeComplete 2026-02-24T07:23:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:01 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2749930539' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CancelBeforeSubmit_trial022-77142-27","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:01 trial022 ceph-mon[39108]: osdmap e107: 4 total, 4 up, 4 in 2026-02-24T07:23:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:01 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:23:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:23:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:23:00] "GET /metrics HTTP/1.1" 200 4186 "" "Prometheus/3.6.0" 2026-02-24T07:23:01.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:23:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:23:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:23:02.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:02 trial022 ceph-mon[39108]: osdmap e108: 4 total, 4 up, 4 in 2026-02-24T07:23:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:02 trial022 ceph-mon[39108]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:03 trial022 ceph-mon[39108]: osdmap e109: 4 total, 4 up, 4 in 2026-02-24T07:23:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:03 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1397360500' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CancelBeforeComplete_trial022-77142-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:04.210 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.CancelBeforeComplete (3006 ms) 2026-02-24T07:23:04.210 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.CancelAfterComplete 2026-02-24T07:23:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:04 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1397360500' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CancelBeforeComplete_trial022-77142-28","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:04 trial022 ceph-mon[39108]: osdmap e110: 4 total, 4 up, 4 in 2026-02-24T07:23:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:04 trial022 ceph-mon[39108]: pgmap v140: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:05 trial022 ceph-mon[39108]: osdmap e111: 4 total, 4 up, 4 in 2026-02-24T07:23:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:06 trial022 ceph-mon[39108]: osdmap e112: 4 total, 4 up, 4 in 2026-02-24T07:23:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:06 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1660559722' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CancelAfterComplete_trial022-77142-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:06 trial022 ceph-mon[39108]: pgmap v143: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:07.218 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.CancelAfterComplete (3006 ms) 2026-02-24T07:23:07.219 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 29 tests from LibRadosAio (86508 ms total) 2026-02-24T07:23:07.219 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.219 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 16 tests from LibRadosAioEC 2026-02-24T07:23:07.219 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2026-02-24T07:23:07.219 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1102: Skipped 2026-02-24T07:23:07.219 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.219 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.219 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2026-02-24T07:23:07.219 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2026-02-24T07:23:07.219 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1134: Skipped 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1151: Skipped 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1184: Skipped 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.220 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1217: Skipped 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.IsComplete 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1288: Skipped 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.IsSafe 2026-02-24T07:23:07.221 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1328: Skipped 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1368: Skipped 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.Flush 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1387: Skipped 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.222 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1417: Skipped 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1456: Skipped 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2026-02-24T07:23:07.223 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1500: Skipped 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1534: Skipped 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.StatRemove 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1595: Skipped 2026-02-24T07:23:07.224 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1651: Skipped 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio.cc:1683: Skipped 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.225 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 45 tests from 2 test suites ran. (86508 ms total) 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 29 tests. 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 16 tests, listed below: 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2026-02-24T07:23:07.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2026-02-24T07:23:07.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2026-02-24T07:23:07.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2026-02-24T07:23:07.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2026-02-24T07:23:07.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2026-02-24T07:23:07.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2026-02-24T07:23:07.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2026-02-24T07:23:07.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2026-02-24T07:23:07.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2026-02-24T07:23:07.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2026-02-24T07:23:07.228 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:23:07.228 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_aio_pp 2026-02-24T07:23:07.228 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:23:07.228 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:23:07.229 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_aio_pp 2026-02-24T07:23:07.234 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:23:07.234 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 63 tests from 5 test suites. 2026-02-24T07:23:07.234 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:23:07.234 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 32 tests from LibRadosAio 2026-02-24T07:23:07.234 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.TooBigPP 2026-02-24T07:23:07.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:07 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1660559722' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CancelAfterComplete_trial022-77142-29","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:07.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:07 trial022 ceph-mon[39108]: osdmap e113: 4 total, 4 up, 4 in 2026-02-24T07:23:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:08 trial022 ceph-mon[39108]: osdmap e114: 4 total, 4 up, 4 in 2026-02-24T07:23:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:08 trial022 ceph-mon[39108]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:09 trial022 ceph-mon[39108]: osdmap e115: 4 total, 4 up, 4 in 2026-02-24T07:23:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:09 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1343034793' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "TooBigPP_trial022-77741-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:10.226 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.TooBigPP (2991 ms) 2026-02-24T07:23:10.226 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2026-02-24T07:23:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:10 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1343034793' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_trial022-77741-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:10 trial022 ceph-mon[39108]: osdmap e116: 4 total, 4 up, 4 in 2026-02-24T07:23:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:10 trial022 ceph-mon[39108]: pgmap v149: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:11.223 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:23:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:23:10] "GET /metrics HTTP/1.1" 200 4187 "" "Prometheus/3.6.0" 2026-02-24T07:23:11.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:23:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:23:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:23:11.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:11 trial022 ceph-mon[39108]: osdmap e117: 4 total, 4 up, 4 in 2026-02-24T07:23:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:12 trial022 ceph-mon[39108]: osdmap e118: 4 total, 4 up, 4 in 2026-02-24T07:23:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:12 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1515262707' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial022-77741-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:12 trial022 ceph-mon[39108]: pgmap v152: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:13 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1515262707' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial022-77741-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:13 trial022 ceph-mon[39108]: osdmap e119: 4 total, 4 up, 4 in 2026-02-24T07:23:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:14 trial022 ceph-mon[39108]: osdmap e120: 4 total, 4 up, 4 in 2026-02-24T07:23:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:14 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1515262707' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial022-77741-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:14 trial022 ceph-mon[39108]: pgmap v155: 65 pgs: 32 unknown, 32 creating+peering, 1 active+clean; 577 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:15 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1515262707' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial022-77741-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:15 trial022 ceph-mon[39108]: osdmap e121: 4 total, 4 up, 4 in 2026-02-24T07:23:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:15 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1515262707' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial022-77741-3", "field": "max_bytes", "val": "4096"} : dispatch 2026-02-24T07:23:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:16 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1515262707' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial022-77741-3", "field": "max_bytes", "val": "4096"}]': finished 2026-02-24T07:23:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:16 trial022 ceph-mon[39108]: osdmap e122: 4 total, 4 up, 4 in 2026-02-24T07:23:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:16 trial022 ceph-mon[39108]: pgmap v158: 65 pgs: 32 unknown, 32 creating+peering, 1 active+clean; 577 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:23:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:18 trial022 ceph-mon[39108]: pgmap v159: 65 pgs: 65 active+clean; 585 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail; 1.4 KiB/s wr, 0 op/s 2026-02-24T07:23:20.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:19 trial022 ceph-mon[39108]: pool 'PoolQuotaPP_trial022-77741-3' is full (reached quota's max_bytes: 4 KiB) 2026-02-24T07:23:20.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:19 trial022 ceph-mon[39108]: Health check failed: 1 pool(s) full (POOL_FULL) 2026-02-24T07:23:20.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:19 trial022 ceph-mon[39108]: osdmap e123: 4 total, 4 up, 4 in 2026-02-24T07:23:21.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:20 trial022 ceph-mon[39108]: pgmap v161: 65 pgs: 65 active+clean; 585 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail; 1.3 KiB/s wr, 0 op/s 2026-02-24T07:23:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:23:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:23:20] "GET /metrics HTTP/1.1" 200 4435 "" "Prometheus/3.6.0" 2026-02-24T07:23:21.287 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:23:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:23:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:23:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:22 trial022 ceph-mon[39108]: pgmap v162: 65 pgs: 65 active+clean; 601 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s wr, 0 op/s 2026-02-24T07:23:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:23:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:23:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:23:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:23:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:23:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:24 trial022 ceph-mon[39108]: pgmap v163: 65 pgs: 65 active+clean; 601 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail; 2.8 KiB/s wr, 0 op/s 2026-02-24T07:23:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:26 trial022 ceph-mon[39108]: pgmap v164: 65 pgs: 65 active+clean; 601 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail; 2.4 KiB/s wr, 0 op/s 2026-02-24T07:23:27.877 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.PoolQuotaPP (17651 ms) 2026-02-24T07:23:27.877 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2026-02-24T07:23:28.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:27 trial022 ceph-mon[39108]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2026-02-24T07:23:28.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:27 trial022 ceph-mon[39108]: Cluster is now healthy 2026-02-24T07:23:28.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:27 trial022 ceph-mon[39108]: osdmap e124: 4 total, 4 up, 4 in 2026-02-24T07:23:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:28 trial022 ceph-mon[39108]: pgmap v166: 33 pgs: 33 active+clean; 577 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:28 trial022 ceph-mon[39108]: osdmap e125: 4 total, 4 up, 4 in 2026-02-24T07:23:30.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:29 trial022 ceph-mon[39108]: osdmap e126: 4 total, 4 up, 4 in 2026-02-24T07:23:30.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:29 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2061801631' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_trial022-77741-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:30 trial022 ceph-mon[39108]: pgmap v169: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 112 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:30 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2061801631' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_trial022-77741-4","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:30 trial022 ceph-mon[39108]: osdmap e127: 4 total, 4 up, 4 in 2026-02-24T07:23:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:23:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:23:30] "GET /metrics HTTP/1.1" 200 4435 "" "Prometheus/3.6.0" 2026-02-24T07:23:31.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:23:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:23:30.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:23:32.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:31 trial022 ceph-mon[39108]: osdmap e128: 4 total, 4 up, 4 in 2026-02-24T07:23:32.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:31 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:23:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:32 trial022 ceph-mon[39108]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:32 trial022 ceph-mon[39108]: osdmap e129: 4 total, 4 up, 4 in 2026-02-24T07:23:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:32 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2063678700' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleWritePP_trial022-77741-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:33.889 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.SimpleWritePP (6011 ms) 2026-02-24T07:23:33.889 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2026-02-24T07:23:34.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:33 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2063678700' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_trial022-77741-5","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:34.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:33 trial022 ceph-mon[39108]: osdmap e130: 4 total, 4 up, 4 in 2026-02-24T07:23:35.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:34 trial022 ceph-mon[39108]: pgmap v175: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 113 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:35.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:34 trial022 ceph-mon[39108]: osdmap e131: 4 total, 4 up, 4 in 2026-02-24T07:23:36.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:35 trial022 ceph-mon[39108]: osdmap e132: 4 total, 4 up, 4 in 2026-02-24T07:23:36.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:35 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3139399829' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafePP_trial022-77741-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:36.893 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.WaitForSafePP (3004 ms) 2026-02-24T07:23:36.893 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripPP 2026-02-24T07:23:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:36 trial022 ceph-mon[39108]: pgmap v178: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 113 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:36 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3139399829' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_trial022-77741-6","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:36 trial022 ceph-mon[39108]: osdmap e133: 4 total, 4 up, 4 in 2026-02-24T07:23:38.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:37 trial022 ceph-mon[39108]: osdmap e134: 4 total, 4 up, 4 in 2026-02-24T07:23:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:38 trial022 ceph-mon[39108]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:38 trial022 ceph-mon[39108]: osdmap e135: 4 total, 4 up, 4 in 2026-02-24T07:23:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:38 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3934186147' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP_trial022-77741-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:39.902 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripPP (3008 ms) 2026-02-24T07:23:39.902 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2026-02-24T07:23:40.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:39 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3934186147' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_trial022-77741-7","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:40.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:39 trial022 ceph-mon[39108]: osdmap e136: 4 total, 4 up, 4 in 2026-02-24T07:23:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:40 trial022 ceph-mon[39108]: pgmap v184: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 113 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:40 trial022 ceph-mon[39108]: osdmap e137: 4 total, 4 up, 4 in 2026-02-24T07:23:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:23:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:23:40] "GET /metrics HTTP/1.1" 200 3902 "" "Prometheus/3.6.0" 2026-02-24T07:23:41.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:23:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:23:40.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:23:42.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:41 trial022 ceph-mon[39108]: osdmap e138: 4 total, 4 up, 4 in 2026-02-24T07:23:42.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:41 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/772020170' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP2_trial022-77741-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:42.906 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3004 ms) 2026-02-24T07:23:42.907 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2026-02-24T07:23:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:42 trial022 ceph-mon[39108]: pgmap v187: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 113 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/772020170' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_trial022-77741-8","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:42 trial022 ceph-mon[39108]: osdmap e139: 4 total, 4 up, 4 in 2026-02-24T07:23:44.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:43 trial022 ceph-mon[39108]: osdmap e140: 4 total, 4 up, 4 in 2026-02-24T07:23:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:44 trial022 ceph-mon[39108]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:44 trial022 ceph-mon[39108]: osdmap e141: 4 total, 4 up, 4 in 2026-02-24T07:23:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:44 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/71113494' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripPP3_trial022-77741-9","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:45.914 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripPP3 (3007 ms) 2026-02-24T07:23:45.914 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2026-02-24T07:23:46.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:45 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/71113494' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_trial022-77741-9","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:46.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:45 trial022 ceph-mon[39108]: osdmap e142: 4 total, 4 up, 4 in 2026-02-24T07:23:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:46 trial022 ceph-mon[39108]: pgmap v193: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 113 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:46 trial022 ceph-mon[39108]: osdmap e143: 4 total, 4 up, 4 in 2026-02-24T07:23:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:46 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:23:48.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:47 trial022 ceph-mon[39108]: osdmap e144: 4 total, 4 up, 4 in 2026-02-24T07:23:48.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:47 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2189839565' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_trial022-77741-10","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:48.920 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3005 ms) 2026-02-24T07:23:48.920 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.IsCompletePP 2026-02-24T07:23:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:48 trial022 ceph-mon[39108]: pgmap v196: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 113 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:48 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2189839565' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_trial022-77741-10","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:48 trial022 ceph-mon[39108]: osdmap e145: 4 total, 4 up, 4 in 2026-02-24T07:23:50.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:49 trial022 ceph-mon[39108]: osdmap e146: 4 total, 4 up, 4 in 2026-02-24T07:23:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:50 trial022 ceph-mon[39108]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:50 trial022 ceph-mon[39108]: osdmap e147: 4 total, 4 up, 4 in 2026-02-24T07:23:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:50 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4087823055' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsCompletePP_trial022-77741-11","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:51.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:23:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:23:50] "GET /metrics HTTP/1.1" 200 3900 "" "Prometheus/3.6.0" 2026-02-24T07:23:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:23:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:23:50.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:23:51.927 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.IsCompletePP (3007 ms) 2026-02-24T07:23:51.927 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.IsSafePP 2026-02-24T07:23:52.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:51 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4087823055' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_trial022-77741-11","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:52.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:51 trial022 ceph-mon[39108]: osdmap e148: 4 total, 4 up, 4 in 2026-02-24T07:23:53.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:52 trial022 ceph-mon[39108]: pgmap v202: 33 pgs: 33 active+clean; 577 KiB data, 114 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2026-02-24T07:23:53.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:52 trial022 ceph-mon[39108]: osdmap e149: 4 total, 4 up, 4 in 2026-02-24T07:23:54.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:53 trial022 ceph-mon[39108]: osdmap e150: 4 total, 4 up, 4 in 2026-02-24T07:23:54.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:53 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/481755814' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "IsSafePP_trial022-77741-12","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:54.930 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.IsSafePP (3003 ms) 2026-02-24T07:23:54.930 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2026-02-24T07:23:55.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:54 trial022 ceph-mon[39108]: pgmap v205: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 114 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:55.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:54 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/481755814' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_trial022-77741-12","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:55.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:54 trial022 ceph-mon[39108]: osdmap e151: 4 total, 4 up, 4 in 2026-02-24T07:23:56.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:55 trial022 ceph-mon[39108]: osdmap e152: 4 total, 4 up, 4 in 2026-02-24T07:23:57.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:56 trial022 ceph-mon[39108]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 114 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:57.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:56 trial022 ceph-mon[39108]: osdmap e153: 4 total, 4 up, 4 in 2026-02-24T07:23:57.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:56 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2825730569' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReturnValuePP_trial022-77741-13","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:23:57.940 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.ReturnValuePP (3009 ms) 2026-02-24T07:23:57.940 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.FlushPP 2026-02-24T07:23:58.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:57 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2825730569' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_trial022-77741-13","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:23:58.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:57 trial022 ceph-mon[39108]: osdmap e154: 4 total, 4 up, 4 in 2026-02-24T07:23:59.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:58 trial022 ceph-mon[39108]: pgmap v211: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 114 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:23:59.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:58 trial022 ceph-mon[39108]: osdmap e155: 4 total, 4 up, 4 in 2026-02-24T07:24:00.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:59 trial022 ceph-mon[39108]: osdmap e156: 4 total, 4 up, 4 in 2026-02-24T07:24:00.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:23:59 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3517443906' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushPP_trial022-77741-14","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:00.946 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.FlushPP (3006 ms) 2026-02-24T07:24:00.947 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2026-02-24T07:24:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:00 trial022 ceph-mon[39108]: pgmap v214: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 114 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:00 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3517443906' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_trial022-77741-14","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:00 trial022 ceph-mon[39108]: osdmap e157: 4 total, 4 up, 4 in 2026-02-24T07:24:01.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:24:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:24:00] "GET /metrics HTTP/1.1" 200 3900 "" "Prometheus/3.6.0" 2026-02-24T07:24:01.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:24:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:24:00.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:24:02.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:01 trial022 ceph-mon[39108]: osdmap e158: 4 total, 4 up, 4 in 2026-02-24T07:24:02.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:01 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:24:03.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:02 trial022 ceph-mon[39108]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 114 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:03.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:02 trial022 ceph-mon[39108]: osdmap e159: 4 total, 4 up, 4 in 2026-02-24T07:24:03.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:02 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4199581128' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "FlushAsyncPP_trial022-77741-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:03.953 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3006 ms) 2026-02-24T07:24:03.953 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2026-02-24T07:24:04.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:03 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4199581128' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_trial022-77741-15","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:04.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:03 trial022 ceph-mon[39108]: osdmap e160: 4 total, 4 up, 4 in 2026-02-24T07:24:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:04 trial022 ceph-mon[39108]: pgmap v220: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 114 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:04 trial022 ceph-mon[39108]: osdmap e161: 4 total, 4 up, 4 in 2026-02-24T07:24:06.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:05 trial022 ceph-mon[39108]: osdmap e162: 4 total, 4 up, 4 in 2026-02-24T07:24:06.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:05 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2252294347' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_trial022-77741-16","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:06.958 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3005 ms) 2026-02-24T07:24:06.959 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2026-02-24T07:24:07.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:06 trial022 ceph-mon[39108]: pgmap v223: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 114 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:07.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:06 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2252294347' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_trial022-77741-16","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:07.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:06 trial022 ceph-mon[39108]: osdmap e163: 4 total, 4 up, 4 in 2026-02-24T07:24:08.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:07 trial022 ceph-mon[39108]: osdmap e164: 4 total, 4 up, 4 in 2026-02-24T07:24:09.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:08 trial022 ceph-mon[39108]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 114 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:09.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:08 trial022 ceph-mon[39108]: osdmap e165: 4 total, 4 up, 4 in 2026-02-24T07:24:09.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:08 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2475102050' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_trial022-77741-17","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:09.965 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3006 ms) 2026-02-24T07:24:09.966 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2026-02-24T07:24:10.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:09 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2475102050' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_trial022-77741-17","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:10.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:09 trial022 ceph-mon[39108]: osdmap e166: 4 total, 4 up, 4 in 2026-02-24T07:24:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:10 trial022 ceph-mon[39108]: pgmap v229: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 114 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:10 trial022 ceph-mon[39108]: osdmap e167: 4 total, 4 up, 4 in 2026-02-24T07:24:11.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:24:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:24:10] "GET /metrics HTTP/1.1" 200 3904 "" "Prometheus/3.6.0" 2026-02-24T07:24:11.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:24:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:24:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:24:12.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:11 trial022 ceph-mon[39108]: osdmap e168: 4 total, 4 up, 4 in 2026-02-24T07:24:12.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:11 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/76700360' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_trial022-77741-18","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:12.970 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3004 ms) 2026-02-24T07:24:12.970 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2026-02-24T07:24:13.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:12 trial022 ceph-mon[39108]: pgmap v232: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:13.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:12 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/76700360' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_trial022-77741-18","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:13.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:12 trial022 ceph-mon[39108]: osdmap e169: 4 total, 4 up, 4 in 2026-02-24T07:24:14.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:13 trial022 ceph-mon[39108]: osdmap e170: 4 total, 4 up, 4 in 2026-02-24T07:24:15.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:14 trial022 ceph-mon[39108]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:15.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:14 trial022 ceph-mon[39108]: osdmap e171: 4 total, 4 up, 4 in 2026-02-24T07:24:15.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:14 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2898795455' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_trial022-77741-19","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:15.977 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (3006 ms) 2026-02-24T07:24:15.977 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2026-02-24T07:24:16.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:15 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2898795455' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_trial022-77741-19","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:16.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:15 trial022 ceph-mon[39108]: osdmap e172: 4 total, 4 up, 4 in 2026-02-24T07:24:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:16 trial022 ceph-mon[39108]: pgmap v238: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:16 trial022 ceph-mon[39108]: osdmap e173: 4 total, 4 up, 4 in 2026-02-24T07:24:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:24:18.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:17 trial022 ceph-mon[39108]: osdmap e174: 4 total, 4 up, 4 in 2026-02-24T07:24:18.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:17 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1876854865' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPPNS_trial022-77741-20","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:18.983 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3006 ms) 2026-02-24T07:24:18.983 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2026-02-24T07:24:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:18 trial022 ceph-mon[39108]: pgmap v241: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:18 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1876854865' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_trial022-77741-20","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:18 trial022 ceph-mon[39108]: osdmap e175: 4 total, 4 up, 4 in 2026-02-24T07:24:20.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:19 trial022 ceph-mon[39108]: osdmap e176: 4 total, 4 up, 4 in 2026-02-24T07:24:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:20 trial022 ceph-mon[39108]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:20 trial022 ceph-mon[39108]: osdmap e177: 4 total, 4 up, 4 in 2026-02-24T07:24:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:20 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2895197170' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "SimpleStatPP_trial022-77741-21","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:24:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:24:20] "GET /metrics HTTP/1.1" 200 3912 "" "Prometheus/3.6.0" 2026-02-24T07:24:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:24:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:24:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:24:21.990 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.SimpleStatPP (3007 ms) 2026-02-24T07:24:21.991 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.OperateMtime 2026-02-24T07:24:22.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:21 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2895197170' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_trial022-77741-21","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:22.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:21 trial022 ceph-mon[39108]: osdmap e178: 4 total, 4 up, 4 in 2026-02-24T07:24:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:22 trial022 ceph-mon[39108]: pgmap v247: 33 pgs: 33 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 255 B/s wr, 0 op/s 2026-02-24T07:24:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:22 trial022 ceph-mon[39108]: osdmap e179: 4 total, 4 up, 4 in 2026-02-24T07:24:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:24:23.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:24:23.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:24:23.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:24:23.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:24:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:23 trial022 ceph-mon[39108]: osdmap e180: 4 total, 4 up, 4 in 2026-02-24T07:24:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:23 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/683333751' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime_trial022-77741-22","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:24.998 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.OperateMtime (3007 ms) 2026-02-24T07:24:24.998 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.OperateMtime2 2026-02-24T07:24:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:24 trial022 ceph-mon[39108]: pgmap v250: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:24 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/683333751' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_trial022-77741-22","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:24 trial022 ceph-mon[39108]: osdmap e181: 4 total, 4 up, 4 in 2026-02-24T07:24:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:25 trial022 ceph-mon[39108]: osdmap e182: 4 total, 4 up, 4 in 2026-02-24T07:24:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:26 trial022 ceph-mon[39108]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:26 trial022 ceph-mon[39108]: osdmap e183: 4 total, 4 up, 4 in 2026-02-24T07:24:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:26 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1442171694' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OperateMtime2_trial022-77741-23","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:28.005 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.OperateMtime2 (3007 ms) 2026-02-24T07:24:28.006 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.StatRemovePP 2026-02-24T07:24:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:28 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1442171694' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_trial022-77741-23","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:28 trial022 ceph-mon[39108]: osdmap e184: 4 total, 4 up, 4 in 2026-02-24T07:24:29.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:29 trial022 ceph-mon[39108]: pgmap v256: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:29.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:29 trial022 ceph-mon[39108]: osdmap e185: 4 total, 4 up, 4 in 2026-02-24T07:24:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:30 trial022 ceph-mon[39108]: osdmap e186: 4 total, 4 up, 4 in 2026-02-24T07:24:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:30 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4075006125' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "StatRemovePP_trial022-77741-24","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:31.011 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.StatRemovePP (3005 ms) 2026-02-24T07:24:31.011 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2026-02-24T07:24:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:31 trial022 ceph-mon[39108]: pgmap v259: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:31 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4075006125' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_trial022-77741-24","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:31 trial022 ceph-mon[39108]: osdmap e187: 4 total, 4 up, 4 in 2026-02-24T07:24:31.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:24:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:24:30] "GET /metrics HTTP/1.1" 200 3912 "" "Prometheus/3.6.0" 2026-02-24T07:24:31.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:24:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:24:30.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:24:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:32 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:24:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:32 trial022 ceph-mon[39108]: osdmap e188: 4 total, 4 up, 4 in 2026-02-24T07:24:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:33 trial022 ceph-mon[39108]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:33 trial022 ceph-mon[39108]: osdmap e189: 4 total, 4 up, 4 in 2026-02-24T07:24:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:33 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1621579658' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ExecuteClassPP_trial022-77741-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:34.018 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3007 ms) 2026-02-24T07:24:34.019 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.OmapPP 2026-02-24T07:24:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:34 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1621579658' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_trial022-77741-25","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:34 trial022 ceph-mon[39108]: osdmap e190: 4 total, 4 up, 4 in 2026-02-24T07:24:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:35 trial022 ceph-mon[39108]: pgmap v265: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:35 trial022 ceph-mon[39108]: osdmap e191: 4 total, 4 up, 4 in 2026-02-24T07:24:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:36 trial022 ceph-mon[39108]: osdmap e192: 4 total, 4 up, 4 in 2026-02-24T07:24:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:36 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/94370431' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "OmapPP_trial022-77741-26","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:37.025 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.OmapPP (3006 ms) 2026-02-24T07:24:37.025 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.MultiWritePP 2026-02-24T07:24:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:37 trial022 ceph-mon[39108]: pgmap v268: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 115 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:37 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/94370431' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_trial022-77741-26","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:37 trial022 ceph-mon[39108]: osdmap e193: 4 total, 4 up, 4 in 2026-02-24T07:24:38.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:38 trial022 ceph-mon[39108]: osdmap e194: 4 total, 4 up, 4 in 2026-02-24T07:24:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:39 trial022 ceph-mon[39108]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:39 trial022 ceph-mon[39108]: osdmap e195: 4 total, 4 up, 4 in 2026-02-24T07:24:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:39 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2354318357' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "MultiWritePP_trial022-77741-27","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:40.032 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.MultiWritePP (3007 ms) 2026-02-24T07:24:40.032 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2026-02-24T07:24:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:40 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2354318357' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_trial022-77741-27","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:40 trial022 ceph-mon[39108]: osdmap e196: 4 total, 4 up, 4 in 2026-02-24T07:24:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:41 trial022 ceph-mon[39108]: pgmap v274: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 116 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:41 trial022 ceph-mon[39108]: osdmap e197: 4 total, 4 up, 4 in 2026-02-24T07:24:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:24:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:24:40] "GET /metrics HTTP/1.1" 200 3977 "" "Prometheus/3.6.0" 2026-02-24T07:24:41.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:24:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:24:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:24:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:42 trial022 ceph-mon[39108]: osdmap e198: 4 total, 4 up, 4 in 2026-02-24T07:24:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1416738139' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "AioUnlockPP_trial022-77741-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:43.039 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.AioUnlockPP (3007 ms) 2026-02-24T07:24:43.039 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2026-02-24T07:24:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:43 trial022 ceph-mon[39108]: pgmap v277: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 116 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:43 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1416738139' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_trial022-77741-28","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:43 trial022 ceph-mon[39108]: osdmap e199: 4 total, 4 up, 4 in 2026-02-24T07:24:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:44 trial022 ceph-mon[39108]: osdmap e200: 4 total, 4 up, 4 in 2026-02-24T07:24:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:44 trial022 ceph-mon[39108]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:45 trial022 ceph-mon[39108]: osdmap e201: 4 total, 4 up, 4 in 2026-02-24T07:24:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:45 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1063876141' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripAppendPP_trial022-77741-29","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:46.044 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (3004 ms) 2026-02-24T07:24:46.044 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2026-02-24T07:24:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:46 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1063876141' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_trial022-77741-29","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:46 trial022 ceph-mon[39108]: osdmap e202: 4 total, 4 up, 4 in 2026-02-24T07:24:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:46 trial022 ceph-mon[39108]: pgmap v283: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 116 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:46 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:24:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:47 trial022 ceph-mon[39108]: osdmap e203: 4 total, 4 up, 4 in 2026-02-24T07:24:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:48 trial022 ceph-mon[39108]: osdmap e204: 4 total, 4 up, 4 in 2026-02-24T07:24:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:48 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2409047397' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RacingRemovePP_trial022-77741-30","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:48 trial022 ceph-mon[39108]: pgmap v286: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 116 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:49.052 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RacingRemovePP (3008 ms) 2026-02-24T07:24:49.052 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2026-02-24T07:24:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:49 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2409047397' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_trial022-77741-30","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:49 trial022 ceph-mon[39108]: osdmap e205: 4 total, 4 up, 4 in 2026-02-24T07:24:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:50 trial022 ceph-mon[39108]: osdmap e206: 4 total, 4 up, 4 in 2026-02-24T07:24:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:50 trial022 ceph-mon[39108]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:51 trial022 ceph-mon[39108]: osdmap e207: 4 total, 4 up, 4 in 2026-02-24T07:24:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:51 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/463956290' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_trial022-77741-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:51.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:24:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:24:50] "GET /metrics HTTP/1.1" 200 4193 "" "Prometheus/3.6.0" 2026-02-24T07:24:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:24:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:24:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:24:52.059 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3006 ms) 2026-02-24T07:24:52.059 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2026-02-24T07:24:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:52 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/463956290' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_trial022-77741-31","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:52 trial022 ceph-mon[39108]: osdmap e208: 4 total, 4 up, 4 in 2026-02-24T07:24:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:52 trial022 ceph-mon[39108]: pgmap v292: 33 pgs: 33 active+clean; 577 KiB data, 116 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2026-02-24T07:24:53.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:53 trial022 ceph-mon[39108]: osdmap e209: 4 total, 4 up, 4 in 2026-02-24T07:24:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:54 trial022 ceph-mon[39108]: osdmap e210: 4 total, 4 up, 4 in 2026-02-24T07:24:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:54 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3803753967' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_trial022-77741-32","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:54 trial022 ceph-mon[39108]: pgmap v295: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 116 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:55.066 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3007 ms) 2026-02-24T07:24:55.066 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2026-02-24T07:24:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:55 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3803753967' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_trial022-77741-32","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:55 trial022 ceph-mon[39108]: osdmap e211: 4 total, 4 up, 4 in 2026-02-24T07:24:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:56 trial022 ceph-mon[39108]: osdmap e212: 4 total, 4 up, 4 in 2026-02-24T07:24:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:56 trial022 ceph-mon[39108]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:57.391 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:57 trial022 ceph-mon[39108]: osdmap e213: 4 total, 4 up, 4 in 2026-02-24T07:24:57.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:57 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/221660784' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolEIOFlag_trial022-77741-33","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:24:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:58 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/221660784' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_trial022-77741-33","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:24:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:58 trial022 ceph-mon[39108]: osdmap e214: 4 total, 4 up, 4 in 2026-02-24T07:24:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:58 trial022 ceph-mon[39108]: pgmap v301: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:24:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:24:59 trial022 ceph-mon[39108]: osdmap e215: 4 total, 4 up, 4 in 2026-02-24T07:25:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:00 trial022 ceph-mon[39108]: pgmap v303: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:01 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:25:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:25:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:25:00] "GET /metrics HTTP/1.1" 200 4193 "" "Prometheus/3.6.0" 2026-02-24T07:25:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:25:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:25:00.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:25:02.094 INFO:tasks.workunit.client.0.trial022.stdout:sending pool EIO time: 2026-02-24T07:25:02.093295+0000 2026-02-24T07:25:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:02 trial022 ceph-mon[39108]: pgmap v304: 33 pgs: 33 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail; 79 KiB/s wr, 78 op/s 2026-02-24T07:25:03.101 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:2430: Skipped 2026-02-24T07:25:03.101 INFO:tasks.workunit.client.0.trial022.stdout:eio flag missed all ios that already completed 2026-02-24T07:25:03.101 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:03 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/221660784' entity='client.admin' cmd={ 2026-02-24T07:25:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:03 trial022 ceph-mon[39108]: "prefix": "osd pool set", 2026-02-24T07:25:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:03 trial022 ceph-mon[39108]: "pool": "PoolEIOFlag_trial022-77741-33", 2026-02-24T07:25:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:03 trial022 ceph-mon[39108]: "var": "eio", 2026-02-24T07:25:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:03 trial022 ceph-mon[39108]: "val": "true" 2026-02-24T07:25:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:03 trial022 ceph-mon[39108]: } : dispatch 2026-02-24T07:25:04.082 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAio.PoolEIOFlag (9015 ms) 2026-02-24T07:25:04.082 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio.MultiReads 2026-02-24T07:25:04.083 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:2439: Skipped 2026-02-24T07:25:04.083 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:04.083 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:04.083 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2026-02-24T07:25:04.083 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 32 tests from LibRadosAio (116847 ms total) 2026-02-24T07:25:04.083 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:04.083 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosAioPP 2026-02-24T07:25:04.083 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2026-02-24T07:25:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:04 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/221660784' entity='client.admin' cmd='[{ 2026-02-24T07:25:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:04 trial022 ceph-mon[39108]: "prefix": "osd pool set", 2026-02-24T07:25:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:04 trial022 ceph-mon[39108]: "pool": "PoolEIOFlag_trial022-77741-33", 2026-02-24T07:25:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:04 trial022 ceph-mon[39108]: "var": "eio", 2026-02-24T07:25:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:04 trial022 ceph-mon[39108]: "val": "true" 2026-02-24T07:25:04.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:04 trial022 ceph-mon[39108]: }]': finished 2026-02-24T07:25:04.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:04 trial022 ceph-mon[39108]: osdmap e216: 4 total, 4 up, 4 in 2026-02-24T07:25:04.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:04 trial022 ceph-mon[39108]: pgmap v306: 33 pgs: 33 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail; 70 KiB/s wr, 69 op/s 2026-02-24T07:25:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:05 trial022 ceph-mon[39108]: osdmap e217: 4 total, 4 up, 4 in 2026-02-24T07:25:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:06 trial022 ceph-mon[39108]: osdmap e218: 4 total, 4 up, 4 in 2026-02-24T07:25:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:06 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2671659674' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_trial022-77741-34","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:06 trial022 ceph-mon[39108]: pgmap v309: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:07.087 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (3005 ms) 2026-02-24T07:25:07.087 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2026-02-24T07:25:07.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:07 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2671659674' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_trial022-77741-34","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:07.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:07 trial022 ceph-mon[39108]: osdmap e219: 4 total, 4 up, 4 in 2026-02-24T07:25:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:08 trial022 ceph-mon[39108]: osdmap e220: 4 total, 4 up, 4 in 2026-02-24T07:25:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:08 trial022 ceph-mon[39108]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:09 trial022 ceph-mon[39108]: osdmap e221: 4 total, 4 up, 4 in 2026-02-24T07:25:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:09 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1372229197' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_trial022-77741-35","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:10 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1372229197' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_trial022-77741-35","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:10 trial022 ceph-mon[39108]: osdmap e222: 4 total, 4 up, 4 in 2026-02-24T07:25:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:10 trial022 ceph-mon[39108]: pgmap v315: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:11 trial022 ceph-mon[39108]: osdmap e223: 4 total, 4 up, 4 in 2026-02-24T07:25:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:11 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1176375770' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_trial022-77741-36","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:25:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:25:10] "GET /metrics HTTP/1.1" 200 4179 "" "Prometheus/3.6.0" 2026-02-24T07:25:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:25:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:25:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:25:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:12 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1176375770' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_trial022-77741-36","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:12 trial022 ceph-mon[39108]: osdmap e224: 4 total, 4 up, 4 in 2026-02-24T07:25:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:12 trial022 ceph-mon[39108]: pgmap v318: 65 pgs: 65 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:25:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:13 trial022 ceph-mon[39108]: osdmap e225: 4 total, 4 up, 4 in 2026-02-24T07:25:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:13 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/484663217' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_trial022-77741-37","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:14 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/484663217' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_trial022-77741-37","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:14 trial022 ceph-mon[39108]: osdmap e226: 4 total, 4 up, 4 in 2026-02-24T07:25:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:14 trial022 ceph-mon[39108]: pgmap v321: 97 pgs: 32 unknown, 65 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:25:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:15 trial022 ceph-mon[39108]: osdmap e227: 4 total, 4 up, 4 in 2026-02-24T07:25:16.108 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (9020 ms) 2026-02-24T07:25:16.108 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2026-02-24T07:25:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:16 trial022 ceph-mon[39108]: osdmap e228: 4 total, 4 up, 4 in 2026-02-24T07:25:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:16 trial022 ceph-mon[39108]: pgmap v324: 33 pgs: 33 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:25:17.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:17 trial022 ceph-mon[39108]: osdmap e229: 4 total, 4 up, 4 in 2026-02-24T07:25:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:18 trial022 ceph-mon[39108]: osdmap e230: 4 total, 4 up, 4 in 2026-02-24T07:25:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:18 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/961821046' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_trial022-77741-38","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:18 trial022 ceph-mon[39108]: pgmap v327: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:19.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:19 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/961821046' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_trial022-77741-38","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:19.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:19 trial022 ceph-mon[39108]: osdmap e231: 4 total, 4 up, 4 in 2026-02-24T07:25:20.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:20 trial022 ceph-mon[39108]: osdmap e232: 4 total, 4 up, 4 in 2026-02-24T07:25:20.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:20 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3553570221' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_trial022-77741-39","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:20.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:20 trial022 ceph-mon[39108]: pgmap v330: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 117 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:21 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3553570221' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_trial022-77741-39","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:21 trial022 ceph-mon[39108]: osdmap e233: 4 total, 4 up, 4 in 2026-02-24T07:25:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:25:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:25:20] "GET /metrics HTTP/1.1" 200 4230 "" "Prometheus/3.6.0" 2026-02-24T07:25:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:25:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:25:20.954Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:25:22.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:22 trial022 ceph-mon[39108]: osdmap e234: 4 total, 4 up, 4 in 2026-02-24T07:25:22.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:22 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3472863096' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_trial022-77741-40","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:22.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:22 trial022 ceph-mon[39108]: pgmap v333: 97 pgs: 32 creating+peering, 65 active+clean; 577 KiB data, 118 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:25:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:23 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3472863096' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_trial022-77741-40","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:23 trial022 ceph-mon[39108]: osdmap e235: 4 total, 4 up, 4 in 2026-02-24T07:25:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:25:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:25:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:25:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:25:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:25:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:24 trial022 ceph-mon[39108]: osdmap e236: 4 total, 4 up, 4 in 2026-02-24T07:25:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:24 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3102308407' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_trial022-77741-41","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:24 trial022 ceph-mon[39108]: pgmap v336: 129 pgs: 32 unknown, 32 creating+peering, 65 active+clean; 577 KiB data, 118 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:25:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:25 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3102308407' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_trial022-77741-41","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:25 trial022 ceph-mon[39108]: osdmap e237: 4 total, 4 up, 4 in 2026-02-24T07:25:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:26 trial022 ceph-mon[39108]: osdmap e238: 4 total, 4 up, 4 in 2026-02-24T07:25:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:26 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2755376782' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RmXattrPP_trial022-77741-42","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:26 trial022 ceph-mon[39108]: pgmap v339: 161 pgs: 64 unknown, 32 creating+peering, 65 active+clean; 577 KiB data, 118 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:27 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2755376782' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_trial022-77741-42","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:27.393 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:27 trial022 ceph-mon[39108]: osdmap e239: 4 total, 4 up, 4 in 2026-02-24T07:25:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:28 trial022 ceph-mon[39108]: osdmap e240: 4 total, 4 up, 4 in 2026-02-24T07:25:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:28 trial022 ceph-mon[39108]: pgmap v342: 129 pgs: 129 active+clean; 577 KiB data, 118 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:25:29.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:29 trial022 ceph-mon[39108]: osdmap e241: 4 total, 4 up, 4 in 2026-02-24T07:25:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:30 trial022 ceph-mon[39108]: osdmap e242: 4 total, 4 up, 4 in 2026-02-24T07:25:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:30 trial022 ceph-mon[39108]: pgmap v345: 65 pgs: 65 active+clean; 577 KiB data, 118 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:25:31.143 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAioPP.RmXattrPP (15035 ms) 2026-02-24T07:25:31.143 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2026-02-24T07:25:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:31 trial022 ceph-mon[39108]: osdmap e243: 4 total, 4 up, 4 in 2026-02-24T07:25:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:31 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:25:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:25:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:25:30] "GET /metrics HTTP/1.1" 200 4230 "" "Prometheus/3.6.0" 2026-02-24T07:25:31.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:25:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:25:30.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:25:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:32 trial022 ceph-mon[39108]: osdmap e244: 4 total, 4 up, 4 in 2026-02-24T07:25:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:32 trial022 ceph-mon[39108]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:33 trial022 ceph-mon[39108]: osdmap e245: 4 total, 4 up, 4 in 2026-02-24T07:25:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:33 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3854731084' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RemoveTestPP_trial022-77741-43","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:34.151 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3008 ms) 2026-02-24T07:25:34.151 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosAioPP (30069 ms total) 2026-02-24T07:25:34.151 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:34.152 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosIoPP 2026-02-24T07:25:34.152 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2026-02-24T07:25:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:34 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3854731084' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_trial022-77741-43","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:34 trial022 ceph-mon[39108]: osdmap e246: 4 total, 4 up, 4 in 2026-02-24T07:25:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:34 trial022 ceph-mon[39108]: pgmap v351: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 118 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:35 trial022 ceph-mon[39108]: osdmap e247: 4 total, 4 up, 4 in 2026-02-24T07:25:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:36 trial022 ceph-mon[39108]: osdmap e248: 4 total, 4 up, 4 in 2026-02-24T07:25:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:36 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/286739289' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "XattrListPP_trial022-77741-44","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:36 trial022 ceph-mon[39108]: pgmap v354: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 118 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:37.161 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.XattrListPP (3008 ms) 2026-02-24T07:25:37.162 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosIoPP (3008 ms total) 2026-02-24T07:25:37.162 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.162 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 20 tests from LibRadosAioEC 2026-02-24T07:25:37.162 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2026-02-24T07:25:37.162 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1388: Skipped 2026-02-24T07:25:37.162 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.162 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.162 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2026-02-24T07:25:37.162 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1423: Skipped 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1440: Skipped 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2026-02-24T07:25:37.163 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1471: Skipped 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1504: Skipped 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1609: Skipped 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.164 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1641: Skipped 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1709: Skipped 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2026-02-24T07:25:37.165 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1746: Skipped 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1784: Skipped 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.FlushPP 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1800: Skipped 2026-02-24T07:25:37.166 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1828: Skipped 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1863: Skipped 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.167 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1908: Skipped 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1950: Skipped 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2026-02-24T07:25:37.168 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:1981: Skipped 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:2012: Skipped 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:2063: Skipped 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.OmapPP 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:2093: Skipped 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/aio_cxx.cc:2128: Skipped 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2026-02-24T07:25:37.170 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:37.171 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 6 tests from LibRadosAio/Cancel 2026-02-24T07:25:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:37 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/286739289' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_trial022-77741-44","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:37 trial022 ceph-mon[39108]: osdmap e249: 4 total, 4 up, 4 in 2026-02-24T07:25:38.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:38 trial022 ceph-mon[39108]: osdmap e250: 4 total, 4 up, 4 in 2026-02-24T07:25:38.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:38 trial022 ceph-mon[39108]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 118 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:39.165 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel 2026-02-24T07:25:39.165 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel (0 ms) 2026-02-24T07:25:39.166 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio/Cancel.BeforeSubmit/cancel 2026-02-24T07:25:39.166 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio/Cancel.BeforeSubmit/cancel (0 ms) 2026-02-24T07:25:39.166 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio/Cancel.BeforeComplete/aio_cancel 2026-02-24T07:25:39.166 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio/Cancel.BeforeComplete/aio_cancel (0 ms) 2026-02-24T07:25:39.166 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio/Cancel.BeforeComplete/cancel 2026-02-24T07:25:39.166 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio/Cancel.BeforeComplete/cancel (0 ms) 2026-02-24T07:25:39.166 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio/Cancel.AfterComplete/aio_cancel 2026-02-24T07:25:39.170 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio/Cancel.AfterComplete/aio_cancel (4 ms) 2026-02-24T07:25:39.170 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosAio/Cancel.AfterComplete/cancel 2026-02-24T07:25:39.170 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosAio/Cancel.AfterComplete/cancel (0 ms) 2026-02-24T07:25:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:39 trial022 ceph-mon[39108]: osdmap e251: 4 total, 4 up, 4 in 2026-02-24T07:25:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:39 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3740829376' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "ceph_test_rados_api_pptrial022-77741-45","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:40.167 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 6 tests from LibRadosAio/Cancel (5 ms total) 2026-02-24T07:25:40.168 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:40.168 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:25:40.168 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 63 tests from 5 test suites ran. (152933 ms total) 2026-02-24T07:25:40.168 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 41 tests. 2026-02-24T07:25:40.168 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 22 tests, listed below: 2026-02-24T07:25:40.168 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAio.PoolEIOFlag 2026-02-24T07:25:40.168 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2026-02-24T07:25:40.168 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2026-02-24T07:25:40.168 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2026-02-24T07:25:40.168 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2026-02-24T07:25:40.169 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2026-02-24T07:25:40.170 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2026-02-24T07:25:40.170 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2026-02-24T07:25:40.170 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2026-02-24T07:25:40.170 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2026-02-24T07:25:40.171 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:25:40.171 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_io 2026-02-24T07:25:40.171 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:40.171 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:40.171 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_io 2026-02-24T07:25:40.185 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:25:40.185 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 24 tests from 2 test suites. 2026-02-24T07:25:40.185 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:25:40.185 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 14 tests from LibRadosIo 2026-02-24T07:25:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:40 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3740829376' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ceph_test_rados_api_pptrial022-77741-45","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:40 trial022 ceph-mon[39108]: osdmap e252: 4 total, 4 up, 4 in 2026-02-24T07:25:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:40 trial022 ceph-mon[39108]: pgmap v360: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 118 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:41 trial022 ceph-mon[39108]: osdmap e253: 4 total, 4 up, 4 in 2026-02-24T07:25:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:25:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:25:40] "GET /metrics HTTP/1.1" 200 4228 "" "Prometheus/3.6.0" 2026-02-24T07:25:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:25:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:25:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:25:42.173 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.SimpleWrite 2026-02-24T07:25:42.184 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.SimpleWrite (10 ms) 2026-02-24T07:25:42.184 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.TooBig 2026-02-24T07:25:42.184 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2026-02-24T07:25:42.184 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.ReadTimeout 2026-02-24T07:25:42.199 INFO:tasks.workunit.client.0.trial022.stdout:no timeout :/ 2026-02-24T07:25:42.199 INFO:tasks.workunit.client.0.trial022.stdout:no timeout :/ 2026-02-24T07:25:42.199 INFO:tasks.workunit.client.0.trial022.stdout:no timeout :/ 2026-02-24T07:25:42.199 INFO:tasks.workunit.client.0.trial022.stdout:no timeout :/ 2026-02-24T07:25:42.200 INFO:tasks.workunit.client.0.trial022.stdout:no timeout :/ 2026-02-24T07:25:42.200 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.ReadTimeout (15 ms) 2026-02-24T07:25:42.200 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.RoundTrip 2026-02-24T07:25:42.201 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.RoundTrip (2 ms) 2026-02-24T07:25:42.201 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.Checksum 2026-02-24T07:25:42.203 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.Checksum (1 ms) 2026-02-24T07:25:42.203 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2026-02-24T07:25:42.204 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (1 ms) 2026-02-24T07:25:42.204 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2026-02-24T07:25:42.206 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (1 ms) 2026-02-24T07:25:42.206 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2026-02-24T07:25:42.208 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.AppendRoundTrip (1 ms) 2026-02-24T07:25:42.208 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2026-02-24T07:25:42.208 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.ZeroLenZero (0 ms) 2026-02-24T07:25:42.208 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.TruncTest 2026-02-24T07:25:42.210 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.TruncTest (1 ms) 2026-02-24T07:25:42.210 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.RemoveTest 2026-02-24T07:25:42.211 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.RemoveTest (1 ms) 2026-02-24T07:25:42.212 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2026-02-24T07:25:42.213 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (1 ms) 2026-02-24T07:25:42.213 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.RmXattr 2026-02-24T07:25:42.218 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.RmXattr (4 ms) 2026-02-24T07:25:42.218 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIo.XattrIter 2026-02-24T07:25:42.220 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIo.XattrIter (1 ms) 2026-02-24T07:25:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:42 trial022 ceph-mon[39108]: osdmap e254: 4 total, 4 up, 4 in 2026-02-24T07:25:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2456945459' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIo_trial022-78812-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:42 trial022 ceph-mon[39108]: pgmap v363: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 119 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:43.177 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 14 tests from LibRadosIo (47 ms total) 2026-02-24T07:25:43.177 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.177 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 10 tests from LibRadosIoEC 2026-02-24T07:25:43.177 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:168: Skipped 2026-02-24T07:25:43.177 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:43.177 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.177 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io.cc:272: Skipped 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io.cc:281: Skipped 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io.cc:295: Skipped 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2026-02-24T07:25:43.178 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io.cc:318: Skipped 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io.cc:332: Skipped 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoEC.TruncTest 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io.cc:359: Skipped 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2026-02-24T07:25:43.179 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io.cc:373: Skipped 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io.cc:384: Skipped 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoEC.RmXattr 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io.cc:398: Skipped 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2026-02-24T07:25:43.180 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoEC.XattrIter 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io.cc:422: Skipped 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:176: Skipped 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 24 tests from 2 test suites ran. (2990 ms total) 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 14 tests. 2026-02-24T07:25:43.181 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 10 tests, listed below: 2026-02-24T07:25:43.182 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2026-02-24T07:25:43.182 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2026-02-24T07:25:43.182 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-24T07:25:43.182 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2026-02-24T07:25:43.182 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2026-02-24T07:25:43.182 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2026-02-24T07:25:43.182 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2026-02-24T07:25:43.182 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2026-02-24T07:25:43.182 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2026-02-24T07:25:43.182 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2026-02-24T07:25:43.183 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:25:43.183 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_io_pp 2026-02-24T07:25:43.183 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:43.183 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:43.184 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_io_pp 2026-02-24T07:25:43.193 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:25:43.193 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 40 tests from 2 test suites. 2026-02-24T07:25:43.193 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:25:43.194 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 22 tests from LibRadosIoPP 2026-02-24T07:25:43.194 INFO:tasks.workunit.client.0.trial022.stdout:seed 78846 2026-02-24T07:25:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:43 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2456945459' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_trial022-78812-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:43 trial022 ceph-mon[39108]: osdmap e255: 4 total, 4 up, 4 in 2026-02-24T07:25:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:44 trial022 ceph-mon[39108]: osdmap e256: 4 total, 4 up, 4 in 2026-02-24T07:25:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:44 trial022 ceph-mon[39108]: pgmap v366: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:45.182 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2026-02-24T07:25:45.182 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2026-02-24T07:25:45.182 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2026-02-24T07:25:45.190 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (8 ms) 2026-02-24T07:25:45.191 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2026-02-24T07:25:45.193 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.ReadOpPP (3 ms) 2026-02-24T07:25:45.194 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2026-02-24T07:25:45.195 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (1 ms) 2026-02-24T07:25:45.195 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2026-02-24T07:25:45.321 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (126 ms) 2026-02-24T07:25:45.322 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2026-02-24T07:25:45.322 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.RoundTripPP (1 ms) 2026-02-24T07:25:45.323 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2026-02-24T07:25:45.323 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (0 ms) 2026-02-24T07:25:45.323 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.Checksum 2026-02-24T07:25:45.325 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.Checksum (1 ms) 2026-02-24T07:25:45.325 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2026-02-24T07:25:45.326 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (0 ms) 2026-02-24T07:25:45.326 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2026-02-24T07:25:45.327 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (1 ms) 2026-02-24T07:25:45.327 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2026-02-24T07:25:45.329 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (1 ms) 2026-02-24T07:25:45.329 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2026-02-24T07:25:45.330 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (1 ms) 2026-02-24T07:25:45.331 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2026-02-24T07:25:45.332 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (1 ms) 2026-02-24T07:25:45.332 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2026-02-24T07:25:45.334 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.TruncTestPP (1 ms) 2026-02-24T07:25:45.334 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2026-02-24T07:25:45.335 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (1 ms) 2026-02-24T07:25:45.335 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2026-02-24T07:25:45.337 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (1 ms) 2026-02-24T07:25:45.337 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2026-02-24T07:25:45.342 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.RmXattrPP (4 ms) 2026-02-24T07:25:45.342 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2026-02-24T07:25:45.344 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.XattrListPP (2 ms) 2026-02-24T07:25:45.344 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.CrcZeroWrite 2026-02-24T07:25:45.346 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.CrcZeroWrite (1 ms) 2026-02-24T07:25:45.346 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2026-02-24T07:25:45.348 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.CmpExtPP (1 ms) 2026-02-24T07:25:45.348 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2026-02-24T07:25:45.349 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (0 ms) 2026-02-24T07:25:45.349 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2026-02-24T07:25:45.350 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (1 ms) 2026-02-24T07:25:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:45 trial022 ceph-mon[39108]: osdmap e257: 4 total, 4 up, 4 in 2026-02-24T07:25:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:45 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1964399548' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosIoPP_trial022-78846-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:46.186 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 22 tests from LibRadosIoPP (168 ms total) 2026-02-24T07:25:46.187 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.187 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 18 tests from LibRadosIoECPP 2026-02-24T07:25:46.187 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:371: Skipped 2026-02-24T07:25:46.187 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:46.187 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.187 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2026-02-24T07:25:46.187 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:510: Skipped 2026-02-24T07:25:46.187 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.187 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:521: Skipped 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:668: Skipped 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:688: Skipped 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.188 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:701: Skipped 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:718: Skipped 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:743: Skipped 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.189 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:760: Skipped 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:777: Skipped 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:802: Skipped 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.190 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:817: Skipped 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:829: Skipped 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:849: Skipped 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.191 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.CrcZeroWrite 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:880: Skipped 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite (0 ms) 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:896: Skipped 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:989: Skipped 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.192 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:1010: Skipped 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/io_cxx.cc:1028: Skipped 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:379: Skipped 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 18 tests from LibRadosIoECPP (0 ms total) 2026-02-24T07:25:46.193 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 40 tests from 2 test suites ran. (2990 ms total) 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 22 tests. 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 18 tests, listed below: 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-24T07:25:46.194 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-24T07:25:46.195 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2026-02-24T07:25:46.195 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2026-02-24T07:25:46.195 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2026-02-24T07:25:46.195 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-24T07:25:46.195 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2026-02-24T07:25:46.195 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite 2026-02-24T07:25:46.195 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2026-02-24T07:25:46.195 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2026-02-24T07:25:46.195 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2026-02-24T07:25:46.195 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-24T07:25:46.196 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:25:46.196 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_asio 2026-02-24T07:25:46.196 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:46.196 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:46.196 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_asio 2026-02-24T07:25:46.209 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 29 tests from 1 test suite. 2026-02-24T07:25:46.209 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:25:46.209 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 29 tests from AsioRados 2026-02-24T07:25:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:46 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1964399548' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_trial022-78846-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:46 trial022 ceph-mon[39108]: osdmap e258: 4 total, 4 up, 4 in 2026-02-24T07:25:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:46 trial022 ceph-mon[39108]: pgmap v369: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 119 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:46 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:25:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:47 trial022 ceph-mon[39108]: osdmap e259: 4 total, 4 up, 4 in 2026-02-24T07:25:48.198 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadCallback 2026-02-24T07:25:48.199 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadCallback (0 ms) 2026-02-24T07:25:48.199 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadDeferred 2026-02-24T07:25:48.199 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadDeferred (0 ms) 2026-02-24T07:25:48.199 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadFuture 2026-02-24T07:25:48.199 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadFuture (0 ms) 2026-02-24T07:25:48.199 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadYield 2026-02-24T07:25:48.200 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadYield (0 ms) 2026-02-24T07:25:48.200 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadAwaitable 2026-02-24T07:25:48.200 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadAwaitable (0 ms) 2026-02-24T07:25:48.200 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2026-02-24T07:25:48.200 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteCallback (0 ms) 2026-02-24T07:25:48.200 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteDeferred 2026-02-24T07:25:48.201 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteDeferred (0 ms) 2026-02-24T07:25:48.201 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2026-02-24T07:25:48.202 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteFuture (1 ms) 2026-02-24T07:25:48.202 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteYield 2026-02-24T07:25:48.202 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteYield (0 ms) 2026-02-24T07:25:48.202 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteAwaitable 2026-02-24T07:25:48.203 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteAwaitable (0 ms) 2026-02-24T07:25:48.203 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2026-02-24T07:25:48.204 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2026-02-24T07:25:48.204 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadOperationDeferred 2026-02-24T07:25:48.204 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadOperationDeferred (0 ms) 2026-02-24T07:25:48.204 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2026-02-24T07:25:48.204 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (0 ms) 2026-02-24T07:25:48.204 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2026-02-24T07:25:48.204 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2026-02-24T07:25:48.204 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadOperationAwaitable 2026-02-24T07:25:48.205 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadOperationAwaitable (0 ms) 2026-02-24T07:25:48.205 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2026-02-24T07:25:48.205 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (0 ms) 2026-02-24T07:25:48.205 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteOperationDeferred 2026-02-24T07:25:48.206 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteOperationDeferred (0 ms) 2026-02-24T07:25:48.206 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2026-02-24T07:25:48.206 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (0 ms) 2026-02-24T07:25:48.206 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2026-02-24T07:25:48.206 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (0 ms) 2026-02-24T07:25:48.206 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteOperationAwaitable 2026-02-24T07:25:48.207 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteOperationAwaitable (0 ms) 2026-02-24T07:25:48.207 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncNotifyCallback 2026-02-24T07:25:48.207 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncNotifyCallback (0 ms) 2026-02-24T07:25:48.208 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncNotifyDeferred 2026-02-24T07:25:48.208 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncNotifyDeferred (0 ms) 2026-02-24T07:25:48.208 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncNotifyFuture 2026-02-24T07:25:48.208 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncNotifyFuture (0 ms) 2026-02-24T07:25:48.208 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncNotifyYield 2026-02-24T07:25:48.209 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncNotifyYield (0 ms) 2026-02-24T07:25:48.209 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncNotifyAwaitable 2026-02-24T07:25:48.209 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncNotifyAwaitable (0 ms) 2026-02-24T07:25:48.209 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadOperationCancelTerminal 2026-02-24T07:25:48.209 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadOperationCancelTerminal (0 ms) 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncReadOperationCancelTotal 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncReadOperationCancelTotal (0 ms) 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteOperationCancelTerminal 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteOperationCancelTerminal (0 ms) 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] AsioRados.AsyncWriteOperationCancelTotal 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] AsioRados.AsyncWriteOperationCancelTotal (0 ms) 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 29 tests from AsioRados (10 ms total) 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 29 tests from 1 test suite ran. (1999 ms total) 2026-02-24T07:25:48.210 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 29 tests. 2026-02-24T07:25:48.211 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:25:48.211 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_list 2026-02-24T07:25:48.211 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:48.211 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:48.211 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_list 2026-02-24T07:25:48.230 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 11 tests from 3 test suites. 2026-02-24T07:25:48.231 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:25:48.231 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 7 tests from LibRadosList 2026-02-24T07:25:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:48 trial022 ceph-mon[39108]: osdmap e260: 4 total, 4 up, 4 in 2026-02-24T07:25:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:48 trial022 ceph-mon[39108]: pgmap v372: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 137 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:49 trial022 ceph-mon[39108]: osdmap e261: 4 total, 4 up, 4 in 2026-02-24T07:25:50.198 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosList.ListObjects 2026-02-24T07:25:50.218 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosList.ListObjects (19 ms) 2026-02-24T07:25:50.218 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2026-02-24T07:25:50.229 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (10 ms) 2026-02-24T07:25:50.229 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosList.ListObjectsNS 2026-02-24T07:25:50.234 INFO:tasks.workunit.client.0.trial022.stdout:myset foo1,foo2,foo3 2026-02-24T07:25:50.239 INFO:tasks.workunit.client.0.trial022.stdout:foo1 2026-02-24T07:25:50.239 INFO:tasks.workunit.client.0.trial022.stdout:foo2 2026-02-24T07:25:50.239 INFO:tasks.workunit.client.0.trial022.stdout:foo3 2026-02-24T07:25:50.239 INFO:tasks.workunit.client.0.trial022.stdout:myset foo1,foo4,foo5 2026-02-24T07:25:50.244 INFO:tasks.workunit.client.0.trial022.stdout:foo4 2026-02-24T07:25:50.244 INFO:tasks.workunit.client.0.trial022.stdout:foo5 2026-02-24T07:25:50.244 INFO:tasks.workunit.client.0.trial022.stdout:foo1 2026-02-24T07:25:50.244 INFO:tasks.workunit.client.0.trial022.stdout:myset foo6,foo7 2026-02-24T07:25:50.249 INFO:tasks.workunit.client.0.trial022.stdout:foo7 2026-02-24T07:25:50.249 INFO:tasks.workunit.client.0.trial022.stdout:foo6 2026-02-24T07:25:50.249 INFO:tasks.workunit.client.0.trial022.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-24T07:25:50.254 INFO:tasks.workunit.client.0.trial022.stdout:ns1:foo4 2026-02-24T07:25:50.254 INFO:tasks.workunit.client.0.trial022.stdout:ns1:foo5 2026-02-24T07:25:50.254 INFO:tasks.workunit.client.0.trial022.stdout:ns2:foo7 2026-02-24T07:25:50.254 INFO:tasks.workunit.client.0.trial022.stdout:ns2:foo6 2026-02-24T07:25:50.254 INFO:tasks.workunit.client.0.trial022.stdout:ns1:foo1 2026-02-24T07:25:50.254 INFO:tasks.workunit.client.0.trial022.stdout::foo1 2026-02-24T07:25:50.254 INFO:tasks.workunit.client.0.trial022.stdout::foo2 2026-02-24T07:25:50.254 INFO:tasks.workunit.client.0.trial022.stdout::foo3 2026-02-24T07:25:50.263 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosList.ListObjectsNS (34 ms) 2026-02-24T07:25:50.263 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosList.ListObjectsStart 2026-02-24T07:25:50.279 INFO:tasks.workunit.client.0.trial022.stdout:1 0 2026-02-24T07:25:50.279 INFO:tasks.workunit.client.0.trial022.stdout:10 0 2026-02-24T07:25:50.279 INFO:tasks.workunit.client.0.trial022.stdout:13 0 2026-02-24T07:25:50.279 INFO:tasks.workunit.client.0.trial022.stdout:7 0 2026-02-24T07:25:50.279 INFO:tasks.workunit.client.0.trial022.stdout:14 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:0 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:15 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:11 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:5 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:8 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:6 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:3 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:4 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:12 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:9 0 2026-02-24T07:25:50.280 INFO:tasks.workunit.client.0.trial022.stdout:2 0 2026-02-24T07:25:50.284 INFO:tasks.workunit.client.0.trial022.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-24T07:25:50.299 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosList.ListObjectsStart (35 ms) 2026-02-24T07:25:50.299 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2026-02-24T07:25:50.310 INFO:tasks.workunit.client.0.trial022.stdout:x cursor=MIN 2026-02-24T07:25:50.316 INFO:tasks.workunit.client.0.trial022.stdout:> oid=1 cursor=79:02547ec2:::1:head 2026-02-24T07:25:50.316 INFO:tasks.workunit.client.0.trial022.stdout:> oid=10 cursor=79:52ea6a34:::10:head 2026-02-24T07:25:50.316 INFO:tasks.workunit.client.0.trial022.stdout:> oid=13 cursor=79:566253c9:::13:head 2026-02-24T07:25:50.316 INFO:tasks.workunit.client.0.trial022.stdout:> oid=7 cursor=79:5c6b0b28:::7:head 2026-02-24T07:25:50.316 INFO:tasks.workunit.client.0.trial022.stdout:> oid=14 cursor=79:62a1935d:::14:head 2026-02-24T07:25:50.316 INFO:tasks.workunit.client.0.trial022.stdout:> oid=0 cursor=79:6cac518f:::0:head 2026-02-24T07:25:50.317 INFO:tasks.workunit.client.0.trial022.stdout:> oid=15 cursor=79:863748b0:::15:head 2026-02-24T07:25:50.317 INFO:tasks.workunit.client.0.trial022.stdout:> oid=11 cursor=79:89d3ae78:::11:head 2026-02-24T07:25:50.317 INFO:tasks.workunit.client.0.trial022.stdout:> oid=5 cursor=79:b29083e3:::5:head 2026-02-24T07:25:50.317 INFO:tasks.workunit.client.0.trial022.stdout:> oid=8 cursor=79:bd63b0f1:::8:head 2026-02-24T07:25:50.317 INFO:tasks.workunit.client.0.trial022.stdout:> oid=6 cursor=79:c4fdafeb:::6:head 2026-02-24T07:25:50.317 INFO:tasks.workunit.client.0.trial022.stdout:> oid=3 cursor=79:cfc208b3:::3:head 2026-02-24T07:25:50.317 INFO:tasks.workunit.client.0.trial022.stdout:> oid=4 cursor=79:d83876eb:::4:head 2026-02-24T07:25:50.317 INFO:tasks.workunit.client.0.trial022.stdout:> oid=12 cursor=79:de5d7c5f:::12:head 2026-02-24T07:25:50.318 INFO:tasks.workunit.client.0.trial022.stdout:> oid=9 cursor=79:e960b815:::9:head 2026-02-24T07:25:50.318 INFO:tasks.workunit.client.0.trial022.stdout:> oid=2 cursor=79:f905c69b:::2:head 2026-02-24T07:25:50.320 INFO:tasks.workunit.client.0.trial022.stdout:FIRST> seek to MIN oid=1 2026-02-24T07:25:50.324 INFO:tasks.workunit.client.0.trial022.stdout:: oid=1 cursor=79:02547ec2:::1:head 2026-02-24T07:25:50.325 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:02547ec2:::1:head 2026-02-24T07:25:50.329 INFO:tasks.workunit.client.0.trial022.stdout:> 79:02547ec2:::1:head -> 1 2026-02-24T07:25:50.329 INFO:tasks.workunit.client.0.trial022.stdout:: oid=10 cursor=79:52ea6a34:::10:head 2026-02-24T07:25:50.329 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:52ea6a34:::10:head 2026-02-24T07:25:50.332 INFO:tasks.workunit.client.0.trial022.stdout:> 79:52ea6a34:::10:head -> 10 2026-02-24T07:25:50.332 INFO:tasks.workunit.client.0.trial022.stdout:: oid=13 cursor=79:566253c9:::13:head 2026-02-24T07:25:50.333 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:566253c9:::13:head 2026-02-24T07:25:50.336 INFO:tasks.workunit.client.0.trial022.stdout:> 79:566253c9:::13:head -> 13 2026-02-24T07:25:50.336 INFO:tasks.workunit.client.0.trial022.stdout:: oid=7 cursor=79:5c6b0b28:::7:head 2026-02-24T07:25:50.336 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:5c6b0b28:::7:head 2026-02-24T07:25:50.339 INFO:tasks.workunit.client.0.trial022.stdout:> 79:5c6b0b28:::7:head -> 7 2026-02-24T07:25:50.339 INFO:tasks.workunit.client.0.trial022.stdout:: oid=14 cursor=79:62a1935d:::14:head 2026-02-24T07:25:50.339 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:62a1935d:::14:head 2026-02-24T07:25:50.342 INFO:tasks.workunit.client.0.trial022.stdout:> 79:62a1935d:::14:head -> 14 2026-02-24T07:25:50.342 INFO:tasks.workunit.client.0.trial022.stdout:: oid=0 cursor=79:6cac518f:::0:head 2026-02-24T07:25:50.342 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:6cac518f:::0:head 2026-02-24T07:25:50.345 INFO:tasks.workunit.client.0.trial022.stdout:> 79:6cac518f:::0:head -> 0 2026-02-24T07:25:50.345 INFO:tasks.workunit.client.0.trial022.stdout:: oid=15 cursor=79:863748b0:::15:head 2026-02-24T07:25:50.345 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:863748b0:::15:head 2026-02-24T07:25:50.347 INFO:tasks.workunit.client.0.trial022.stdout:> 79:863748b0:::15:head -> 15 2026-02-24T07:25:50.347 INFO:tasks.workunit.client.0.trial022.stdout:: oid=11 cursor=79:89d3ae78:::11:head 2026-02-24T07:25:50.347 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:89d3ae78:::11:head 2026-02-24T07:25:50.349 INFO:tasks.workunit.client.0.trial022.stdout:> 79:89d3ae78:::11:head -> 11 2026-02-24T07:25:50.349 INFO:tasks.workunit.client.0.trial022.stdout:: oid=5 cursor=79:b29083e3:::5:head 2026-02-24T07:25:50.349 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:b29083e3:::5:head 2026-02-24T07:25:50.350 INFO:tasks.workunit.client.0.trial022.stdout:> 79:b29083e3:::5:head -> 5 2026-02-24T07:25:50.350 INFO:tasks.workunit.client.0.trial022.stdout:: oid=8 cursor=79:bd63b0f1:::8:head 2026-02-24T07:25:50.350 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:bd63b0f1:::8:head 2026-02-24T07:25:50.351 INFO:tasks.workunit.client.0.trial022.stdout:> 79:bd63b0f1:::8:head -> 8 2026-02-24T07:25:50.352 INFO:tasks.workunit.client.0.trial022.stdout:: oid=6 cursor=79:c4fdafeb:::6:head 2026-02-24T07:25:50.352 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:c4fdafeb:::6:head 2026-02-24T07:25:50.353 INFO:tasks.workunit.client.0.trial022.stdout:> 79:c4fdafeb:::6:head -> 6 2026-02-24T07:25:50.353 INFO:tasks.workunit.client.0.trial022.stdout:: oid=3 cursor=79:cfc208b3:::3:head 2026-02-24T07:25:50.353 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:cfc208b3:::3:head 2026-02-24T07:25:50.354 INFO:tasks.workunit.client.0.trial022.stdout:> 79:cfc208b3:::3:head -> 3 2026-02-24T07:25:50.354 INFO:tasks.workunit.client.0.trial022.stdout:: oid=4 cursor=79:d83876eb:::4:head 2026-02-24T07:25:50.354 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:d83876eb:::4:head 2026-02-24T07:25:50.354 INFO:tasks.workunit.client.0.trial022.stdout:> 79:d83876eb:::4:head -> 4 2026-02-24T07:25:50.354 INFO:tasks.workunit.client.0.trial022.stdout:: oid=12 cursor=79:de5d7c5f:::12:head 2026-02-24T07:25:50.354 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:de5d7c5f:::12:head 2026-02-24T07:25:50.355 INFO:tasks.workunit.client.0.trial022.stdout:> 79:de5d7c5f:::12:head -> 12 2026-02-24T07:25:50.355 INFO:tasks.workunit.client.0.trial022.stdout:: oid=9 cursor=79:e960b815:::9:head 2026-02-24T07:25:50.355 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:e960b815:::9:head 2026-02-24T07:25:50.356 INFO:tasks.workunit.client.0.trial022.stdout:> 79:e960b815:::9:head -> 9 2026-02-24T07:25:50.356 INFO:tasks.workunit.client.0.trial022.stdout:: oid=2 cursor=79:f905c69b:::2:head 2026-02-24T07:25:50.356 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:f905c69b:::2:head 2026-02-24T07:25:50.356 INFO:tasks.workunit.client.0.trial022.stdout:> 79:f905c69b:::2:head -> 2 2026-02-24T07:25:50.356 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:5c6b0b28:::7:head 2026-02-24T07:25:50.356 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:5c6b0b28:::7:head expected=79:5c6b0b28:::7:head 2026-02-24T07:25:50.359 INFO:tasks.workunit.client.0.trial022.stdout:> 79:5c6b0b28:::7:head -> 7 2026-02-24T07:25:50.359 INFO:tasks.workunit.client.0.trial022.stdout:: entry=7 expected=7 2026-02-24T07:25:50.359 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:f905c69b:::2:head 2026-02-24T07:25:50.359 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:f905c69b:::2:head expected=79:f905c69b:::2:head 2026-02-24T07:25:50.359 INFO:tasks.workunit.client.0.trial022.stdout:> 79:f905c69b:::2:head -> 2 2026-02-24T07:25:50.359 INFO:tasks.workunit.client.0.trial022.stdout:: entry=2 expected=2 2026-02-24T07:25:50.359 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:cfc208b3:::3:head 2026-02-24T07:25:50.360 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:cfc208b3:::3:head expected=79:cfc208b3:::3:head 2026-02-24T07:25:50.360 INFO:tasks.workunit.client.0.trial022.stdout:> 79:cfc208b3:::3:head -> 3 2026-02-24T07:25:50.360 INFO:tasks.workunit.client.0.trial022.stdout:: entry=3 expected=3 2026-02-24T07:25:50.360 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:863748b0:::15:head 2026-02-24T07:25:50.360 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:863748b0:::15:head expected=79:863748b0:::15:head 2026-02-24T07:25:50.362 INFO:tasks.workunit.client.0.trial022.stdout:> 79:863748b0:::15:head -> 15 2026-02-24T07:25:50.362 INFO:tasks.workunit.client.0.trial022.stdout:: entry=15 expected=15 2026-02-24T07:25:50.362 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:e960b815:::9:head 2026-02-24T07:25:50.362 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:e960b815:::9:head expected=79:e960b815:::9:head 2026-02-24T07:25:50.363 INFO:tasks.workunit.client.0.trial022.stdout:> 79:e960b815:::9:head -> 9 2026-02-24T07:25:50.363 INFO:tasks.workunit.client.0.trial022.stdout:: entry=9 expected=9 2026-02-24T07:25:50.363 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:de5d7c5f:::12:head 2026-02-24T07:25:50.363 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:de5d7c5f:::12:head expected=79:de5d7c5f:::12:head 2026-02-24T07:25:50.363 INFO:tasks.workunit.client.0.trial022.stdout:> 79:de5d7c5f:::12:head -> 12 2026-02-24T07:25:50.363 INFO:tasks.workunit.client.0.trial022.stdout:: entry=12 expected=12 2026-02-24T07:25:50.363 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:d83876eb:::4:head 2026-02-24T07:25:50.364 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:d83876eb:::4:head expected=79:d83876eb:::4:head 2026-02-24T07:25:50.364 INFO:tasks.workunit.client.0.trial022.stdout:> 79:d83876eb:::4:head -> 4 2026-02-24T07:25:50.364 INFO:tasks.workunit.client.0.trial022.stdout:: entry=4 expected=4 2026-02-24T07:25:50.364 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:6cac518f:::0:head 2026-02-24T07:25:50.364 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:6cac518f:::0:head expected=79:6cac518f:::0:head 2026-02-24T07:25:50.366 INFO:tasks.workunit.client.0.trial022.stdout:> 79:6cac518f:::0:head -> 0 2026-02-24T07:25:50.367 INFO:tasks.workunit.client.0.trial022.stdout:: entry=0 expected=0 2026-02-24T07:25:50.367 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:62a1935d:::14:head 2026-02-24T07:25:50.367 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:62a1935d:::14:head expected=79:62a1935d:::14:head 2026-02-24T07:25:50.369 INFO:tasks.workunit.client.0.trial022.stdout:> 79:62a1935d:::14:head -> 14 2026-02-24T07:25:50.369 INFO:tasks.workunit.client.0.trial022.stdout:: entry=14 expected=14 2026-02-24T07:25:50.370 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:566253c9:::13:head 2026-02-24T07:25:50.370 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:566253c9:::13:head expected=79:566253c9:::13:head 2026-02-24T07:25:50.373 INFO:tasks.workunit.client.0.trial022.stdout:> 79:566253c9:::13:head -> 13 2026-02-24T07:25:50.373 INFO:tasks.workunit.client.0.trial022.stdout:: entry=13 expected=13 2026-02-24T07:25:50.373 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:c4fdafeb:::6:head 2026-02-24T07:25:50.373 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:c4fdafeb:::6:head expected=79:c4fdafeb:::6:head 2026-02-24T07:25:50.374 INFO:tasks.workunit.client.0.trial022.stdout:> 79:c4fdafeb:::6:head -> 6 2026-02-24T07:25:50.374 INFO:tasks.workunit.client.0.trial022.stdout:: entry=6 expected=6 2026-02-24T07:25:50.374 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:bd63b0f1:::8:head 2026-02-24T07:25:50.374 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:bd63b0f1:::8:head expected=79:bd63b0f1:::8:head 2026-02-24T07:25:50.375 INFO:tasks.workunit.client.0.trial022.stdout:> 79:bd63b0f1:::8:head -> 8 2026-02-24T07:25:50.375 INFO:tasks.workunit.client.0.trial022.stdout:: entry=8 expected=8 2026-02-24T07:25:50.375 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:b29083e3:::5:head 2026-02-24T07:25:50.375 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:b29083e3:::5:head expected=79:b29083e3:::5:head 2026-02-24T07:25:50.376 INFO:tasks.workunit.client.0.trial022.stdout:> 79:b29083e3:::5:head -> 5 2026-02-24T07:25:50.377 INFO:tasks.workunit.client.0.trial022.stdout:: entry=5 expected=5 2026-02-24T07:25:50.377 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:89d3ae78:::11:head 2026-02-24T07:25:50.377 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:89d3ae78:::11:head expected=79:89d3ae78:::11:head 2026-02-24T07:25:50.378 INFO:tasks.workunit.client.0.trial022.stdout:> 79:89d3ae78:::11:head -> 11 2026-02-24T07:25:50.379 INFO:tasks.workunit.client.0.trial022.stdout:: entry=11 expected=11 2026-02-24T07:25:50.379 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:02547ec2:::1:head 2026-02-24T07:25:50.379 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:02547ec2:::1:head expected=79:02547ec2:::1:head 2026-02-24T07:25:50.383 INFO:tasks.workunit.client.0.trial022.stdout:> 79:02547ec2:::1:head -> 1 2026-02-24T07:25:50.383 INFO:tasks.workunit.client.0.trial022.stdout:: entry=1 expected=1 2026-02-24T07:25:50.383 INFO:tasks.workunit.client.0.trial022.stdout:: seek to 79:52ea6a34:::10:head 2026-02-24T07:25:50.384 INFO:tasks.workunit.client.0.trial022.stdout:: cursor()=79:52ea6a34:::10:head expected=79:52ea6a34:::10:head 2026-02-24T07:25:50.386 INFO:tasks.workunit.client.0.trial022.stdout:> 79:52ea6a34:::10:head -> 10 2026-02-24T07:25:50.387 INFO:tasks.workunit.client.0.trial022.stdout:: entry=10 expected=10 2026-02-24T07:25:50.401 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosList.ListObjectsCursor (101 ms) 2026-02-24T07:25:50.401 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosList.EnumerateObjects 2026-02-24T07:25:50.431 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosList.EnumerateObjects (30 ms) 2026-02-24T07:25:50.431 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2026-02-24T07:25:50.441 INFO:tasks.workunit.client.0.trial022.stdout:split 0/5 -> MIN 79:33333333::::head 2026-02-24T07:25:50.442 INFO:tasks.workunit.client.0.trial022.stdout:split 1/5 -> 79:33333333::::head 79:66666666::::head 2026-02-24T07:25:50.444 INFO:tasks.workunit.client.0.trial022.stdout:split 2/5 -> 79:66666666::::head 79:99999999::::head 2026-02-24T07:25:50.445 INFO:tasks.workunit.client.0.trial022.stdout:split 3/5 -> 79:99999999::::head 79:cccccccc::::head 2026-02-24T07:25:50.446 INFO:tasks.workunit.client.0.trial022.stdout:split 4/5 -> 79:cccccccc::::head MAX 2026-02-24T07:25:50.461 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (30 ms) 2026-02-24T07:25:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:50 trial022 ceph-mon[39108]: osdmap e262: 4 total, 4 up, 4 in 2026-02-24T07:25:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:50 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1168789422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosList_trial022-78936-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:50 trial022 ceph-mon[39108]: pgmap v375: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 137 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:51.202 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 7 tests from LibRadosList (262 ms total) 2026-02-24T07:25:51.202 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:51.202 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from LibRadosListEC 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:70: Skipped 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosListEC.ListObjects 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/list.cc:279: Skipped 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/list.cc:296: Skipped 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:51.203 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/list.cc:360: Skipped 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:78: Skipped 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosListNP 2026-02-24T07:25:51.204 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2026-02-24T07:25:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:51 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1168789422' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_trial022-78936-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:51 trial022 ceph-mon[39108]: osdmap e263: 4 total, 4 up, 4 in 2026-02-24T07:25:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:25:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:25:50] "GET /metrics HTTP/1.1" 200 4184 "" "Prometheus/3.6.0" 2026-02-24T07:25:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:25:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:25:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:25:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:52 trial022 ceph-mon[39108]: osdmap e264: 4 total, 4 up, 4 in 2026-02-24T07:25:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:52 trial022 ceph-mon[39108]: pgmap v378: 33 pgs: 33 active+clean; 577 KiB data, 172 MiB used, 2.7 TiB / 2.7 TiB avail; 2.5 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2026-02-24T07:25:53.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:53 trial022 ceph-mon[39108]: osdmap e265: 4 total, 4 up, 4 in 2026-02-24T07:25:53.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:53 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3052536279' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-78936-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:54.209 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosListNP.ListObjectsError (3007 ms) 2026-02-24T07:25:54.209 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosListNP (3007 ms total) 2026-02-24T07:25:54.209 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:54.209 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:25:54.209 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 11 tests from 3 test suites ran. (5978 ms total) 2026-02-24T07:25:54.210 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 8 tests. 2026-02-24T07:25:54.210 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 3 tests, listed below: 2026-02-24T07:25:54.210 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2026-02-24T07:25:54.210 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2026-02-24T07:25:54.210 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2026-02-24T07:25:54.213 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:25:54.213 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_lock 2026-02-24T07:25:54.213 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:54.213 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:54.213 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_lock 2026-02-24T07:25:54.226 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:25:54.226 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 16 tests from 2 test suites. 2026-02-24T07:25:54.227 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:25:54.227 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from LibRadosLock 2026-02-24T07:25:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:54 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3052536279' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-78936-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:54 trial022 ceph-mon[39108]: osdmap e266: 4 total, 4 up, 4 in 2026-02-24T07:25:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:54 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3052536279' entity='client.admin' cmd={"prefix":"osd pool rm","pool": "test-rados-api-trial022-78936-2","pool2":"test-rados-api-trial022-78936-2","yes_i_really_really_mean_it_not_faking": true} : dispatch 2026-02-24T07:25:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:54 trial022 ceph-mon[39108]: pgmap v381: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 172 MiB used, 2.7 TiB / 2.7 TiB avail; 2.5 KiB/s rd, 2.7 KiB/s wr, 5 op/s 2026-02-24T07:25:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:55 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3052536279' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-trial022-78936-2","pool2":"test-rados-api-trial022-78936-2","yes_i_really_really_mean_it_not_faking": true}]': finished 2026-02-24T07:25:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:55 trial022 ceph-mon[39108]: osdmap e267: 4 total, 4 up, 4 in 2026-02-24T07:25:56.213 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLock.LockExclusive 2026-02-24T07:25:56.224 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLock.LockExclusive (10 ms) 2026-02-24T07:25:56.224 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLock.LockShared 2026-02-24T07:25:56.225 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLock.LockShared (1 ms) 2026-02-24T07:25:56.226 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2026-02-24T07:25:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:56 trial022 ceph-mon[39108]: osdmap e268: 4 total, 4 up, 4 in 2026-02-24T07:25:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:56 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/919451613' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLock_trial022-78974-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:25:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:56 trial022 ceph-mon[39108]: pgmap v384: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 172 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:25:57.230 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1004 ms) 2026-02-24T07:25:57.230 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLock.LockSharedDur 2026-02-24T07:25:57.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:57 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/919451613' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_trial022-78974-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:25:57.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:57 trial022 ceph-mon[39108]: osdmap e269: 4 total, 4 up, 4 in 2026-02-24T07:25:58.234 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLock.LockSharedDur (1004 ms) 2026-02-24T07:25:58.235 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLock.LockMayRenew 2026-02-24T07:25:58.237 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLock.LockMayRenew (2 ms) 2026-02-24T07:25:58.237 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLock.Unlock 2026-02-24T07:25:58.239 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLock.Unlock (2 ms) 2026-02-24T07:25:58.239 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLock.ListLockers 2026-02-24T07:25:58.242 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLock.ListLockers (2 ms) 2026-02-24T07:25:58.242 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLock.BreakLock 2026-02-24T07:25:58.243 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLock.BreakLock (1 ms) 2026-02-24T07:25:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:58 trial022 ceph-mon[39108]: osdmap e270: 4 total, 4 up, 4 in 2026-02-24T07:25:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:25:58 trial022 ceph-mon[39108]: pgmap v387: 65 pgs: 65 active+clean; 577 KiB data, 172 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 0 B/s wr, 1 op/s 2026-02-24T07:25:59.222 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from LibRadosLock (2030 ms total) 2026-02-24T07:25:59.222 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.222 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from LibRadosLockEC 2026-02-24T07:25:59.222 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:168: Skipped 2026-02-24T07:25:59.222 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock.cc:126: Skipped 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockEC.LockShared 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock.cc:132: Skipped 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock.cc:138: Skipped 2026-02-24T07:25:59.223 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock.cc:151: Skipped 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock.cc:165: Skipped 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockEC.Unlock 2026-02-24T07:25:59.224 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock.cc:172: Skipped 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockEC.ListLockers 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock.cc:179: Skipped 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockEC.BreakLock 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock.cc:212: Skipped 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:176: Skipped 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:25:59.225 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from LibRadosLockEC (0 ms total) 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 16 tests from 2 test suites ran. (4994 ms total) 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 8 tests. 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 8 tests, listed below: 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2026-02-24T07:25:59.226 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2026-02-24T07:25:59.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2026-02-24T07:25:59.227 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2026-02-24T07:25:59.228 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:25:59.228 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_lock_pp 2026-02-24T07:25:59.228 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:59.228 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:25:59.228 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_lock_pp 2026-02-24T07:25:59.238 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:25:59.238 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 16 tests from 2 test suites. 2026-02-24T07:25:59.238 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:25:59.238 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from LibRadosLockPP 2026-02-24T07:25:59.238 INFO:tasks.workunit.client.0.trial022.stdout:seed 78993 2026-02-24T07:26:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:00 trial022 ceph-mon[39108]: osdmap e271: 4 total, 4 up, 4 in 2026-02-24T07:26:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:00 trial022 ceph-mon[39108]: pgmap v389: 33 pgs: 33 active+clean; 577 KiB data, 172 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:01.224 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:26:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:26:00] "GET /metrics HTTP/1.1" 200 4184 "" "Prometheus/3.6.0" 2026-02-24T07:26:01.225 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2026-02-24T07:26:01.233 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (7 ms) 2026-02-24T07:26:01.233 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2026-02-24T07:26:01.235 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLockPP.LockSharedPP (2 ms) 2026-02-24T07:26:01.235 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2026-02-24T07:26:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:26:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:26:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:26:01.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:01 trial022 ceph-mon[39108]: osdmap e272: 4 total, 4 up, 4 in 2026-02-24T07:26:01.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:01 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3774782101' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosLockPP_trial022-78993-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:01.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:01 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:26:02.238 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1002 ms) 2026-02-24T07:26:02.239 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2026-02-24T07:26:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:02 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3774782101' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_trial022-78993-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:02 trial022 ceph-mon[39108]: osdmap e273: 4 total, 4 up, 4 in 2026-02-24T07:26:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:02 trial022 ceph-mon[39108]: pgmap v392: 65 pgs: 65 active+clean; 577 KiB data, 172 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:03.242 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1003 ms) 2026-02-24T07:26:03.242 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2026-02-24T07:26:03.244 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (2 ms) 2026-02-24T07:26:03.244 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2026-02-24T07:26:03.246 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLockPP.UnlockPP (2 ms) 2026-02-24T07:26:03.246 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2026-02-24T07:26:03.248 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLockPP.ListLockersPP (2 ms) 2026-02-24T07:26:03.249 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2026-02-24T07:26:03.250 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosLockPP.BreakLockPP (1 ms) 2026-02-24T07:26:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:03 trial022 ceph-mon[39108]: osdmap e274: 4 total, 4 up, 4 in 2026-02-24T07:26:04.233 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from LibRadosLockPP (2024 ms total) 2026-02-24T07:26:04.233 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.233 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from LibRadosLockECPP 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:371: Skipped 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock_cxx.cc:110: Skipped 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock_cxx.cc:116: Skipped 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.234 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock_cxx.cc:122: Skipped 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock_cxx.cc:135: Skipped 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock_cxx.cc:148: Skipped 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.235 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock_cxx.cc:155: Skipped 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock_cxx.cc:162: Skipped 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/lock_cxx.cc:188: Skipped 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.236 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:379: Skipped 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 16 tests from 2 test suites ran. (4994 ms total) 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 8 tests. 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 8 tests, listed below: 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2026-02-24T07:26:04.237 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-24T07:26:04.238 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2026-02-24T07:26:04.238 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2026-02-24T07:26:04.238 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2026-02-24T07:26:04.238 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2026-02-24T07:26:04.238 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2026-02-24T07:26:04.239 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:26:04.239 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_misc 2026-02-24T07:26:04.239 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:26:04.239 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:26:04.239 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_misc 2026-02-24T07:26:04.254 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 12 tests from 4 test suites. 2026-02-24T07:26:04.254 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:26:04.254 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosMiscVersion 2026-02-24T07:26:04.254 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscVersion.Version 2026-02-24T07:26:04.254 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2026-02-24T07:26:04.254 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-24T07:26:04.255 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:04.255 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2026-02-24T07:26:04.255 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2026-02-24T07:26:04.284 INFO:tasks.workunit.client.0.trial022.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-24T07:26:04.284 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:26:04.283+0000 7f40661dc700 -1 failed for service _ceph-mon._tcp 2026-02-24T07:26:04.285 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:26:04.283+0000 7f40661dc700 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-24T07:26:04.285 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (30 ms) 2026-02-24T07:26:04.285 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2026-02-24T07:26:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:04 trial022 ceph-mon[39108]: pgmap v394: 65 pgs: 65 active+clean; 577 KiB data, 172 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 0 B/s wr, 1 op/s 2026-02-24T07:26:05.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:05 trial022 ceph-mon[39108]: osdmap e275: 4 total, 4 up, 4 in 2026-02-24T07:26:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:06 trial022 ceph-mon[39108]: pgmap v396: 33 pgs: 33 active+clean; 577 KiB data, 172 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:09.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:08 trial022 ceph-mon[39108]: pgmap v397: 33 pgs: 33 active+clean; 577 KiB data, 173 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:09.288 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5003 ms) 2026-02-24T07:26:09.288 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (5033 ms total) 2026-02-24T07:26:09.288 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:09.288 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosMiscPool 2026-02-24T07:26:09.288 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2026-02-24T07:26:11.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:10 trial022 ceph-mon[39108]: pgmap v398: 33 pgs: 33 active+clean; 577 KiB data, 173 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:10 trial022 ceph-mon[39108]: osdmap e276: 4 total, 4 up, 4 in 2026-02-24T07:26:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:26:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:26:10] "GET /metrics HTTP/1.1" 200 4475 "" "Prometheus/3.6.0" 2026-02-24T07:26:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:26:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:26:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:26:11.896 INFO:tasks.workunit.client.0.trial022.stdout:started 0x7f402c00b2e0 2026-02-24T07:26:12.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:11 trial022 ceph-mon[39108]: osdmap e277: 4 total, 4 up, 4 in 2026-02-24T07:26:12.896 INFO:tasks.workunit.client.0.trial022.stdout:started 0x7f4050004bc0 2026-02-24T07:26:12.897 INFO:tasks.workunit.client.0.trial022.stdout: started 2 aios 2026-02-24T07:26:12.897 INFO:tasks.workunit.client.0.trial022.stdout:waiting 0x7f402c00b2e0 2026-02-24T07:26:12.897 INFO:tasks.workunit.client.0.trial022.stdout:waiting 0x7f4050004bc0 2026-02-24T07:26:12.897 INFO:tasks.workunit.client.0.trial022.stdout:done. 2026-02-24T07:26:13.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:12 trial022 ceph-mon[39108]: pgmap v401: 97 pgs: 32 creating+peering, 65 active+clean; 577 KiB data, 173 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:13.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:12 trial022 ceph-mon[39108]: osdmap e278: 4 total, 4 up, 4 in 2026-02-24T07:26:13.906 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (4618 ms) 2026-02-24T07:26:13.907 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosMiscPool (4618 ms total) 2026-02-24T07:26:13.907 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:13.907 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from LibRadosMisc 2026-02-24T07:26:14.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:13 trial022 ceph-mon[39108]: osdmap e279: 4 total, 4 up, 4 in 2026-02-24T07:26:15.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:14 trial022 ceph-mon[39108]: pgmap v404: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 173 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:15.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:14 trial022 ceph-mon[39108]: osdmap e280: 4 total, 4 up, 4 in 2026-02-24T07:26:15.909 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2026-02-24T07:26:15.909 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2026-02-24T07:26:15.909 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMisc.Exec 2026-02-24T07:26:15.918 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMisc.Exec (9 ms) 2026-02-24T07:26:15.918 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMisc.WriteSame 2026-02-24T07:26:15.922 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMisc.WriteSame (3 ms) 2026-02-24T07:26:15.922 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMisc.CmpExt 2026-02-24T07:26:15.924 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMisc.CmpExt (2 ms) 2026-02-24T07:26:15.924 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMisc.Applications 2026-02-24T07:26:16.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:15 trial022 ceph-mon[39108]: osdmap e281: 4 total, 4 up, 4 in 2026-02-24T07:26:16.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:15 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_trial022-79012-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:16 trial022 ceph-mon[39108]: pgmap v407: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 173 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:16 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_trial022-79012-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:16 trial022 ceph-mon[39108]: osdmap e282: 4 total, 4 up, 4 in 2026-02-24T07:26:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:16 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd={"prefix":"osd dump"} : dispatch 2026-02-24T07:26:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:16 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_trial022-79012-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:26:18.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:17 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_trial022-79012-1","app": "app1","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:18.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:17 trial022 ceph-mon[39108]: osdmap e283: 4 total, 4 up, 4 in 2026-02-24T07:26:18.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:17 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_trial022-79012-1","app": "app2"} : dispatch 2026-02-24T07:26:18.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:17 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_trial022-79012-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:18 trial022 ceph-mon[39108]: pgmap v410: 65 pgs: 65 active+clean; 577 KiB data, 173 MiB used, 2.7 TiB / 2.7 TiB avail; 511 B/s rd, 1.2 KiB/s wr, 1 op/s 2026-02-24T07:26:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:18 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_trial022-79012-1","app": "app2","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:18 trial022 ceph-mon[39108]: osdmap e284: 4 total, 4 up, 4 in 2026-02-24T07:26:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:18 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_trial022-79012-1","app":"dne","key":"key","value":"value"} : dispatch 2026-02-24T07:26:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:18 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_trial022-79012-1","app":"app1","key":"key1","value":"value1"} : dispatch 2026-02-24T07:26:20.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:19 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_trial022-79012-1","app":"app1","key":"key1","value":"value1"}]': finished 2026-02-24T07:26:20.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:19 trial022 ceph-mon[39108]: osdmap e285: 4 total, 4 up, 4 in 2026-02-24T07:26:20.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:19 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMisc_trial022-79012-1","app":"app1","key":"key2","value":"value2"} : dispatch 2026-02-24T07:26:20.917 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMisc.Applications (4992 ms) 2026-02-24T07:26:20.917 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2026-02-24T07:26:20.917 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2026-02-24T07:26:20.917 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2026-02-24T07:26:20.917 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2026-02-24T07:26:20.917 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2026-02-24T07:26:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:26:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:26:20] "GET /metrics HTTP/1.1" 200 4469 "" "Prometheus/3.6.0" 2026-02-24T07:26:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:20 trial022 ceph-mon[39108]: pgmap v413: 65 pgs: 65 active+clean; 577 KiB data, 173 MiB used, 2.7 TiB / 2.7 TiB avail; 511 B/s rd, 1.2 KiB/s wr, 1 op/s 2026-02-24T07:26:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:20 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_trial022-79012-1","app":"app1","key":"key2","value":"value2"}]': finished 2026-02-24T07:26:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:20 trial022 ceph-mon[39108]: osdmap e286: 4 total, 4 up, 4 in 2026-02-24T07:26:21.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:20 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMisc_trial022-79012-1","app":"app1","key":"key1"} : dispatch 2026-02-24T07:26:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:26:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:26:20.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:26:22.244 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:21 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559697771' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_trial022-79012-1","app":"app1","key":"key1"}]': finished 2026-02-24T07:26:22.244 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:21 trial022 ceph-mon[39108]: osdmap e287: 4 total, 4 up, 4 in 2026-02-24T07:26:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:22 trial022 ceph-mon[39108]: pgmap v416: 65 pgs: 65 active+clean; 577 KiB data, 191 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:22 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:26:24.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:26:24.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:26:24.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:26:24.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:26:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:24 trial022 ceph-mon[39108]: pgmap v417: 65 pgs: 65 active+clean; 577 KiB data, 191 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:25.659 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMisc.ShutdownRace (4743 ms) 2026-02-24T07:26:25.925 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from LibRadosMisc (9751 ms total) 2026-02-24T07:26:25.926 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:25.926 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:26:25.926 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 12 tests from 4 test suites ran. (21670 ms total) 2026-02-24T07:26:25.926 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 12 tests. 2026-02-24T07:26:25.937 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:26:25.937 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_misc_pp 2026-02-24T07:26:25.937 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:26:25.937 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:26:25.938 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_misc_pp 2026-02-24T07:26:25.956 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 32 tests from 7 test suites. 2026-02-24T07:26:25.957 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:26:25.957 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosMiscVersion 2026-02-24T07:26:25.957 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2026-02-24T07:26:25.957 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2026-02-24T07:26:25.957 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-24T07:26:25.957 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:25.957 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 23 tests from LibRadosMiscPP 2026-02-24T07:26:25.957 INFO:tasks.workunit.client.0.trial022.stdout:seed 140759 2026-02-24T07:26:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:26 trial022 ceph-mon[39108]: pgmap v418: 65 pgs: 65 active+clean; 577 KiB data, 191 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:26 trial022 ceph-mon[39108]: osdmap e288: 4 total, 4 up, 4 in 2026-02-24T07:26:27.930 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2026-02-24T07:26:27.931 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2026-02-24T07:26:27.931 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2026-02-24T07:26:27.944 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.LongNamePP (13 ms) 2026-02-24T07:26:27.944 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2026-02-24T07:26:27.944 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/misc_cxx.cc:55: Skipped 2026-02-24T07:26:27.944 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:26:27.944 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:27.944 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2026-02-24T07:26:27.944 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2026-02-24T07:26:27.947 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (3 ms) 2026-02-24T07:26:27.948 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2026-02-24T07:26:27.950 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (3 ms) 2026-02-24T07:26:27.951 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2026-02-24T07:26:27.952 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.ExecPP (0 ms) 2026-02-24T07:26:27.952 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2026-02-24T07:26:27.952 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (0 ms) 2026-02-24T07:26:27.952 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2026-02-24T07:26:27.954 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.Operate1PP (1 ms) 2026-02-24T07:26:27.954 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2026-02-24T07:26:27.955 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.Operate2PP (0 ms) 2026-02-24T07:26:27.955 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2026-02-24T07:26:27.958 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (3 ms) 2026-02-24T07:26:27.958 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2026-02-24T07:26:27.959 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (0 ms) 2026-02-24T07:26:27.959 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2026-02-24T07:26:27.961 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (2 ms) 2026-02-24T07:26:27.961 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2026-02-24T07:26:27.964 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (3 ms) 2026-02-24T07:26:27.964 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2026-02-24T07:26:27.965 INFO:tasks.workunit.client.0.trial022.stdout:osd_max_attr_size = 0 2026-02-24T07:26:27.965 INFO:tasks.workunit.client.0.trial022.stdout:osd_max_attr_size == 0; skipping test 2026-02-24T07:26:28.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:27 trial022 ceph-mon[39108]: osdmap e289: 4 total, 4 up, 4 in 2026-02-24T07:26:28.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:27 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial022-140759-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:28.696 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (730 ms) 2026-02-24T07:26:28.696 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2026-02-24T07:26:28.696 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/misc_cxx.cc:389: Skipped 2026-02-24T07:26:28.696 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:26:28.696 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:28.696 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2026-02-24T07:26:28.696 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2026-02-24T07:26:28.696 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/misc_cxx.cc:552: Skipped 2026-02-24T07:26:28.696 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:26:28.697 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:28.697 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2026-02-24T07:26:28.697 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2026-02-24T07:26:28.697 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (2 ms) 2026-02-24T07:26:28.698 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2026-02-24T07:26:28.699 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (1 ms) 2026-02-24T07:26:28.699 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.Applications 2026-02-24T07:26:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:28 trial022 ceph-mon[39108]: pgmap v421: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 191 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:28 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial022-140759-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:28 trial022 ceph-mon[39108]: osdmap e290: 4 total, 4 up, 4 in 2026-02-24T07:26:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:28 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2026-02-24T07:26:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:28 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial022-140759-1","app": "app1","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:30.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:29 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial022-140759-1","app": "app1","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:30.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:29 trial022 ceph-mon[39108]: osdmap e291: 4 total, 4 up, 4 in 2026-02-24T07:26:30.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:29 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial022-140759-1","app": "app2"} : dispatch 2026-02-24T07:26:30.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:29 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial022-140759-1","app": "app2","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:30 trial022 ceph-mon[39108]: pgmap v424: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 191 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:30 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial022-140759-1","app": "app2","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:30 trial022 ceph-mon[39108]: osdmap e292: 4 total, 4 up, 4 in 2026-02-24T07:26:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:30 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_trial022-140759-1","app":"dne","key":"key1","value":"value1"} : dispatch 2026-02-24T07:26:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:30 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_trial022-140759-1","app":"app1","key":"key1","value":"value1"} : dispatch 2026-02-24T07:26:31.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:26:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:26:30] "GET /metrics HTTP/1.1" 200 4469 "" "Prometheus/3.6.0" 2026-02-24T07:26:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:26:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:26:30.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:26:32.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:31 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_trial022-140759-1","app":"app1","key":"key1","value":"value1"}]': finished 2026-02-24T07:26:32.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:31 trial022 ceph-mon[39108]: osdmap e293: 4 total, 4 up, 4 in 2026-02-24T07:26:32.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:31 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd={"prefix":"osd pool application set","pool":"LibRadosMiscPP_trial022-140759-1","app":"app1","key":"key2","value":"value2"} : dispatch 2026-02-24T07:26:32.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:31 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:26:32.941 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.Applications (4241 ms) 2026-02-24T07:26:32.941 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2026-02-24T07:26:32.941 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2026-02-24T07:26:32.941 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2026-02-24T07:26:32.941 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2026-02-24T07:26:32.941 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.Conf 2026-02-24T07:26:32.941 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2026-02-24T07:26:32.942 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscPP.NoVer 2026-02-24T07:26:32.946 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosMiscPP.NoVer (5 ms) 2026-02-24T07:26:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:32 trial022 ceph-mon[39108]: pgmap v427: 65 pgs: 65 active+clean; 578 KiB data, 226 MiB used, 2.7 TiB / 2.7 TiB avail; 767 B/s rd, 3.7 KiB/s wr, 507 op/s 2026-02-24T07:26:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:32 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_trial022-140759-1","app":"app1","key":"key2","value":"value2"}]': finished 2026-02-24T07:26:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:32 trial022 ceph-mon[39108]: osdmap e294: 4 total, 4 up, 4 in 2026-02-24T07:26:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:32 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd={"prefix":"osd pool application rm","pool":"LibRadosMiscPP_trial022-140759-1","app":"app1","key":"key1"} : dispatch 2026-02-24T07:26:33.945 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 23 tests from LibRadosMiscPP (5016 ms total) 2026-02-24T07:26:33.946 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:33.946 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2026-02-24T07:26:33.946 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/misc_cxx.cc:479: Skipped 2026-02-24T07:26:33.946 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:26:33.946 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:33.946 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-24T07:26:33.946 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/misc_cxx.cc:524: Skipped 2026-02-24T07:26:33.946 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:33.947 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2026-02-24T07:26:33.947 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/misc_cxx.cc:494: Skipped 2026-02-24T07:26:33.947 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:26:33.947 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:33.947 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2026-02-24T07:26:33.947 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:33.947 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0,Checksummer::xxhash32,ceph_le > 2026-02-24T07:26:34.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:33 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3105767741' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_trial022-140759-1","app":"app1","key":"key1"}]': finished 2026-02-24T07:26:34.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:33 trial022 ceph-mon[39108]: osdmap e295: 4 total, 4 up, 4 in 2026-02-24T07:26:35.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:34 trial022 ceph-mon[39108]: pgmap v430: 65 pgs: 65 active+clean; 578 KiB data, 226 MiB used, 2.7 TiB / 2.7 TiB avail; 767 B/s rd, 3.7 KiB/s wr, 507 op/s 2026-02-24T07:26:35.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:34 trial022 ceph-mon[39108]: osdmap e296: 4 total, 4 up, 4 in 2026-02-24T07:26:35.948 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosChecksum/0.Subset 2026-02-24T07:26:35.960 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosChecksum/0.Subset (12 ms) 2026-02-24T07:26:35.960 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2026-02-24T07:26:35.961 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosChecksum/0.Chunked (1 ms) 2026-02-24T07:26:36.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:35 trial022 ceph-mon[39108]: osdmap e297: 4 total, 4 up, 4 in 2026-02-24T07:26:36.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:35 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4210521685' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_trial022-140759-25","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:36.951 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosChecksum/0 (13 ms total) 2026-02-24T07:26:36.951 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:36.951 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1,Checksummer::xxhash64,ceph_le > 2026-02-24T07:26:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:36 trial022 ceph-mon[39108]: pgmap v433: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 226 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:36 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4210521685' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_trial022-140759-25","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:36 trial022 ceph-mon[39108]: osdmap e298: 4 total, 4 up, 4 in 2026-02-24T07:26:38.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:37 trial022 ceph-mon[39108]: osdmap e299: 4 total, 4 up, 4 in 2026-02-24T07:26:38.957 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosChecksum/1.Subset 2026-02-24T07:26:38.964 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosChecksum/1.Subset (7 ms) 2026-02-24T07:26:38.964 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2026-02-24T07:26:38.966 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosChecksum/1.Chunked (2 ms) 2026-02-24T07:26:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:38 trial022 ceph-mon[39108]: pgmap v436: 33 pgs: 33 active+clean; 577 KiB data, 244 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:38 trial022 ceph-mon[39108]: osdmap e300: 4 total, 4 up, 4 in 2026-02-24T07:26:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:38 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/799876422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_trial022-140759-28","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:39.961 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosChecksum/1 (9 ms total) 2026-02-24T07:26:39.961 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:39.961 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2,Checksummer::crc32c,ceph_le > 2026-02-24T07:26:40.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:39 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/799876422' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_trial022-140759-28","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:40.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:39 trial022 ceph-mon[39108]: osdmap e301: 4 total, 4 up, 4 in 2026-02-24T07:26:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:40 trial022 ceph-mon[39108]: pgmap v439: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 244 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:40 trial022 ceph-mon[39108]: osdmap e302: 4 total, 4 up, 4 in 2026-02-24T07:26:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:26:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:26:40] "GET /metrics HTTP/1.1" 200 4489 "" "Prometheus/3.6.0" 2026-02-24T07:26:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:26:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:26:40.954Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:26:41.962 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosChecksum/2.Subset 2026-02-24T07:26:41.973 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosChecksum/2.Subset (11 ms) 2026-02-24T07:26:41.973 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2026-02-24T07:26:41.975 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosChecksum/2.Chunked (1 ms) 2026-02-24T07:26:42.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:41 trial022 ceph-mon[39108]: osdmap e303: 4 total, 4 up, 4 in 2026-02-24T07:26:42.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:41 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1188657011' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_trial022-140759-31","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:42.966 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosChecksum/2 (13 ms total) 2026-02-24T07:26:42.966 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:42.966 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosMiscECPP 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:371: Skipped 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/misc_cxx.cc:872: Skipped 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:379: Skipped 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:42.967 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2026-02-24T07:26:42.968 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:26:42.968 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:26:42.968 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 32 tests from 7 test suites ran. (17009 ms total) 2026-02-24T07:26:42.968 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 27 tests. 2026-02-24T07:26:42.968 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 5 tests, listed below: 2026-02-24T07:26:42.968 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2026-02-24T07:26:42.968 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2026-02-24T07:26:42.968 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2026-02-24T07:26:42.968 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-24T07:26:42.968 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2026-02-24T07:26:42.969 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:26:42.969 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_pool 2026-02-24T07:26:42.969 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:26:42.969 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:26:42.969 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_pool 2026-02-24T07:26:42.985 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:26:42.985 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 9 tests from 1 test suite. 2026-02-24T07:26:42.985 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:26:42.985 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 9 tests from LibRadosPools 2026-02-24T07:26:42.985 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPools.PoolList 2026-02-24T07:26:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:42 trial022 ceph-mon[39108]: pgmap v442: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 262 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1188657011' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_trial022-140759-31","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:42 trial022 ceph-mon[39108]: osdmap e304: 4 total, 4 up, 4 in 2026-02-24T07:26:44.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:43 trial022 ceph-mon[39108]: osdmap e305: 4 total, 4 up, 4 in 2026-02-24T07:26:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:44 trial022 ceph-mon[39108]: pgmap v445: 33 pgs: 33 active+clean; 577 KiB data, 262 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:44 trial022 ceph-mon[39108]: osdmap e306: 4 total, 4 up, 4 in 2026-02-24T07:26:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:44 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/762831969' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:45.974 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosPools.PoolList (2988 ms) 2026-02-24T07:26:45.974 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPools.PoolLookup 2026-02-24T07:26:46.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:45 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/762831969' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:46.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:45 trial022 ceph-mon[39108]: osdmap e307: 4 total, 4 up, 4 in 2026-02-24T07:26:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:46 trial022 ceph-mon[39108]: pgmap v448: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 262 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:46 trial022 ceph-mon[39108]: osdmap e308: 4 total, 4 up, 4 in 2026-02-24T07:26:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:46 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:26:48.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:47 trial022 ceph-mon[39108]: osdmap e309: 4 total, 4 up, 4 in 2026-02-24T07:26:48.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:47 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/39375953' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:48.980 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosPools.PoolLookup (3006 ms) 2026-02-24T07:26:48.980 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPools.PoolLookup2 2026-02-24T07:26:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:48 trial022 ceph-mon[39108]: pgmap v451: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 262 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:48 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/39375953' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:48 trial022 ceph-mon[39108]: osdmap e310: 4 total, 4 up, 4 in 2026-02-24T07:26:50.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:49 trial022 ceph-mon[39108]: osdmap e311: 4 total, 4 up, 4 in 2026-02-24T07:26:51.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:50 trial022 ceph-mon[39108]: pgmap v454: 33 pgs: 33 active+clean; 577 KiB data, 262 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:50 trial022 ceph-mon[39108]: osdmap e312: 4 total, 4 up, 4 in 2026-02-24T07:26:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:50 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4148600286' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:26:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:26:50] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-24T07:26:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:26:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:26:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:26:51.988 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosPools.PoolLookup2 (3008 ms) 2026-02-24T07:26:51.988 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2026-02-24T07:26:52.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:51 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4148600286' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:52.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:51 trial022 ceph-mon[39108]: osdmap e313: 4 total, 4 up, 4 in 2026-02-24T07:26:53.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:52 trial022 ceph-mon[39108]: pgmap v457: 65 pgs: 65 active+clean; 577 KiB data, 263 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:53.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:52 trial022 ceph-mon[39108]: osdmap e314: 4 total, 4 up, 4 in 2026-02-24T07:26:54.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:53 trial022 ceph-mon[39108]: osdmap e315: 4 total, 4 up, 4 in 2026-02-24T07:26:54.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:53 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3476792809' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:54.995 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (3006 ms) 2026-02-24T07:26:54.995 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2026-02-24T07:26:55.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:54 trial022 ceph-mon[39108]: pgmap v460: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 263 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:54 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3476792809' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-4","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:54 trial022 ceph-mon[39108]: osdmap e316: 4 total, 4 up, 4 in 2026-02-24T07:26:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:55 trial022 ceph-mon[39108]: osdmap e317: 4 total, 4 up, 4 in 2026-02-24T07:26:57.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:56 trial022 ceph-mon[39108]: pgmap v463: 33 pgs: 33 active+clean; 577 KiB data, 263 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:57.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:56 trial022 ceph-mon[39108]: osdmap e318: 4 total, 4 up, 4 in 2026-02-24T07:26:57.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:56 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/440378903' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:26:58.004 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3008 ms) 2026-02-24T07:26:58.004 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPools.PoolDelete 2026-02-24T07:26:58.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:57 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/440378903' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-5","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:26:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:57 trial022 ceph-mon[39108]: osdmap e319: 4 total, 4 up, 4 in 2026-02-24T07:26:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:58 trial022 ceph-mon[39108]: pgmap v466: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 263 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:26:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:26:58 trial022 ceph-mon[39108]: osdmap e320: 4 total, 4 up, 4 in 2026-02-24T07:27:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:00 trial022 ceph-mon[39108]: osdmap e321: 4 total, 4 up, 4 in 2026-02-24T07:27:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:00 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3071905797' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:27:01.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:01 trial022 ceph-mon[39108]: pgmap v469: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 263 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:01 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3071905797' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-6","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:27:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:01 trial022 ceph-mon[39108]: osdmap e322: 4 total, 4 up, 4 in 2026-02-24T07:27:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:27:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:27:00] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-24T07:27:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:27:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:27:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:27:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:02 trial022 ceph-mon[39108]: osdmap e323: 4 total, 4 up, 4 in 2026-02-24T07:27:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:02 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:27:03.013 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosPools.PoolDelete (5008 ms) 2026-02-24T07:27:03.013 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2026-02-24T07:27:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:03 trial022 ceph-mon[39108]: pgmap v472: 33 pgs: 33 active+clean; 577 KiB data, 263 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:03 trial022 ceph-mon[39108]: osdmap e324: 4 total, 4 up, 4 in 2026-02-24T07:27:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:04 trial022 ceph-mon[39108]: osdmap e325: 4 total, 4 up, 4 in 2026-02-24T07:27:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:05 trial022 ceph-mon[39108]: pgmap v475: 33 pgs: 33 active+clean; 577 KiB data, 263 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:05 trial022 ceph-mon[39108]: osdmap e326: 4 total, 4 up, 4 in 2026-02-24T07:27:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:05 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1415279322' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:27:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:06 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1415279322' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-7","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:27:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:06 trial022 ceph-mon[39108]: osdmap e327: 4 total, 4 up, 4 in 2026-02-24T07:27:07.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:07 trial022 ceph-mon[39108]: pgmap v478: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 263 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:07.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:07 trial022 ceph-mon[39108]: osdmap e328: 4 total, 4 up, 4 in 2026-02-24T07:27:08.024 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosPools.PoolCreateDelete (5011 ms) 2026-02-24T07:27:08.024 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2026-02-24T07:27:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:08 trial022 ceph-mon[39108]: osdmap e329: 4 total, 4 up, 4 in 2026-02-24T07:27:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:09 trial022 ceph-mon[39108]: pgmap v481: 65 pgs: 65 active+clean; 577 KiB data, 263 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:09 trial022 ceph-mon[39108]: osdmap e330: 4 total, 4 up, 4 in 2026-02-24T07:27:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:10 trial022 ceph-mon[39108]: osdmap e331: 4 total, 4 up, 4 in 2026-02-24T07:27:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:10 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3761542077' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-8","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:27:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:11 trial022 ceph-mon[39108]: pgmap v484: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 263 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:11 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3761542077' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-140831-8","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:27:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:11 trial022 ceph-mon[39108]: osdmap e332: 4 total, 4 up, 4 in 2026-02-24T07:27:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:27:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:27:10] "GET /metrics HTTP/1.1" 200 4226 "" "Prometheus/3.6.0" 2026-02-24T07:27:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:27:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:27:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:27:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:12 trial022 ceph-mon[39108]: osdmap e333: 4 total, 4 up, 4 in 2026-02-24T07:27:13.038 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (5013 ms) 2026-02-24T07:27:13.038 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2026-02-24T07:27:13.038 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/pool.cc:139: Skipped 2026-02-24T07:27:13.038 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:27:13.039 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:13.039 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2026-02-24T07:27:13.039 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 9 tests from LibRadosPools (30052 ms total) 2026-02-24T07:27:13.039 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:13.039 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:27:13.039 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 9 tests from 1 test suite ran. (30052 ms total) 2026-02-24T07:27:13.039 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 8 tests. 2026-02-24T07:27:13.039 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 1 test, listed below: 2026-02-24T07:27:13.039 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2026-02-24T07:27:13.040 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:27:13.040 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_snapshots 2026-02-24T07:27:13.041 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:27:13.041 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:27:13.041 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_snapshots 2026-02-24T07:27:13.054 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:27:13.054 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 13 tests from 4 test suites. 2026-02-24T07:27:13.054 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:27:13.054 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosSnapshots 2026-02-24T07:27:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:13 trial022 ceph-mon[39108]: pgmap v487: 97 pgs: 32 creating+peering, 65 active+clean; 577 KiB data, 264 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:13 trial022 ceph-mon[39108]: osdmap e334: 4 total, 4 up, 4 in 2026-02-24T07:27:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:14 trial022 ceph-mon[39108]: osdmap e335: 4 total, 4 up, 4 in 2026-02-24T07:27:15.043 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshots.SnapList 2026-02-24T07:27:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:15 trial022 ceph-mon[39108]: pgmap v490: 33 pgs: 33 active+clean; 577 KiB data, 264 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:15 trial022 ceph-mon[39108]: osdmap e336: 4 total, 4 up, 4 in 2026-02-24T07:27:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:15 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/148161402' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshots_trial022-141005-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:27:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:16 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/148161402' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_trial022-141005-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:27:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:16 trial022 ceph-mon[39108]: osdmap e337: 4 total, 4 up, 4 in 2026-02-24T07:27:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:27:17.046 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshots.SnapList (2002 ms) 2026-02-24T07:27:17.046 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2026-02-24T07:27:17.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:17 trial022 ceph-mon[39108]: pgmap v493: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 264 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:17.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:17 trial022 ceph-mon[39108]: osdmap e338: 4 total, 4 up, 4 in 2026-02-24T07:27:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:18 trial022 ceph-mon[39108]: osdmap e339: 4 total, 4 up, 4 in 2026-02-24T07:27:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:18 trial022 ceph-mon[39108]: pgmap v496: 65 pgs: 65 active+clean; 577 KiB data, 264 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:27:19.049 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2002 ms) 2026-02-24T07:27:19.049 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshots.Rollback 2026-02-24T07:27:19.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:19 trial022 ceph-mon[39108]: osdmap e340: 4 total, 4 up, 4 in 2026-02-24T07:27:20.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:20 trial022 ceph-mon[39108]: osdmap e341: 4 total, 4 up, 4 in 2026-02-24T07:27:20.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:20 trial022 ceph-mon[39108]: pgmap v499: 65 pgs: 65 active+clean; 577 KiB data, 264 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:27:21.053 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshots.Rollback (2004 ms) 2026-02-24T07:27:21.053 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2026-02-24T07:27:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:21 trial022 ceph-mon[39108]: osdmap e342: 4 total, 4 up, 4 in 2026-02-24T07:27:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:27:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:27:20] "GET /metrics HTTP/1.1" 200 4488 "" "Prometheus/3.6.0" 2026-02-24T07:27:21.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:27:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:27:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:27:22.459 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:22 trial022 ceph-mon[39108]: osdmap e343: 4 total, 4 up, 4 in 2026-02-24T07:27:22.459 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:22 trial022 ceph-mon[39108]: pgmap v502: 65 pgs: 65 active+clean; 577 KiB data, 264 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 1023 B/s wr, 1 op/s 2026-02-24T07:27:23.056 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2002 ms) 2026-02-24T07:27:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:23 trial022 ceph-mon[39108]: osdmap e344: 4 total, 4 up, 4 in 2026-02-24T07:27:24.061 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosSnapshots (8012 ms total) 2026-02-24T07:27:24.062 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:24.062 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2026-02-24T07:27:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:24 trial022 ceph-mon[39108]: osdmap e345: 4 total, 4 up, 4 in 2026-02-24T07:27:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:27:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:27:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:27:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:27:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:27:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:24 trial022 ceph-mon[39108]: pgmap v505: 65 pgs: 65 active+clean; 577 KiB data, 264 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 1023 B/s wr, 1 op/s 2026-02-24T07:27:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:25 trial022 ceph-mon[39108]: osdmap e346: 4 total, 4 up, 4 in 2026-02-24T07:27:26.064 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2026-02-24T07:27:26.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:26 trial022 ceph-mon[39108]: osdmap e347: 4 total, 4 up, 4 in 2026-02-24T07:27:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:26 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1798640468' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_trial022-141005-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:27:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:26 trial022 ceph-mon[39108]: pgmap v508: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 264 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:27 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1798640468' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_trial022-141005-6","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:27:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:27 trial022 ceph-mon[39108]: osdmap e348: 4 total, 4 up, 4 in 2026-02-24T07:27:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:28 trial022 ceph-mon[39108]: osdmap e349: 4 total, 4 up, 4 in 2026-02-24T07:27:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:28 trial022 ceph-mon[39108]: pgmap v511: 65 pgs: 65 active+clean; 577 KiB data, 264 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:29.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:29 trial022 ceph-mon[39108]: osdmap e350: 4 total, 4 up, 4 in 2026-02-24T07:27:30.076 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4012 ms) 2026-02-24T07:27:30.077 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2026-02-24T07:27:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:30 trial022 ceph-mon[39108]: osdmap e351: 4 total, 4 up, 4 in 2026-02-24T07:27:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:30 trial022 ceph-mon[39108]: pgmap v514: 65 pgs: 65 active+clean; 577 KiB data, 264 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:31 trial022 ceph-mon[39108]: osdmap e352: 4 total, 4 up, 4 in 2026-02-24T07:27:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:31 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:27:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:27:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:27:30] "GET /metrics HTTP/1.1" 200 4488 "" "Prometheus/3.6.0" 2026-02-24T07:27:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:27:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:27:30.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:27:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:32 trial022 ceph-mon[39108]: osdmap e353: 4 total, 4 up, 4 in 2026-02-24T07:27:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:32 trial022 ceph-mon[39108]: pgmap v517: 65 pgs: 65 active+clean; 577 KiB data, 265 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 767 B/s wr, 1 op/s 2026-02-24T07:27:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:33 trial022 ceph-mon[39108]: osdmap e354: 4 total, 4 up, 4 in 2026-02-24T07:27:34.083 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (4006 ms) 2026-02-24T07:27:34.083 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2026-02-24T07:27:34.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:34 trial022 ceph-mon[39108]: osdmap e355: 4 total, 4 up, 4 in 2026-02-24T07:27:34.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:34 trial022 ceph-mon[39108]: pgmap v520: 65 pgs: 65 active+clean; 577 KiB data, 265 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 767 B/s wr, 1 op/s 2026-02-24T07:27:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:35 trial022 ceph-mon[39108]: osdmap e356: 4 total, 4 up, 4 in 2026-02-24T07:27:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:35 trial022 ceph-mon[39108]: osdmap e357: 4 total, 4 up, 4 in 2026-02-24T07:27:36.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:36 trial022 ceph-mon[39108]: osdmap e358: 4 total, 4 up, 4 in 2026-02-24T07:27:36.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:36 trial022 ceph-mon[39108]: pgmap v524: 65 pgs: 65 active+clean; 577 KiB data, 265 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:37.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:37 trial022 ceph-mon[39108]: osdmap e359: 4 total, 4 up, 4 in 2026-02-24T07:27:38.464 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (4381 ms) 2026-02-24T07:27:38.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:38 trial022 ceph-mon[39108]: osdmap e360: 4 total, 4 up, 4 in 2026-02-24T07:27:38.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:38 trial022 ceph-mon[39108]: pgmap v527: 65 pgs: 65 active+clean; 577 KiB data, 265 MiB used, 2.7 TiB / 2.7 TiB avail; 542 B/s rd, 814 B/s wr, 1 op/s 2026-02-24T07:27:39.460 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (12399 ms total) 2026-02-24T07:27:39.461 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.461 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2026-02-24T07:27:39.461 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:168: Skipped 2026-02-24T07:27:39.461 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:27:39.461 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.461 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2026-02-24T07:27:39.461 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots.cc:206: Skipped 2026-02-24T07:27:39.461 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.461 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots.cc:221: Skipped 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots.cc:234: Skipped 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots.cc:250: Skipped 2026-02-24T07:27:39.462 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:176: Skipped 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:168: Skipped 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-24T07:27:39.463 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots.cc:268: Skipped 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots.cc:319: Skipped 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:176: Skipped 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:27:39.464 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 13 tests from 4 test suites ran. (26406 ms total) 2026-02-24T07:27:39.465 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 7 tests. 2026-02-24T07:27:39.465 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 6 tests, listed below: 2026-02-24T07:27:39.465 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2026-02-24T07:27:39.465 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2026-02-24T07:27:39.465 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2026-02-24T07:27:39.465 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2026-02-24T07:27:39.465 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-24T07:27:39.465 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-24T07:27:39.466 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:27:39.466 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_snapshots_pp 2026-02-24T07:27:39.466 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:27:39.466 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:27:39.466 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_snapshots_pp 2026-02-24T07:27:39.477 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:27:39.478 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 21 tests from 5 test suites. 2026-02-24T07:27:39.478 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:27:39.478 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2026-02-24T07:27:39.478 INFO:tasks.workunit.client.0.trial022.stdout:seed 141162 2026-02-24T07:27:39.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:39 trial022 ceph-mon[39108]: osdmap e361: 4 total, 4 up, 4 in 2026-02-24T07:27:39.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:39 trial022 ceph-mon[39108]: osdmap e362: 4 total, 4 up, 4 in 2026-02-24T07:27:40.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:40 trial022 ceph-mon[39108]: pgmap v530: 33 pgs: 33 active+clean; 577 KiB data, 265 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:27:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:27:40] "GET /metrics HTTP/1.1" 200 4499 "" "Prometheus/3.6.0" 2026-02-24T07:27:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:27:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:27:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:27:41.470 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2026-02-24T07:27:41.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:41 trial022 ceph-mon[39108]: osdmap e363: 4 total, 4 up, 4 in 2026-02-24T07:27:41.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:41 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3945368641' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_trial022-141162-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:27:42.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3945368641' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_trial022-141162-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:27:42.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:42 trial022 ceph-mon[39108]: osdmap e364: 4 total, 4 up, 4 in 2026-02-24T07:27:42.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:42 trial022 ceph-mon[39108]: pgmap v533: 65 pgs: 65 active+clean; 577 KiB data, 265 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:43.472 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (2002 ms) 2026-02-24T07:27:43.472 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2026-02-24T07:27:43.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:43 trial022 ceph-mon[39108]: osdmap e365: 4 total, 4 up, 4 in 2026-02-24T07:27:44.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:44 trial022 ceph-mon[39108]: osdmap e366: 4 total, 4 up, 4 in 2026-02-24T07:27:44.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:44 trial022 ceph-mon[39108]: pgmap v536: 65 pgs: 65 active+clean; 577 KiB data, 265 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:27:45.476 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2003 ms) 2026-02-24T07:27:45.476 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2026-02-24T07:27:45.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:45 trial022 ceph-mon[39108]: osdmap e367: 4 total, 4 up, 4 in 2026-02-24T07:27:46.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:46 trial022 ceph-mon[39108]: osdmap e368: 4 total, 4 up, 4 in 2026-02-24T07:27:46.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:46 trial022 ceph-mon[39108]: pgmap v539: 65 pgs: 65 active+clean; 577 KiB data, 265 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:46.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:46 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:27:47.480 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2004 ms) 2026-02-24T07:27:47.480 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2026-02-24T07:27:47.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:47 trial022 ceph-mon[39108]: osdmap e369: 4 total, 4 up, 4 in 2026-02-24T07:27:48.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:48 trial022 ceph-mon[39108]: osdmap e370: 4 total, 4 up, 4 in 2026-02-24T07:27:48.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:48 trial022 ceph-mon[39108]: pgmap v542: 65 pgs: 65 active+clean; 577 KiB data, 265 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 767 B/s wr, 0 op/s 2026-02-24T07:27:49.458 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1977 ms) 2026-02-24T07:27:49.458 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2026-02-24T07:27:49.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:49 trial022 ceph-mon[39108]: osdmap e371: 4 total, 4 up, 4 in 2026-02-24T07:27:49.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:49 trial022 ceph-mon[39108]: osdmap e372: 4 total, 4 up, 4 in 2026-02-24T07:27:50.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:50 trial022 ceph-mon[39108]: pgmap v545: 65 pgs: 65 active+clean; 577 KiB data, 265 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 767 B/s wr, 0 op/s 2026-02-24T07:27:50.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:50 trial022 ceph-mon[39108]: osdmap e373: 4 total, 4 up, 4 in 2026-02-24T07:27:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:27:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:27:50] "GET /metrics HTTP/1.1" 200 4511 "" "Prometheus/3.6.0" 2026-02-24T07:27:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:27:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:27:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:27:52.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:52 trial022 ceph-mon[39108]: osdmap e374: 4 total, 4 up, 4 in 2026-02-24T07:27:52.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:52 trial022 ceph-mon[39108]: pgmap v548: 65 pgs: 65 active+clean; 577 KiB data, 266 MiB used, 2.7 TiB / 2.7 TiB avail; 511 B/s wr, 0 op/s 2026-02-24T07:27:53.461 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4002 ms) 2026-02-24T07:27:53.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:53 trial022 ceph-mon[39108]: osdmap e375: 4 total, 4 up, 4 in 2026-02-24T07:27:54.460 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 5 tests from LibRadosSnapshotsPP (11990 ms total) 2026-02-24T07:27:54.460 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:27:54.461 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2026-02-24T07:27:54.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:54 trial022 ceph-mon[39108]: osdmap e376: 4 total, 4 up, 4 in 2026-02-24T07:27:54.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:54 trial022 ceph-mon[39108]: pgmap v551: 65 pgs: 65 active+clean; 577 KiB data, 266 MiB used, 2.7 TiB / 2.7 TiB avail; 511 B/s wr, 0 op/s 2026-02-24T07:27:54.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:54 trial022 ceph-mon[39108]: osdmap e377: 4 total, 4 up, 4 in 2026-02-24T07:27:56.466 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2026-02-24T07:27:56.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:56 trial022 ceph-mon[39108]: osdmap e378: 4 total, 4 up, 4 in 2026-02-24T07:27:56.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:56 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2390870434' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_trial022-141162-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:27:56.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:56 trial022 ceph-mon[39108]: pgmap v554: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 266 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:57.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:57 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2390870434' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_trial022-141162-7","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:27:57.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:57 trial022 ceph-mon[39108]: osdmap e379: 4 total, 4 up, 4 in 2026-02-24T07:27:58.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:58 trial022 ceph-mon[39108]: osdmap e380: 4 total, 4 up, 4 in 2026-02-24T07:27:58.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:58 trial022 ceph-mon[39108]: pgmap v557: 65 pgs: 65 active+clean; 577 KiB data, 266 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:27:59.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:27:59 trial022 ceph-mon[39108]: osdmap e381: 4 total, 4 up, 4 in 2026-02-24T07:28:00.478 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4011 ms) 2026-02-24T07:28:00.478 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2026-02-24T07:28:00.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:00 trial022 ceph-mon[39108]: osdmap e382: 4 total, 4 up, 4 in 2026-02-24T07:28:00.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:00 trial022 ceph-mon[39108]: pgmap v560: 65 pgs: 65 active+clean; 577 KiB data, 266 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:28:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:28:00] "GET /metrics HTTP/1.1" 200 4511 "" "Prometheus/3.6.0" 2026-02-24T07:28:01.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:28:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:28:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:28:01.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:01 trial022 ceph-mon[39108]: osdmap e383: 4 total, 4 up, 4 in 2026-02-24T07:28:01.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:01 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:28:02.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:02 trial022 ceph-mon[39108]: osdmap e384: 4 total, 4 up, 4 in 2026-02-24T07:28:02.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:02 trial022 ceph-mon[39108]: pgmap v563: 65 pgs: 65 active+clean; 577 KiB data, 266 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 1.2 KiB/s wr, 1 op/s 2026-02-24T07:28:03.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:03 trial022 ceph-mon[39108]: osdmap e385: 4 total, 4 up, 4 in 2026-02-24T07:28:04.460 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3981 ms) 2026-02-24T07:28:04.460 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2026-02-24T07:28:04.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:04 trial022 ceph-mon[39108]: osdmap e386: 4 total, 4 up, 4 in 2026-02-24T07:28:04.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:04 trial022 ceph-mon[39108]: pgmap v566: 65 pgs: 65 active+clean; 577 KiB data, 266 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 1.2 KiB/s wr, 1 op/s 2026-02-24T07:28:04.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:04 trial022 ceph-mon[39108]: osdmap e387: 4 total, 4 up, 4 in 2026-02-24T07:28:06.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:06 trial022 ceph-mon[39108]: osdmap e388: 4 total, 4 up, 4 in 2026-02-24T07:28:06.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:06 trial022 ceph-mon[39108]: pgmap v569: 65 pgs: 65 active+clean; 577 KiB data, 266 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:07.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:07 trial022 ceph-mon[39108]: osdmap e389: 4 total, 4 up, 4 in 2026-02-24T07:28:08.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:08 trial022 ceph-mon[39108]: osdmap e390: 4 total, 4 up, 4 in 2026-02-24T07:28:08.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:08 trial022 ceph-mon[39108]: pgmap v572: 65 pgs: 65 active+clean; 579 KiB data, 266 MiB used, 2.7 TiB / 2.7 TiB avail; 767 B/s rd, 3.0 KiB/s wr, 4 op/s 2026-02-24T07:28:09.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:09 trial022 ceph-mon[39108]: osdmap e391: 4 total, 4 up, 4 in 2026-02-24T07:28:09.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:09 trial022 ceph-mon[39108]: osdmap e392: 4 total, 4 up, 4 in 2026-02-24T07:28:10.461 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6000 ms) 2026-02-24T07:28:10.461 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2026-02-24T07:28:10.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:10 trial022 ceph-mon[39108]: pgmap v575: 65 pgs: 65 active+clean; 579 KiB data, 266 MiB used, 2.7 TiB / 2.7 TiB avail; 767 B/s rd, 3.0 KiB/s wr, 4 op/s 2026-02-24T07:28:10.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:10 trial022 ceph-mon[39108]: osdmap e393: 4 total, 4 up, 4 in 2026-02-24T07:28:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:28:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:28:10] "GET /metrics HTTP/1.1" 200 4501 "" "Prometheus/3.6.0" 2026-02-24T07:28:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:28:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:28:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:28:12.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:12 trial022 ceph-mon[39108]: osdmap e394: 4 total, 4 up, 4 in 2026-02-24T07:28:12.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:12 trial022 ceph-mon[39108]: pgmap v578: 65 pgs: 65 active+clean; 1.6 MiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 257 KiB/s wr, 1 op/s 2026-02-24T07:28:13.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:13 trial022 ceph-mon[39108]: osdmap e395: 4 total, 4 up, 4 in 2026-02-24T07:28:14.461 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4000 ms) 2026-02-24T07:28:14.461 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2026-02-24T07:28:14.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:14 trial022 ceph-mon[39108]: osdmap e396: 4 total, 4 up, 4 in 2026-02-24T07:28:14.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:14 trial022 ceph-mon[39108]: pgmap v581: 65 pgs: 65 active+clean; 1.6 MiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 257 KiB/s wr, 1 op/s 2026-02-24T07:28:14.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:14 trial022 ceph-mon[39108]: osdmap e397: 4 total, 4 up, 4 in 2026-02-24T07:28:16.468 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2006 ms) 2026-02-24T07:28:16.468 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-24T07:28:16.468 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots_cxx.cc:460: Skipped 2026-02-24T07:28:16.468 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:16.469 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:16.469 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2026-02-24T07:28:16.469 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2026-02-24T07:28:16.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:16 trial022 ceph-mon[39108]: osdmap e398: 4 total, 4 up, 4 in 2026-02-24T07:28:16.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:16 trial022 ceph-mon[39108]: pgmap v584: 65 pgs: 65 active+clean; 1.6 MiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:16.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:28:17.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:17 trial022 ceph-mon[39108]: osdmap e399: 4 total, 4 up, 4 in 2026-02-24T07:28:18.466 INFO:tasks.workunit.client.0.trial022.stdout:deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_trial022-141162-7 2026-02-24T07:28:18.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:18 trial022 ceph-mon[39108]: osdmap e400: 4 total, 4 up, 4 in 2026-02-24T07:28:18.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:18 trial022 ceph-mon[39108]: pgmap v587: 65 pgs: 65 active+clean; 578 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 767 B/s wr, 1 op/s 2026-02-24T07:28:19.461 INFO:tasks.workunit.client.0.trial022.stdout:waiting for snaps to purge 2026-02-24T07:28:19.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:19 trial022 ceph-mon[39108]: osdmap e401: 4 total, 4 up, 4 in 2026-02-24T07:28:19.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:19 trial022 ceph-mon[39108]: osdmap e402: 4 total, 4 up, 4 in 2026-02-24T07:28:20.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:20 trial022 ceph-mon[39108]: pgmap v590: 65 pgs: 65 active+clean; 578 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 767 B/s wr, 1 op/s 2026-02-24T07:28:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:28:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:28:20] "GET /metrics HTTP/1.1" 200 4551 "" "Prometheus/3.6.0" 2026-02-24T07:28:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:28:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:28:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:28:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:22 trial022 ceph-mon[39108]: pgmap v591: 65 pgs: 65 active+clean; 579 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 759 B/s wr, 1 op/s 2026-02-24T07:28:24.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:28:24.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:28:24.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:28:24.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:28:24.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:28:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:24 trial022 ceph-mon[39108]: pgmap v592: 65 pgs: 65 active+clean; 579 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail; 160 B/s wr, 0 op/s 2026-02-24T07:28:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:24 trial022 ceph-mon[39108]: osdmap e403: 4 total, 4 up, 4 in 2026-02-24T07:28:27.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:26 trial022 ceph-mon[39108]: pgmap v594: 65 pgs: 65 active+clean; 579 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail; 138 B/s wr, 0 op/s 2026-02-24T07:28:29.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:28 trial022 ceph-mon[39108]: pgmap v595: 65 pgs: 65 active+clean; 579 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail; 121 B/s wr, 0 op/s 2026-02-24T07:28:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:30 trial022 ceph-mon[39108]: pgmap v596: 65 pgs: 65 active+clean; 579 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s wr, 0 op/s 2026-02-24T07:28:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:28:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:28:30] "GET /metrics HTTP/1.1" 200 4551 "" "Prometheus/3.6.0" 2026-02-24T07:28:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:28:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:28:30.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:28:32.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:31 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:28:33.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:32 trial022 ceph-mon[39108]: pgmap v597: 65 pgs: 65 active+clean; 579 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:34.462 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17994 ms) 2026-02-24T07:28:34.919 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (37996 ms total) 2026-02-24T07:28:34.920 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:34.920 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2026-02-24T07:28:34.920 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2026-02-24T07:28:34.922 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (3 ms) 2026-02-24T07:28:34.923 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2026-02-24T07:28:35.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:34 trial022 ceph-mon[39108]: pgmap v598: 65 pgs: 65 active+clean; 579 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:36.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:35 trial022 ceph-mon[39108]: osdmap e404: 4 total, 4 up, 4 in 2026-02-24T07:28:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:36 trial022 ceph-mon[39108]: pgmap v600: 33 pgs: 33 active+clean; 577 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:36 trial022 ceph-mon[39108]: osdmap e405: 4 total, 4 up, 4 in 2026-02-24T07:28:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:36 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2550460419' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-141162-15","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:28:38.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:37 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2550460419' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-141162-15","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:28:38.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:37 trial022 ceph-mon[39108]: osdmap e406: 4 total, 4 up, 4 in 2026-02-24T07:28:39.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:38 trial022 ceph-mon[39108]: pgmap v603: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:39.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:38 trial022 ceph-mon[39108]: osdmap e407: 4 total, 4 up, 4 in 2026-02-24T07:28:39.942 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5017 ms) 2026-02-24T07:28:39.942 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5020 ms total) 2026-02-24T07:28:39.942 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.942 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2026-02-24T07:28:39.942 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:371: Skipped 2026-02-24T07:28:39.942 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:39.942 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.942 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots_cxx.cc:595: Skipped 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots_cxx.cc:612: Skipped 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots_cxx.cc:626: Skipped 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.943 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots_cxx.cc:646: Skipped 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:379: Skipped 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:371: Skipped 2026-02-24T07:28:39.944 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots_cxx.cc:665: Skipped 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots_cxx.cc:713: Skipped 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/snapshots_cxx.cc:800: Skipped 2026-02-24T07:28:39.945 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.946 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2026-02-24T07:28:39.946 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:379: Skipped 2026-02-24T07:28:39.946 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:39.946 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.946 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2026-02-24T07:28:39.946 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:39.946 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:28:39.946 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 21 tests from 5 test suites ran. (60462 ms total) 2026-02-24T07:28:39.946 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 13 tests. 2026-02-24T07:28:39.946 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 8 tests, listed below: 2026-02-24T07:28:39.947 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-24T07:28:39.947 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2026-02-24T07:28:39.947 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-24T07:28:39.947 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2026-02-24T07:28:39.947 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-24T07:28:39.947 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-24T07:28:39.947 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-24T07:28:39.947 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-24T07:28:39.948 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:28:39.948 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_stat 2026-02-24T07:28:39.948 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:28:39.948 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:28:39.948 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_stat 2026-02-24T07:28:39.958 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:28:39.958 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 9 tests from 2 test suites. 2026-02-24T07:28:39.958 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:28:39.958 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 5 tests from LibRadosStat 2026-02-24T07:28:40.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:39 trial022 ceph-mon[39108]: osdmap e408: 4 total, 4 up, 4 in 2026-02-24T07:28:41.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:40 trial022 ceph-mon[39108]: pgmap v606: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:40 trial022 ceph-mon[39108]: osdmap e409: 4 total, 4 up, 4 in 2026-02-24T07:28:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:28:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:28:40] "GET /metrics HTTP/1.1" 200 4554 "" "Prometheus/3.6.0" 2026-02-24T07:28:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:28:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:28:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:28:41.934 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStat.Stat 2026-02-24T07:28:41.944 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosStat.Stat (10 ms) 2026-02-24T07:28:41.944 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStat.Stat2 2026-02-24T07:28:41.946 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosStat.Stat2 (2 ms) 2026-02-24T07:28:41.947 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStat.StatNS 2026-02-24T07:28:41.950 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosStat.StatNS (3 ms) 2026-02-24T07:28:41.950 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStat.ClusterStat 2026-02-24T07:28:41.950 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosStat.ClusterStat (0 ms) 2026-02-24T07:28:41.950 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStat.PoolStat 2026-02-24T07:28:41.951 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosStat.PoolStat (0 ms) 2026-02-24T07:28:42.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:41 trial022 ceph-mon[39108]: osdmap e410: 4 total, 4 up, 4 in 2026-02-24T07:28:42.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:41 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1408822358' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStat_trial022-141384-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:28:42.939 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 5 tests from LibRadosStat (17 ms total) 2026-02-24T07:28:42.939 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:42.939 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosStatEC 2026-02-24T07:28:42.939 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:168: Skipped 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatEC.Stat 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/stat.cc:96: Skipped 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatEC.StatNS 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/stat.cc:108: Skipped 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2026-02-24T07:28:42.940 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/stat.cc:135: Skipped 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatEC.PoolStat 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/stat.cc:141: Skipped 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:176: Skipped 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2026-02-24T07:28:42.941 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:42.942 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:28:42.942 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 9 tests from 2 test suites ran. (2979 ms total) 2026-02-24T07:28:42.942 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 5 tests. 2026-02-24T07:28:42.942 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 4 tests, listed below: 2026-02-24T07:28:42.942 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2026-02-24T07:28:42.942 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2026-02-24T07:28:42.942 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2026-02-24T07:28:42.942 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2026-02-24T07:28:42.943 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:28:42.943 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_stat_pp 2026-02-24T07:28:42.943 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:28:42.943 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:28:42.943 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_stat_pp 2026-02-24T07:28:42.955 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:28:42.955 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 9 tests from 2 test suites. 2026-02-24T07:28:42.955 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:28:42.955 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 5 tests from LibRadosStatPP 2026-02-24T07:28:42.955 INFO:tasks.workunit.client.0.trial022.stdout:seed 141403 2026-02-24T07:28:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:42 trial022 ceph-mon[39108]: pgmap v609: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1408822358' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_trial022-141384-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:28:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:42 trial022 ceph-mon[39108]: osdmap e411: 4 total, 4 up, 4 in 2026-02-24T07:28:44.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:43 trial022 ceph-mon[39108]: osdmap e412: 4 total, 4 up, 4 in 2026-02-24T07:28:44.946 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatPP.StatPP 2026-02-24T07:28:44.953 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosStatPP.StatPP (6 ms) 2026-02-24T07:28:44.953 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2026-02-24T07:28:44.954 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (1 ms) 2026-02-24T07:28:44.954 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2026-02-24T07:28:44.954 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2026-02-24T07:28:44.954 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2026-02-24T07:28:44.955 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosStatPP.PoolStatPP (0 ms) 2026-02-24T07:28:44.955 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2026-02-24T07:28:44.960 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosStatPP.StatPPNS (4 ms) 2026-02-24T07:28:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:44 trial022 ceph-mon[39108]: pgmap v612: 33 pgs: 33 active+clean; 577 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:44 trial022 ceph-mon[39108]: osdmap e413: 4 total, 4 up, 4 in 2026-02-24T07:28:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:44 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2631127450' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosStatPP_trial022-141403-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:28:45.950 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 5 tests from LibRadosStatPP (13 ms total) 2026-02-24T07:28:45.950 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:45.950 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosStatECPP 2026-02-24T07:28:45.950 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:371: Skipped 2026-02-24T07:28:45.950 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:45.950 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:45.951 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatECPP.StatPP 2026-02-24T07:28:45.951 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/stat_cxx.cc:75: Skipped 2026-02-24T07:28:45.951 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:45.951 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2026-02-24T07:28:45.951 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2026-02-24T07:28:45.951 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/stat_cxx.cc:89: Skipped 2026-02-24T07:28:45.951 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:45.951 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2026-02-24T07:28:45.951 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2026-02-24T07:28:45.951 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/stat_cxx.cc:95: Skipped 2026-02-24T07:28:45.952 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:45.952 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2026-02-24T07:28:45.952 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2026-02-24T07:28:45.952 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/stat_cxx.cc:139: Skipped 2026-02-24T07:28:45.952 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:45.952 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2026-02-24T07:28:45.952 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:379: Skipped 2026-02-24T07:28:45.952 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:45.952 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:45.952 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2026-02-24T07:28:45.953 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:45.953 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:28:45.953 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 9 tests from 2 test suites ran. (2993 ms total) 2026-02-24T07:28:45.953 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 5 tests. 2026-02-24T07:28:45.953 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 4 tests, listed below: 2026-02-24T07:28:45.953 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2026-02-24T07:28:45.953 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2026-02-24T07:28:45.953 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2026-02-24T07:28:45.953 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2026-02-24T07:28:45.954 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:28:45.954 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_watch_notify 2026-02-24T07:28:45.954 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:28:45.954 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:28:45.955 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_watch_notify 2026-02-24T07:28:45.965 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:28:45.965 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 11 tests from 2 test suites. 2026-02-24T07:28:45.966 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:28:45.966 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 10 tests from LibRadosWatchNotify 2026-02-24T07:28:46.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:45 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2631127450' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_trial022-141403-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:28:46.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:45 trial022 ceph-mon[39108]: osdmap e414: 4 total, 4 up, 4 in 2026-02-24T07:28:47.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:46 trial022 ceph-mon[39108]: pgmap v615: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 267 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:46 trial022 ceph-mon[39108]: osdmap e415: 4 total, 4 up, 4 in 2026-02-24T07:28:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:46 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:28:47.952 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2026-02-24T07:28:47.963 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify_test_cb 2026-02-24T07:28:47.965 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (12 ms) 2026-02-24T07:28:47.965 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2026-02-24T07:28:47.967 INFO:tasks.workunit.client.0.trial022.stdout:waiting up to 300 for disconnect notification ... 2026-02-24T07:28:47.967 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_errcb cookie 40282304 err -107 2026-02-24T07:28:48.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:47 trial022 ceph-mon[39108]: osdmap e416: 4 total, 4 up, 4 in 2026-02-24T07:28:48.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:47 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1879127865' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_trial022-141422-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:28:48.969 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (1003 ms) 2026-02-24T07:28:48.969 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2026-02-24T07:28:48.973 INFO:tasks.workunit.client.0.trial022.stdout:waiting up to 300 for disconnect notification ... 2026-02-24T07:28:48.973 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_errcb cookie 40286288 err -107 2026-02-24T07:28:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:48 trial022 ceph-mon[39108]: pgmap v618: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:48 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1879127865' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_trial022-141422-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:28:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:48 trial022 ceph-mon[39108]: osdmap e417: 4 total, 4 up, 4 in 2026-02-24T07:28:49.973 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (1004 ms) 2026-02-24T07:28:49.974 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2026-02-24T07:28:49.975 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_cb from 22731 notify_id 1795296329728 cookie 40286288 2026-02-24T07:28:49.976 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (3 ms) 2026-02-24T07:28:49.976 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2026-02-24T07:28:49.978 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_cb from 22731 notify_id 1795296329729 cookie 40302912 2026-02-24T07:28:49.979 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (2 ms) 2026-02-24T07:28:49.979 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2026-02-24T07:28:49.980 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_cb from 22731 notify_id 1795296329733 cookie 40298496 2026-02-24T07:28:49.981 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotify.AioNotify (2 ms) 2026-02-24T07:28:49.981 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2026-02-24T07:28:49.983 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_cb from 22731 notify_id 1795296329734 cookie 40298496 2026-02-24T07:28:49.983 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_cb from 22731 notify_id 1795296329734 cookie 40299632 2026-02-24T07:28:49.984 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (3 ms) 2026-02-24T07:28:49.984 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2026-02-24T07:28:49.987 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_cb from 22731 notify_id 1795296329728 cookie 40298448 2026-02-24T07:28:50.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:49 trial022 ceph-mon[39108]: osdmap e418: 4 total, 4 up, 4 in 2026-02-24T07:28:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:50 trial022 ceph-mon[39108]: pgmap v621: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:28:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:28:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:28:50] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-24T07:28:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:28:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:28:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:28:52.987 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_cb from 22731 notify_id 1795296329729 cookie 40298448 2026-02-24T07:28:52.988 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3003 ms) 2026-02-24T07:28:52.988 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2026-02-24T07:28:52.989 INFO:tasks.workunit.client.0.trial022.stdout:waiting up to 1024 for osd to time us out ... 2026-02-24T07:28:53.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:52 trial022 ceph-mon[39108]: pgmap v622: 65 pgs: 65 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail; 1.4 KiB/s wr, 1 op/s 2026-02-24T07:28:55.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:54 trial022 ceph-mon[39108]: pgmap v623: 65 pgs: 65 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail; 1.2 KiB/s wr, 1 op/s 2026-02-24T07:28:56.991 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_errcb cookie 40298448 err -107 2026-02-24T07:28:57.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:56 trial022 ceph-mon[39108]: pgmap v624: 65 pgs: 65 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail; 1023 B/s wr, 1 op/s 2026-02-24T07:28:57.992 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_cb from 22731 notify_id 1795296329736 cookie 40298448 2026-02-24T07:28:57.992 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5004 ms) 2026-02-24T07:28:57.993 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2026-02-24T07:28:57.995 INFO:tasks.workunit.client.0.trial022.stdout:waiting up to 30 for disconnect notification ... 2026-02-24T07:28:57.995 INFO:tasks.workunit.client.0.trial022.stdout:watch_notify2_test_errcb cookie 40298448 err -107 2026-02-24T07:28:58.996 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (1002 ms) 2026-02-24T07:28:59.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:28:58 trial022 ceph-mon[39108]: pgmap v625: 65 pgs: 65 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail; 929 B/s wr, 1 op/s 2026-02-24T07:28:59.962 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 10 tests from LibRadosWatchNotify (11043 ms total) 2026-02-24T07:28:59.962 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:59.963 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2026-02-24T07:28:59.963 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:168: Skipped 2026-02-24T07:28:59.963 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:59.963 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:59.963 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2026-02-24T07:28:59.963 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/watch_notify.cc:163: Skipped 2026-02-24T07:28:59.963 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:59.963 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2026-02-24T07:28:59.963 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/TestCase.cc:176: Skipped 2026-02-24T07:28:59.964 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:59.964 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:59.964 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2026-02-24T07:28:59.964 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:59.964 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:28:59.964 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 11 tests from 2 test suites ran. (13996 ms total) 2026-02-24T07:28:59.964 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 10 tests. 2026-02-24T07:28:59.964 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 1 test, listed below: 2026-02-24T07:28:59.964 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2026-02-24T07:28:59.965 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:28:59.965 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_watch_notify_pp 2026-02-24T07:28:59.965 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:28:59.965 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:28:59.966 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_watch_notify_pp 2026-02-24T07:28:59.979 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:28:59.980 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 16 tests from 2 test suites. 2026-02-24T07:28:59.980 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:28:59.980 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2026-02-24T07:28:59.980 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:371: Skipped 2026-02-24T07:28:59.980 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:59.980 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:59.980 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-24T07:28:59.980 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/watch_notify_cxx.cc:148: Skipped 2026-02-24T07:28:59.980 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:59.980 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2026-02-24T07:28:59.981 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-24T07:28:59.981 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/watch_notify_cxx.cc:197: Skipped 2026-02-24T07:28:59.981 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:59.981 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2026-02-24T07:28:59.981 INFO:tasks.workunit.client.0.trial022.stdout:/ceph/rpmbuild/BUILD/ceph-20.3.0-5440-gff63f3d9/src/test/librados/testcase_cxx.cc:379: Skipped 2026-02-24T07:28:59.981 INFO:tasks.workunit.client.0.trial022.stdout:Not supported by crimson yet. Skipped 2026-02-24T07:28:59.981 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:59.981 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2026-02-24T07:28:59.981 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:28:59.981 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2026-02-24T07:29:01.240 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:29:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:29:00] "GET /metrics HTTP/1.1" 200 4211 "" "Prometheus/3.6.0" 2026-02-24T07:29:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:00 trial022 ceph-mon[39108]: pgmap v626: 65 pgs: 65 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail; 844 B/s wr, 1 op/s 2026-02-24T07:29:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:00 trial022 ceph-mon[39108]: osdmap e419: 4 total, 4 up, 4 in 2026-02-24T07:29:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:29:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:29:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:29:01.967 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2026-02-24T07:29:01.975 INFO:tasks.workunit.client.0.trial022.stdout:notify 2026-02-24T07:29:01.977 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (10 ms) 2026-02-24T07:29:01.977 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2026-02-24T07:29:01.980 INFO:tasks.workunit.client.0.trial022.stdout:notify 2026-02-24T07:29:01.980 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3 ms) 2026-02-24T07:29:01.980 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2026-02-24T07:29:01.982 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (2 ms) 2026-02-24T07:29:01.982 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2026-02-24T07:29:01.984 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (1 ms) 2026-02-24T07:29:01.984 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2026-02-24T07:29:01.986 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 11408688 notify_id 1808181231619 notifier_gid 22733 2026-02-24T07:29:01.987 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (2 ms) 2026-02-24T07:29:01.987 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2026-02-24T07:29:01.988 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 11414080 notify_id 1808181231625 notifier_gid 22733 2026-02-24T07:29:01.989 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (2 ms) 2026-02-24T07:29:01.989 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2026-02-24T07:29:01.990 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 11411744 notify_id 1808181231626 notifier_gid 22733 2026-02-24T07:29:01.991 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (2 ms) 2026-02-24T07:29:01.991 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2026-02-24T07:29:01.992 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 11411744 notify_id 1808181231627 notifier_gid 22733 2026-02-24T07:29:01.993 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (2 ms) 2026-02-24T07:29:01.993 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2026-02-24T07:29:01.995 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 11411744 notify_id 1808181231619 notifier_gid 22733 2026-02-24T07:29:01.996 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (2 ms) 2026-02-24T07:29:01.996 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2026-02-24T07:29:01.997 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 11413856 notify_id 1808181231620 notifier_gid 22733 2026-02-24T07:29:01.998 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (2 ms) 2026-02-24T07:29:01.998 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2026-02-24T07:29:02.000 INFO:tasks.workunit.client.0.trial022.stdout: trying... 2026-02-24T07:29:02.000 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 11413856 notify_id 1808181231628 notifier_gid 22733 2026-02-24T07:29:02.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:01 trial022 ceph-mon[39108]: osdmap e420: 4 total, 4 up, 4 in 2026-02-24T07:29:02.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:01 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1516009844' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial022-141441-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:29:02.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:01 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:29:03.000 INFO:tasks.workunit.client.0.trial022.stdout: timed out 2026-02-24T07:29:03.001 INFO:tasks.workunit.client.0.trial022.stdout: flushing 2026-02-24T07:29:03.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:02 trial022 ceph-mon[39108]: pgmap v629: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:03.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:02 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1516009844' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial022-141441-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:29:03.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:02 trial022 ceph-mon[39108]: osdmap e421: 4 total, 4 up, 4 in 2026-02-24T07:29:04.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:03 trial022 ceph-mon[39108]: osdmap e422: 4 total, 4 up, 4 in 2026-02-24T07:29:05.000 INFO:tasks.workunit.client.0.trial022.stdout: flushed 2026-02-24T07:29:05.000 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3001 ms) 2026-02-24T07:29:05.000 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2026-02-24T07:29:05.001 INFO:tasks.workunit.client.0.trial022.stdout: trying... 2026-02-24T07:29:05.002 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 11418000 notify_id 1812476198925 notifier_gid 22733 2026-02-24T07:29:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:04 trial022 ceph-mon[39108]: pgmap v632: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:06.002 INFO:tasks.workunit.client.0.trial022.stdout: timed out 2026-02-24T07:29:06.003 INFO:tasks.workunit.client.0.trial022.stdout: flushing 2026-02-24T07:29:07.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:06 trial022 ceph-mon[39108]: pgmap v633: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:08.002 INFO:tasks.workunit.client.0.trial022.stdout: flushed 2026-02-24T07:29:08.003 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3002 ms) 2026-02-24T07:29:08.003 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2026-02-24T07:29:08.004 INFO:tasks.workunit.client.0.trial022.stdout:List watches 2026-02-24T07:29:08.005 INFO:tasks.workunit.client.0.trial022.stdout:notify2 2026-02-24T07:29:08.005 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 11418000 notify_id 1812476198917 notifier_gid 22733 2026-02-24T07:29:09.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:08 trial022 ceph-mon[39108]: pgmap v634: 65 pgs: 65 active+clean; 578 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 1.7 KiB/s wr, 3 op/s 2026-02-24T07:29:10.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:10 trial022 ceph-mon[39108]: pgmap v635: 65 pgs: 65 active+clean; 578 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 1.5 KiB/s wr, 2 op/s 2026-02-24T07:29:11.005 INFO:tasks.workunit.client.0.trial022.stdout:notify2 done 2026-02-24T07:29:11.005 INFO:tasks.workunit.client.0.trial022.stdout:watch_check 2026-02-24T07:29:11.005 INFO:tasks.workunit.client.0.trial022.stdout:unwatch2 2026-02-24T07:29:11.006 INFO:tasks.workunit.client.0.trial022.stdout: flushing 2026-02-24T07:29:11.006 INFO:tasks.workunit.client.0.trial022.stdout:done 2026-02-24T07:29:11.006 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3003 ms) 2026-02-24T07:29:11.006 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2026-02-24T07:29:11.007 INFO:tasks.workunit.client.0.trial022.stdout:List watches 2026-02-24T07:29:11.007 INFO:tasks.workunit.client.0.trial022.stdout:notify2 2026-02-24T07:29:11.008 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 11418000 notify_id 1812476198926 notifier_gid 22733 2026-02-24T07:29:11.240 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:29:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:29:10] "GET /metrics HTTP/1.1" 200 4504 "" "Prometheus/3.6.0" 2026-02-24T07:29:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:29:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:29:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:29:13.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:12 trial022 ceph-mon[39108]: pgmap v636: 65 pgs: 65 active+clean; 578 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 1.4 KiB/s wr, 2 op/s 2026-02-24T07:29:14.009 INFO:tasks.workunit.client.0.trial022.stdout:notify2 done 2026-02-24T07:29:14.009 INFO:tasks.workunit.client.0.trial022.stdout:watch_check 2026-02-24T07:29:14.009 INFO:tasks.workunit.client.0.trial022.stdout:unwatch2 2026-02-24T07:29:14.010 INFO:tasks.workunit.client.0.trial022.stdout: flushing 2026-02-24T07:29:14.010 INFO:tasks.workunit.client.0.trial022.stdout:done 2026-02-24T07:29:14.010 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3003 ms) 2026-02-24T07:29:14.919 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12042 ms total) 2026-02-24T07:29:14.920 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:14.920 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:29:14.920 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 16 tests from 2 test suites ran. (14940 ms total) 2026-02-24T07:29:14.920 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 14 tests. 2026-02-24T07:29:14.920 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] 2 tests, listed below: 2026-02-24T07:29:14.920 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-24T07:29:14.920 INFO:tasks.workunit.client.0.trial022.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-24T07:29:14.923 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:29:14.923 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_cmd 2026-02-24T07:29:14.923 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:29:14.923 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:29:14.923 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_cmd 2026-02-24T07:29:14.937 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:29:14.937 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 4 tests from 1 test suite. 2026-02-24T07:29:14.937 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:29:14.937 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosCmd 2026-02-24T07:29:14.937 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCmd.MonDescribe 2026-02-24T07:29:14.952 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCmd.MonDescribe (15 ms) 2026-02-24T07:29:14.952 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCmd.OSDCmd 2026-02-24T07:29:14.963 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCmd.OSDCmd (11 ms) 2026-02-24T07:29:14.963 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCmd.PGCmd 2026-02-24T07:29:15.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:14 trial022 ceph-mon[39108]: pgmap v637: 65 pgs: 65 active+clean; 578 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 1.3 KiB/s wr, 2 op/s 2026-02-24T07:29:16.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:15 trial022 ceph-mon[39108]: osdmap e423: 4 total, 4 up, 4 in 2026-02-24T07:29:16.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:15 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1889314259' entity='client.admin' cmd={"prefix":"quorum_status"} : dispatch 2026-02-24T07:29:17.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:16 trial022 ceph-mon[39108]: pgmap v639: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:16 trial022 ceph-mon[39108]: osdmap e424: 4 total, 4 up, 4 in 2026-02-24T07:29:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:16 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2228091212' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-141460-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:29:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:29:17.928 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCmd.PGCmd (2964 ms) 2026-02-24T07:29:17.928 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCmd.WatchLog 2026-02-24T07:29:17.939 INFO:tasks.workunit.client.0.trial022.stdout:got: 2026-02-24T07:29:16.923473+0000 mon.a [INF] from='client.? 10.20.193.22:0/2228091212' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-141460-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:29:18.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:17 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2228091212' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-141460-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:29:18.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:17 trial022 ceph-mon[39108]: osdmap e425: 4 total, 4 up, 4 in 2026-02-24T07:29:18.927 INFO:tasks.workunit.client.0.trial022.stdout:got: 2026-02-24T07:29:17.939236+0000 client.admin [INF] onexx 2026-02-24T07:29:18.927 INFO:tasks.workunit.client.0.trial022.stdout:got: 2026-02-24T07:29:17.939284+0000 mon.a [INF] from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-24T07:29:19.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:18 trial022 ceph-mon[39108]: pgmap v642: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:19.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:18 trial022 ceph-mon[39108]: osdmap e426: 4 total, 4 up, 4 in 2026-02-24T07:29:19.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:18 trial022 ceph-mon[39108]: onexx 2026-02-24T07:29:19.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:18 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-24T07:29:20.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:19 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2026-02-24T07:29:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:20 trial022 ceph-mon[39108]: pgmap v644: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:20 trial022 ceph-mon[39108]: twoxx 2026-02-24T07:29:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:20 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2026-02-24T07:29:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:29:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:29:20] "GET /metrics HTTP/1.1" 200 4481 "" "Prometheus/3.6.0" 2026-02-24T07:29:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:29:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:29:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:29:22.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:21 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2026-02-24T07:29:22.929 INFO:tasks.workunit.client.0.trial022.stdout:got: 2026-02-24T07:29:20.928698+0000 mon.a [INF] from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2026-02-24T07:29:22.930 INFO:tasks.workunit.client.0.trial022.stdout:got: 2026-02-24T07:29:22.928997+0000 client.admin [INF] threexx 2026-02-24T07:29:22.931 INFO:tasks.workunit.client.0.trial022.stdout:got: 2026-02-24T07:29:22.929074+0000 mon.a [INF] from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-24T07:29:23.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:22 trial022 ceph-mon[39108]: pgmap v645: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:23.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:22 trial022 ceph-mon[39108]: threexx 2026-02-24T07:29:23.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:22 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-24T07:29:24.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:23 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2026-02-24T07:29:24.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:23 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:29:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:24 trial022 ceph-mon[39108]: pgmap v646: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:24 trial022 ceph-mon[39108]: fourxx 2026-02-24T07:29:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:24 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd={"prefix":"log", "logtext":["fourxx"]} : dispatch 2026-02-24T07:29:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:29:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:29:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:29:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:29:26.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:25 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2763947994' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2026-02-24T07:29:26.934 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCmd.WatchLog (9005 ms) 2026-02-24T07:29:26.935 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosCmd (11996 ms total) 2026-02-24T07:29:26.935 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:26.935 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:29:26.935 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 4 tests from 1 test suite ran. (11996 ms total) 2026-02-24T07:29:26.935 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 4 tests. 2026-02-24T07:29:26.938 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:29:26.938 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_cmd_pp 2026-02-24T07:29:26.938 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:29:26.938 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:29:26.938 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_cmd_pp 2026-02-24T07:29:26.953 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:29:26.953 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 3 tests from 1 test suite. 2026-02-24T07:29:26.953 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:29:26.953 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from LibRadosCmd 2026-02-24T07:29:26.953 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2026-02-24T07:29:26.967 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCmd.MonDescribePP (14 ms) 2026-02-24T07:29:26.968 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2026-02-24T07:29:26.979 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCmd.OSDCmdPP (11 ms) 2026-02-24T07:29:26.979 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2026-02-24T07:29:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:26 trial022 ceph-mon[39108]: pgmap v647: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:28 trial022 ceph-mon[39108]: pgmap v648: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:28 trial022 ceph-mon[39108]: osdmap e427: 4 total, 4 up, 4 in 2026-02-24T07:29:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:28 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/561948557' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-141629-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:29:29.948 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCmd.PGCmdPP (2967 ms) 2026-02-24T07:29:29.948 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from LibRadosCmd (2994 ms total) 2026-02-24T07:29:29.948 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:29.948 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:29:29.948 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 3 tests from 1 test suite ran. (2994 ms total) 2026-02-24T07:29:29.948 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 3 tests. 2026-02-24T07:29:29.950 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:29:29.950 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_service 2026-02-24T07:29:29.951 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:29:29.951 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:29:29.951 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_service 2026-02-24T07:29:29.969 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 4 tests from 1 test suite. 2026-02-24T07:29:29.969 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:29:29.969 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosService 2026-02-24T07:29:29.970 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosService.RegisterEarly 2026-02-24T07:29:30.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:29 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/561948557' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-141629-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:29:30.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:29 trial022 ceph-mon[39108]: osdmap e428: 4 total, 4 up, 4 in 2026-02-24T07:29:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:30 trial022 ceph-mon[39108]: pgmap v651: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:30 trial022 ceph-mon[39108]: osdmap e429: 4 total, 4 up, 4 in 2026-02-24T07:29:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:29:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:29:30] "GET /metrics HTTP/1.1" 200 4481 "" "Prometheus/3.6.0" 2026-02-24T07:29:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:29:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:29:30.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:29:32.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:31 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:29:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:32 trial022 ceph-mon[39108]: pgmap v653: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:34.980 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosService.RegisterEarly (5011 ms) 2026-02-24T07:29:34.981 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosService.RegisterLate 2026-02-24T07:29:34.991 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosService.RegisterLate (11 ms) 2026-02-24T07:29:34.992 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosService.StatusFormat 2026-02-24T07:29:35.040 INFO:tasks.workunit.client.0.trial022.stdout: cluster: 2026-02-24T07:29:35.041 INFO:tasks.workunit.client.0.trial022.stdout: id: 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:29:35.041 INFO:tasks.workunit.client.0.trial022.stdout: health: HEALTH_OK 2026-02-24T07:29:35.041 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:35.041 INFO:tasks.workunit.client.0.trial022.stdout: services: 2026-02-24T07:29:35.041 INFO:tasks.workunit.client.0.trial022.stdout: mon: 1 daemons, quorum a (age 9m) [leader: a] 2026-02-24T07:29:35.041 INFO:tasks.workunit.client.0.trial022.stdout: mgr: x(active, since 8m) 2026-02-24T07:29:35.041 INFO:tasks.workunit.client.0.trial022.stdout: osd: 4 osds: 4 up (since 8m), 4 in (since 8m) 2026-02-24T07:29:35.041 INFO:tasks.workunit.client.0.trial022.stdout: laundry: 1 daemon active (1 hosts) 2026-02-24T07:29:35.041 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:35.041 INFO:tasks.workunit.client.0.trial022.stdout: data: 2026-02-24T07:29:35.042 INFO:tasks.workunit.client.0.trial022.stdout: pools: 2 pools, 33 pgs 2026-02-24T07:29:35.042 INFO:tasks.workunit.client.0.trial022.stdout: objects: 3 objects, 577 KiB 2026-02-24T07:29:35.042 INFO:tasks.workunit.client.0.trial022.stdout: usage: 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:35.042 INFO:tasks.workunit.client.0.trial022.stdout: pgs: 33 active+clean 2026-02-24T07:29:35.042 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:35.042 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:35.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:34 trial022 ceph-mon[39108]: pgmap v654: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:36.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:35 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1835064276' entity='client.admin' cmd={"prefix":"status"} : dispatch 2026-02-24T07:29:37.052 INFO:tasks.workunit.client.0.trial022.stdout: cluster: 2026-02-24T07:29:37.052 INFO:tasks.workunit.client.0.trial022.stdout: id: 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:29:37.052 INFO:tasks.workunit.client.0.trial022.stdout: health: HEALTH_OK 2026-02-24T07:29:37.052 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: services: 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: mon: 1 daemons, quorum a (age 9m) [leader: a] 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: mgr: x(active, since 8m) 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: osd: 4 osds: 4 up (since 8m), 4 in (since 8m) 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: foo: 16 portals active (1 hosts, 3 zones) 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: data: 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: pools: 2 pools, 33 pgs 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: objects: 3 objects, 577 KiB 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: usage: 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:37.053 INFO:tasks.workunit.client.0.trial022.stdout: pgs: 33 active+clean 2026-02-24T07:29:37.054 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:37.054 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:37.064 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosService.StatusFormat (2072 ms) 2026-02-24T07:29:37.064 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosService.Status 2026-02-24T07:29:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:36 trial022 ceph-mon[39108]: pgmap v655: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:38.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:37 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3110240124' entity='client.admin' cmd={"prefix":"status"} : dispatch 2026-02-24T07:29:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:38 trial022 ceph-mon[39108]: pgmap v656: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:40 trial022 ceph-mon[39108]: pgmap v657: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:29:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:29:40] "GET /metrics HTTP/1.1" 200 4219 "" "Prometheus/3.6.0" 2026-02-24T07:29:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:29:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:29:40.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:29:43.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:42 trial022 ceph-mon[39108]: pgmap v658: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:44 trial022 ceph-mon[39108]: pgmap v659: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:46 trial022 ceph-mon[39108]: pgmap v660: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:46 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:29:49.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:48 trial022 ceph-mon[39108]: pgmap v661: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:50 trial022 ceph-mon[39108]: pgmap v662: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:29:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:29:50] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:29:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:29:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:29:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:29:53.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:52 trial022 ceph-mon[39108]: pgmap v663: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:55.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:54 trial022 ceph-mon[39108]: pgmap v664: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:57.077 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosService.Status (20011 ms) 2026-02-24T07:29:57.077 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosService (27107 ms total) 2026-02-24T07:29:57.077 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:29:57.077 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:29:57.077 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 4 tests from 1 test suite ran. (27107 ms total) 2026-02-24T07:29:57.077 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 4 tests. 2026-02-24T07:29:57.082 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:29:57.082 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_service_pp 2026-02-24T07:29:57.082 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:29:57.082 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:29:57.083 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_service_pp 2026-02-24T07:29:57.101 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 4 tests from 1 test suite. 2026-02-24T07:29:57.101 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:29:57.101 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosServicePP 2026-02-24T07:29:57.102 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2026-02-24T07:29:57.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:56 trial022 ceph-mon[39108]: pgmap v665: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:29:59.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:29:58 trial022 ceph-mon[39108]: pgmap v666: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:00 trial022 ceph-mon[39108]: pgmap v667: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:30:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:30:00] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:30:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:30:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:30:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:30:02.113 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5012 ms) 2026-02-24T07:30:02.114 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2026-02-24T07:30:02.131 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosServicePP.RegisterLate (17 ms) 2026-02-24T07:30:02.131 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosServicePP.Status 2026-02-24T07:30:02.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:01 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:30:03.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:02 trial022 ceph-mon[39108]: pgmap v668: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:05.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:04 trial022 ceph-mon[39108]: pgmap v669: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:07.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:06 trial022 ceph-mon[39108]: pgmap v670: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:09.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:08 trial022 ceph-mon[39108]: pgmap v671: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:11.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:10 trial022 ceph-mon[39108]: pgmap v672: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:30:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:30:10] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:30:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:30:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:30:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:30:13.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:12 trial022 ceph-mon[39108]: pgmap v673: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:15.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:14 trial022 ceph-mon[39108]: pgmap v674: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:16 trial022 ceph-mon[39108]: pgmap v675: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:16 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:30:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:18 trial022 ceph-mon[39108]: pgmap v676: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:20 trial022 ceph-mon[39108]: pgmap v677: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:30:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:30:20] "GET /metrics HTTP/1.1" 200 4223 "" "Prometheus/3.6.0" 2026-02-24T07:30:21.285 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:30:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:30:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:30:22.143 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosServicePP.Status (20012 ms) 2026-02-24T07:30:22.143 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosServicePP.Close 2026-02-24T07:30:22.143 INFO:tasks.workunit.client.0.trial022.stdout:attempt 0 of 20 2026-02-24T07:30:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:22 trial022 ceph-mon[39108]: pgmap v678: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:24 trial022 ceph-mon[39108]: pgmap v679: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:30:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:30:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:30:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:30:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:30:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:30:25.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:24 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:30:27.167 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosServicePP.Close (5023 ms) 2026-02-24T07:30:27.167 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from LibRadosServicePP (30066 ms total) 2026-02-24T07:30:27.167 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:30:27.167 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:30:27.168 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 4 tests from 1 test suite ran. (30066 ms total) 2026-02-24T07:30:27.168 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 4 tests. 2026-02-24T07:30:27.169 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:30:27.169 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_c_write_operations 2026-02-24T07:30:27.169 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:30:27.170 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:30:27.170 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_c_write_operations 2026-02-24T07:30:27.184 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:30:27.184 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 8 tests from 2 test suites. 2026-02-24T07:30:27.184 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:30:27.185 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibradosCWriteOps 2026-02-24T07:30:27.185 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2026-02-24T07:30:27.185 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2026-02-24T07:30:27.185 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2026-02-24T07:30:27.185 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:30:27.185 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 7 tests from LibRadosCWriteOps 2026-02-24T07:30:27.185 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2026-02-24T07:30:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:26 trial022 ceph-mon[39108]: pgmap v680: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:28.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:27 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3362650942' entity='client.admin' cmd={"prefix": "service dump"} : dispatch 2026-02-24T07:30:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:28 trial022 ceph-mon[39108]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2026-02-24T07:30:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:28 trial022 ceph-mon[39108]: pgmap v681: 33 pgs: 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:28 trial022 ceph-mon[39108]: osdmap e430: 4 total, 4 up, 4 in 2026-02-24T07:30:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:28 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4006556717' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:30:29.984 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCWriteOps.assertExists (2799 ms) 2026-02-24T07:30:29.984 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2026-02-24T07:30:30.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:29 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/4006556717' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:30:30.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:29 trial022 ceph-mon[39108]: osdmap e431: 4 total, 4 up, 4 in 2026-02-24T07:30:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:30 trial022 ceph-mon[39108]: pgmap v684: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 268 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:30 trial022 ceph-mon[39108]: osdmap e432: 4 total, 4 up, 4 in 2026-02-24T07:30:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:30:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:30:30] "GET /metrics HTTP/1.1" 200 4223 "" "Prometheus/3.6.0" 2026-02-24T07:30:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:30:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:30:30.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:30:32.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:31 trial022 ceph-mon[39108]: osdmap e433: 4 total, 4 up, 4 in 2026-02-24T07:30:32.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:31 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/336488991' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:30:32.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:31 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:30:32.991 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3007 ms) 2026-02-24T07:30:32.991 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2026-02-24T07:30:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:32 trial022 ceph-mon[39108]: pgmap v687: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 269 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:32 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/336488991' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:30:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:32 trial022 ceph-mon[39108]: osdmap e434: 4 total, 4 up, 4 in 2026-02-24T07:30:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:33 trial022 ceph-mon[39108]: osdmap e435: 4 total, 4 up, 4 in 2026-02-24T07:30:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:34 trial022 ceph-mon[39108]: pgmap v690: 33 pgs: 33 active+clean; 577 KiB data, 269 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:34 trial022 ceph-mon[39108]: osdmap e436: 4 total, 4 up, 4 in 2026-02-24T07:30:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:34 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2662453977' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:30:35.998 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3006 ms) 2026-02-24T07:30:35.999 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCWriteOps.Write 2026-02-24T07:30:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:35 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2662453977' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:30:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:35 trial022 ceph-mon[39108]: osdmap e437: 4 total, 4 up, 4 in 2026-02-24T07:30:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:36 trial022 ceph-mon[39108]: pgmap v693: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 269 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:36 trial022 ceph-mon[39108]: osdmap e438: 4 total, 4 up, 4 in 2026-02-24T07:30:38.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:37 trial022 ceph-mon[39108]: osdmap e439: 4 total, 4 up, 4 in 2026-02-24T07:30:38.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:37 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3261988494' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:30:39.005 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCWriteOps.Write (3006 ms) 2026-02-24T07:30:39.005 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCWriteOps.Exec 2026-02-24T07:30:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:39 trial022 ceph-mon[39108]: pgmap v696: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 269 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:39 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3261988494' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-4","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:30:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:39 trial022 ceph-mon[39108]: osdmap e440: 4 total, 4 up, 4 in 2026-02-24T07:30:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:40 trial022 ceph-mon[39108]: osdmap e441: 4 total, 4 up, 4 in 2026-02-24T07:30:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:41 trial022 ceph-mon[39108]: pgmap v699: 33 pgs: 33 active+clean; 577 KiB data, 269 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:41 trial022 ceph-mon[39108]: osdmap e442: 4 total, 4 up, 4 in 2026-02-24T07:30:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:41 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1986676911' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-5","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:30:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:30:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:30:40] "GET /metrics HTTP/1.1" 200 4477 "" "Prometheus/3.6.0" 2026-02-24T07:30:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:30:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:30:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:30:42.012 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCWriteOps.Exec (3007 ms) 2026-02-24T07:30:42.012 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2026-02-24T07:30:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1986676911' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-5","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:30:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:42 trial022 ceph-mon[39108]: osdmap e443: 4 total, 4 up, 4 in 2026-02-24T07:30:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:43 trial022 ceph-mon[39108]: pgmap v702: 65 pgs: 65 active+clean; 577 KiB data, 269 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2026-02-24T07:30:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:43 trial022 ceph-mon[39108]: osdmap e444: 4 total, 4 up, 4 in 2026-02-24T07:30:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:44 trial022 ceph-mon[39108]: osdmap e445: 4 total, 4 up, 4 in 2026-02-24T07:30:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:44 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1385075786' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-6","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:30:45.018 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCWriteOps.WriteSame (3006 ms) 2026-02-24T07:30:45.018 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2026-02-24T07:30:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:45 trial022 ceph-mon[39108]: pgmap v705: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 269 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:45 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1385075786' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-6","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:30:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:45 trial022 ceph-mon[39108]: osdmap e446: 4 total, 4 up, 4 in 2026-02-24T07:30:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:46 trial022 ceph-mon[39108]: osdmap e447: 4 total, 4 up, 4 in 2026-02-24T07:30:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:46 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2026-02-24T07:30:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:47 trial022 ceph-mon[39108]: pgmap v708: 33 pgs: 33 active+clean; 577 KiB data, 269 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:47 trial022 ceph-mon[39108]: osdmap e448: 4 total, 4 up, 4 in 2026-02-24T07:30:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:47 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3847313756' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-7","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:30:48.030 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] LibRadosCWriteOps.CmpExt (3011 ms) 2026-02-24T07:30:48.030 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 7 tests from LibRadosCWriteOps (20845 ms total) 2026-02-24T07:30:48.030 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:30:48.030 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:30:48.030 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 8 tests from 2 test suites ran. (20845 ms total) 2026-02-24T07:30:48.030 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 8 tests. 2026-02-24T07:30:48.032 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:30:48.032 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_api_c_read_operations 2026-02-24T07:30:48.032 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:30:48.032 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:30:48.032 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_api_c_read_operations 2026-02-24T07:30:48.046 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:30:48.046 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 17 tests from 1 test suite. 2026-02-24T07:30:48.046 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:30:48.046 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 17 tests from CReadOpsTest 2026-02-24T07:30:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:48 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3847313756' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial022-142271-7","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:30:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:48 trial022 ceph-mon[39108]: osdmap e449: 4 total, 4 up, 4 in 2026-02-24T07:30:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:49 trial022 ceph-mon[39108]: pgmap v711: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 269 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:49 trial022 ceph-mon[39108]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-24T07:30:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:49 trial022 ceph-mon[39108]: osdmap e450: 4 total, 4 up, 4 in 2026-02-24T07:30:50.034 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.NewDelete 2026-02-24T07:30:50.034 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2026-02-24T07:30:50.034 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2026-02-24T07:30:50.044 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.SetOpFlags (10 ms) 2026-02-24T07:30:50.044 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.AssertExists 2026-02-24T07:30:50.046 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.AssertExists (2 ms) 2026-02-24T07:30:50.046 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.AssertVersion 2026-02-24T07:30:50.049 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.AssertVersion (2 ms) 2026-02-24T07:30:50.049 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.CmpXattr 2026-02-24T07:30:50.057 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.CmpXattr (8 ms) 2026-02-24T07:30:50.057 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.Read 2026-02-24T07:30:50.059 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.Read (2 ms) 2026-02-24T07:30:50.059 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.Checksum 2026-02-24T07:30:50.061 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.Checksum (2 ms) 2026-02-24T07:30:50.061 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2026-02-24T07:30:50.063 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.RWOrderedRead (1 ms) 2026-02-24T07:30:50.063 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.ShortRead 2026-02-24T07:30:50.065 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.ShortRead (2 ms) 2026-02-24T07:30:50.065 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.Exec 2026-02-24T07:30:50.066 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.Exec (1 ms) 2026-02-24T07:30:50.066 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2026-02-24T07:30:50.068 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.ExecUserBuf (2 ms) 2026-02-24T07:30:50.068 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.Stat 2026-02-24T07:30:50.070 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.Stat (2 ms) 2026-02-24T07:30:50.071 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.Stat2 2026-02-24T07:30:50.072 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.Stat2 (1 ms) 2026-02-24T07:30:50.072 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.Omap 2026-02-24T07:30:50.077 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.Omap (5 ms) 2026-02-24T07:30:50.077 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.OmapNuls 2026-02-24T07:30:50.082 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.OmapNuls (4 ms) 2026-02-24T07:30:50.082 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.GetXattrs 2026-02-24T07:30:50.086 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.GetXattrs (4 ms) 2026-02-24T07:30:50.086 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] CReadOpsTest.CmpExt 2026-02-24T07:30:50.088 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] CReadOpsTest.CmpExt (1 ms) 2026-02-24T07:30:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:50 trial022 ceph-mon[39108]: osdmap e451: 4 total, 4 up, 4 in 2026-02-24T07:30:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:50 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1706501569' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "CReadOpsTest_trial022-142392-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T07:30:51.037 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 17 tests from CReadOpsTest (54 ms total) 2026-02-24T07:30:51.037 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:30:51.037 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:30:51.037 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 17 tests from 1 test suite ran. (2990 ms total) 2026-02-24T07:30:51.038 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 17 tests. 2026-02-24T07:30:51.040 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:30:51.040 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_list_parallel 2026-02-24T07:30:51.040 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:30:51.040 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:30:51.040 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_list_parallel 2026-02-24T07:30:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:30:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:30:50] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:30:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:51 trial022 ceph-mon[39108]: pgmap v714: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 269 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:51 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1706501569' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_trial022-142392-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T07:30:51.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:51 trial022 ceph-mon[39108]: osdmap e452: 4 total, 4 up, 4 in 2026-02-24T07:30:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:30:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:30:50.955Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:30:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:52 trial022 ceph-mon[39108]: osdmap e453: 4 total, 4 up, 4 in 2026-02-24T07:30:53.090 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142412]: starting. 2026-02-24T07:30:53.090 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142412]: creating pool ceph_test_rados_list_parallel.trial022-142411 2026-02-24T07:30:53.090 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142412]: created object 0... 2026-02-24T07:30:53.090 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142412]: created object 25... 2026-02-24T07:30:53.090 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142412]: created object 49... 2026-02-24T07:30:53.090 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142412]: finishing. 2026-02-24T07:30:53.090 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142412]: shutting down. 2026-02-24T07:30:53.097 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142413]: starting. 2026-02-24T07:30:53.097 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142413]: listing objects. 2026-02-24T07:30:53.097 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142413]: listed object 0... 2026-02-24T07:30:53.098 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142413]: listed object 25... 2026-02-24T07:30:53.098 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142413]: saw 50 objects 2026-02-24T07:30:53.098 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142413]: shutting down. 2026-02-24T07:30:53.147 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.148 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142446]: starting. 2026-02-24T07:30:53.148 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142446]: creating pool ceph_test_rados_list_parallel.trial022-142411 2026-02-24T07:30:53.148 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142446]: created object 0... 2026-02-24T07:30:53.148 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142446]: created object 25... 2026-02-24T07:30:53.148 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142446]: created object 49... 2026-02-24T07:30:53.148 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142446]: finishing. 2026-02-24T07:30:53.148 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142446]: shutting down. 2026-02-24T07:30:53.165 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.165 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142447]: starting. 2026-02-24T07:30:53.165 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142447]: listing objects. 2026-02-24T07:30:53.165 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142447]: listed object 0... 2026-02-24T07:30:53.165 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142447]: listed object 25... 2026-02-24T07:30:53.165 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142447]: saw 42 objects 2026-02-24T07:30:53.165 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142447]: shutting down. 2026-02-24T07:30:53.180 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.180 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142448]: starting. 2026-02-24T07:30:53.180 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142448]: removed 25 objects... 2026-02-24T07:30:53.180 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142448]: removed half of the objects 2026-02-24T07:30:53.180 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142448]: removed 50 objects... 2026-02-24T07:30:53.180 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142448]: removed 50 objects 2026-02-24T07:30:53.181 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142448]: shutting down. 2026-02-24T07:30:53.230 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.230 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.230 INFO:tasks.workunit.client.0.trial022.stdout:process_6_[142494]: starting. 2026-02-24T07:30:53.230 INFO:tasks.workunit.client.0.trial022.stdout:process_6_[142494]: creating pool ceph_test_rados_list_parallel.trial022-142411 2026-02-24T07:30:53.230 INFO:tasks.workunit.client.0.trial022.stdout:process_6_[142494]: created object 0... 2026-02-24T07:30:53.230 INFO:tasks.workunit.client.0.trial022.stdout:process_6_[142494]: created object 25... 2026-02-24T07:30:53.230 INFO:tasks.workunit.client.0.trial022.stdout:process_6_[142494]: created object 49... 2026-02-24T07:30:53.230 INFO:tasks.workunit.client.0.trial022.stdout:process_6_[142494]: finishing. 2026-02-24T07:30:53.231 INFO:tasks.workunit.client.0.trial022.stdout:process_6_[142494]: shutting down. 2026-02-24T07:30:53.250 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.251 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.251 INFO:tasks.workunit.client.0.trial022.stdout:process_7_[142495]: starting. 2026-02-24T07:30:53.251 INFO:tasks.workunit.client.0.trial022.stdout:process_7_[142495]: listing objects. 2026-02-24T07:30:53.251 INFO:tasks.workunit.client.0.trial022.stdout:process_7_[142495]: listed object 0... 2026-02-24T07:30:53.251 INFO:tasks.workunit.client.0.trial022.stdout:process_7_[142495]: listed object 25... 2026-02-24T07:30:53.251 INFO:tasks.workunit.client.0.trial022.stdout:process_7_[142495]: listed object 50... 2026-02-24T07:30:53.251 INFO:tasks.workunit.client.0.trial022.stdout:process_7_[142495]: saw 55 objects 2026-02-24T07:30:53.251 INFO:tasks.workunit.client.0.trial022.stdout:process_7_[142495]: shutting down. 2026-02-24T07:30:53.267 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.267 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.267 INFO:tasks.workunit.client.0.trial022.stdout:process_8_[142496]: starting. 2026-02-24T07:30:53.267 INFO:tasks.workunit.client.0.trial022.stdout:process_8_[142496]: added 25 objects... 2026-02-24T07:30:53.267 INFO:tasks.workunit.client.0.trial022.stdout:process_8_[142496]: added half of the objects 2026-02-24T07:30:53.267 INFO:tasks.workunit.client.0.trial022.stdout:process_8_[142496]: added 50 objects... 2026-02-24T07:30:53.268 INFO:tasks.workunit.client.0.trial022.stdout:process_8_[142496]: added 50 objects 2026-02-24T07:30:53.268 INFO:tasks.workunit.client.0.trial022.stdout:process_8_[142496]: shutting down. 2026-02-24T07:30:53.317 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.317 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.318 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.318 INFO:tasks.workunit.client.0.trial022.stdout:process_9_[142542]: starting. 2026-02-24T07:30:53.318 INFO:tasks.workunit.client.0.trial022.stdout:process_9_[142542]: creating pool ceph_test_rados_list_parallel.trial022-142411 2026-02-24T07:30:53.318 INFO:tasks.workunit.client.0.trial022.stdout:process_9_[142542]: created object 0... 2026-02-24T07:30:53.318 INFO:tasks.workunit.client.0.trial022.stdout:process_9_[142542]: created object 25... 2026-02-24T07:30:53.318 INFO:tasks.workunit.client.0.trial022.stdout:process_9_[142542]: created object 49... 2026-02-24T07:30:53.318 INFO:tasks.workunit.client.0.trial022.stdout:process_9_[142542]: finishing. 2026-02-24T07:30:53.318 INFO:tasks.workunit.client.0.trial022.stdout:process_9_[142542]: shutting down. 2026-02-24T07:30:53.339 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.339 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.339 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.339 INFO:tasks.workunit.client.0.trial022.stdout:process_10_[142543]: starting. 2026-02-24T07:30:53.339 INFO:tasks.workunit.client.0.trial022.stdout:process_10_[142543]: listing objects. 2026-02-24T07:30:53.339 INFO:tasks.workunit.client.0.trial022.stdout:process_10_[142543]: listed object 0... 2026-02-24T07:30:53.339 INFO:tasks.workunit.client.0.trial022.stdout:process_10_[142543]: listed object 25... 2026-02-24T07:30:53.339 INFO:tasks.workunit.client.0.trial022.stdout:process_10_[142543]: listed object 50... 2026-02-24T07:30:53.340 INFO:tasks.workunit.client.0.trial022.stdout:process_10_[142543]: listed object 75... 2026-02-24T07:30:53.340 INFO:tasks.workunit.client.0.trial022.stdout:process_10_[142543]: saw 96 objects 2026-02-24T07:30:53.340 INFO:tasks.workunit.client.0.trial022.stdout:process_10_[142543]: shutting down. 2026-02-24T07:30:53.357 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.357 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.357 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.357 INFO:tasks.workunit.client.0.trial022.stdout:process_13_[142546]: starting. 2026-02-24T07:30:53.357 INFO:tasks.workunit.client.0.trial022.stdout:process_13_[142546]: removed 25 objects... 2026-02-24T07:30:53.357 INFO:tasks.workunit.client.0.trial022.stdout:process_13_[142546]: removed half of the objects 2026-02-24T07:30:53.357 INFO:tasks.workunit.client.0.trial022.stdout:process_13_[142546]: removed 50 objects... 2026-02-24T07:30:53.357 INFO:tasks.workunit.client.0.trial022.stdout:process_13_[142546]: removed 50 objects 2026-02-24T07:30:53.357 INFO:tasks.workunit.client.0.trial022.stdout:process_13_[142546]: shutting down. 2026-02-24T07:30:53.359 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.359 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.359 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.359 INFO:tasks.workunit.client.0.trial022.stdout:process_11_[142544]: starting. 2026-02-24T07:30:53.359 INFO:tasks.workunit.client.0.trial022.stdout:process_11_[142544]: added 25 objects... 2026-02-24T07:30:53.359 INFO:tasks.workunit.client.0.trial022.stdout:process_11_[142544]: added half of the objects 2026-02-24T07:30:53.359 INFO:tasks.workunit.client.0.trial022.stdout:process_11_[142544]: added 50 objects... 2026-02-24T07:30:53.360 INFO:tasks.workunit.client.0.trial022.stdout:process_11_[142544]: added 50 objects 2026-02-24T07:30:53.360 INFO:tasks.workunit.client.0.trial022.stdout:process_11_[142544]: shutting down. 2026-02-24T07:30:53.360 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.360 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.360 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.360 INFO:tasks.workunit.client.0.trial022.stdout:process_12_[142545]: starting. 2026-02-24T07:30:53.360 INFO:tasks.workunit.client.0.trial022.stdout:process_12_[142545]: added 25 objects... 2026-02-24T07:30:53.361 INFO:tasks.workunit.client.0.trial022.stdout:process_12_[142545]: added half of the objects 2026-02-24T07:30:53.361 INFO:tasks.workunit.client.0.trial022.stdout:process_12_[142545]: added 50 objects... 2026-02-24T07:30:53.361 INFO:tasks.workunit.client.0.trial022.stdout:process_12_[142545]: added 50 objects 2026-02-24T07:30:53.361 INFO:tasks.workunit.client.0.trial022.stdout:process_12_[142545]: shutting down. 2026-02-24T07:30:53.411 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.411 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.411 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.411 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.411 INFO:tasks.workunit.client.0.trial022.stdout:process_14_[142622]: starting. 2026-02-24T07:30:53.411 INFO:tasks.workunit.client.0.trial022.stdout:process_14_[142622]: creating pool ceph_test_rados_list_parallel.trial022-142411 2026-02-24T07:30:53.411 INFO:tasks.workunit.client.0.trial022.stdout:process_14_[142622]: created object 0... 2026-02-24T07:30:53.412 INFO:tasks.workunit.client.0.trial022.stdout:process_14_[142622]: created object 25... 2026-02-24T07:30:53.412 INFO:tasks.workunit.client.0.trial022.stdout:process_14_[142622]: created object 49... 2026-02-24T07:30:53.412 INFO:tasks.workunit.client.0.trial022.stdout:process_14_[142622]: finishing. 2026-02-24T07:30:53.412 INFO:tasks.workunit.client.0.trial022.stdout:process_14_[142622]: shutting down. 2026-02-24T07:30:53.431 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.431 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.431 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.431 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.431 INFO:tasks.workunit.client.0.trial022.stdout:process_15_[142623]: starting. 2026-02-24T07:30:53.431 INFO:tasks.workunit.client.0.trial022.stdout:process_15_[142623]: listing objects. 2026-02-24T07:30:53.431 INFO:tasks.workunit.client.0.trial022.stdout:process_15_[142623]: listed object 0... 2026-02-24T07:30:53.431 INFO:tasks.workunit.client.0.trial022.stdout:process_15_[142623]: listed object 25... 2026-02-24T07:30:53.432 INFO:tasks.workunit.client.0.trial022.stdout:process_15_[142623]: listed object 50... 2026-02-24T07:30:53.432 INFO:tasks.workunit.client.0.trial022.stdout:process_15_[142623]: listed object 75... 2026-02-24T07:30:53.432 INFO:tasks.workunit.client.0.trial022.stdout:process_15_[142623]: listed object 100... 2026-02-24T07:30:53.432 INFO:tasks.workunit.client.0.trial022.stdout:process_15_[142623]: listed object 125... 2026-02-24T07:30:53.432 INFO:tasks.workunit.client.0.trial022.stdout:process_15_[142623]: saw 150 objects 2026-02-24T07:30:53.432 INFO:tasks.workunit.client.0.trial022.stdout:process_15_[142623]: shutting down. 2026-02-24T07:30:53.448 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.449 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.449 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.449 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:53.449 INFO:tasks.workunit.client.0.trial022.stdout:process_16_[142624]: starting. 2026-02-24T07:30:53.449 INFO:tasks.workunit.client.0.trial022.stdout:process_16_[142624]: added 25 objects... 2026-02-24T07:30:53.449 INFO:tasks.workunit.client.0.trial022.stdout:process_16_[142624]: added half of the objects 2026-02-24T07:30:53.449 INFO:tasks.workunit.client.0.trial022.stdout:process_16_[142624]: added 50 objects... 2026-02-24T07:30:53.449 INFO:tasks.workunit.client.0.trial022.stdout:process_16_[142624]: added 50 objects 2026-02-24T07:30:53.449 INFO:tasks.workunit.client.0.trial022.stdout:process_16_[142624]: shutting down. 2026-02-24T07:30:53.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:53 trial022 ceph-mon[39108]: pgmap v717: 33 pgs: 33 active+clean; 577 KiB data, 270 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:53.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:53 trial022 ceph-mon[39108]: osdmap e454: 4 total, 4 up, 4 in 2026-02-24T07:30:54.048 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:54.049 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:54.049 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:54.049 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:54.049 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:54.049 INFO:tasks.workunit.client.0.trial022.stdout:******* SUCCESS ********** 2026-02-24T07:30:54.050 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:30:54.050 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_open_pools_parallel 2026-02-24T07:30:54.050 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:30:54.050 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:30:54.050 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_open_pools_parallel 2026-02-24T07:30:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:54 trial022 ceph-mon[39108]: osdmap e455: 4 total, 4 up, 4 in 2026-02-24T07:30:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:55 trial022 ceph-mon[39108]: pgmap v720: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 270 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:55 trial022 ceph-mon[39108]: osdmap e456: 4 total, 4 up, 4 in 2026-02-24T07:30:56.101 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142687]: starting. 2026-02-24T07:30:56.101 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142687]: creating pool ceph_test_rados_open_pools_parallel.trial022-142686 2026-02-24T07:30:56.101 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142687]: created object 0... 2026-02-24T07:30:56.101 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142687]: created object 25... 2026-02-24T07:30:56.101 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142687]: created object 49... 2026-02-24T07:30:56.101 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142687]: finishing. 2026-02-24T07:30:56.102 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142687]: shutting down. 2026-02-24T07:30:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:56 trial022 ceph-mon[39108]: osdmap e457: 4 total, 4 up, 4 in 2026-02-24T07:30:57.059 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142688]: starting. 2026-02-24T07:30:57.059 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142688]: rados_pool_create. 2026-02-24T07:30:57.059 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142688]: rados_ioctx_create. 2026-02-24T07:30:57.059 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142688]: shutting down. 2026-02-24T07:30:57.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:57 trial022 ceph-mon[39108]: pgmap v723: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 270 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:57.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:57 trial022 ceph-mon[39108]: osdmap e458: 4 total, 4 up, 4 in 2026-02-24T07:30:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:58 trial022 ceph-mon[39108]: osdmap e459: 4 total, 4 up, 4 in 2026-02-24T07:30:59.111 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:30:59.111 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142721]: starting. 2026-02-24T07:30:59.111 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142721]: creating pool ceph_test_rados_open_pools_parallel.trial022-142686 2026-02-24T07:30:59.111 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142721]: created object 0... 2026-02-24T07:30:59.111 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142721]: created object 25... 2026-02-24T07:30:59.111 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142721]: created object 49... 2026-02-24T07:30:59.111 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142721]: finishing. 2026-02-24T07:30:59.111 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142721]: shutting down. 2026-02-24T07:30:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:59 trial022 ceph-mon[39108]: pgmap v726: 33 pgs: 33 active+clean; 577 KiB data, 271 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:30:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:30:59 trial022 ceph-mon[39108]: osdmap e460: 4 total, 4 up, 4 in 2026-02-24T07:31:00.070 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:31:00.070 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142722]: starting. 2026-02-24T07:31:00.070 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142722]: rados_pool_create. 2026-02-24T07:31:00.070 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142722]: rados_ioctx_create. 2026-02-24T07:31:00.070 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142722]: shutting down. 2026-02-24T07:31:00.071 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:31:00.071 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:31:00.071 INFO:tasks.workunit.client.0.trial022.stdout:******* SUCCESS ********** 2026-02-24T07:31:00.072 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in "${RADOS_TESTS[@]}" 2026-02-24T07:31:00.072 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_rados_delete_pools_parallel 2026-02-24T07:31:00.072 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:31:00.072 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:31:00.072 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_rados_delete_pools_parallel 2026-02-24T07:31:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:00 trial022 ceph-mon[39108]: osdmap e461: 4 total, 4 up, 4 in 2026-02-24T07:31:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:00 trial022 ceph-mon[39108]: pgmap v729: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 271 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:01 trial022 ceph-mon[39108]: osdmap e462: 4 total, 4 up, 4 in 2026-02-24T07:31:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:31:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:31:00] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:31:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:31:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:31:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:31:02.118 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142757]: starting. 2026-02-24T07:31:02.119 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142757]: creating pool ceph_test_rados_delete_pools_parallel.trial022-142756 2026-02-24T07:31:02.119 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142757]: created object 0... 2026-02-24T07:31:02.119 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142757]: created object 25... 2026-02-24T07:31:02.119 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142757]: created object 49... 2026-02-24T07:31:02.119 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142757]: finishing. 2026-02-24T07:31:02.119 INFO:tasks.workunit.client.0.trial022.stdout:process_1_[142757]: shutting down. 2026-02-24T07:31:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:02 trial022 ceph-mon[39108]: osdmap e463: 4 total, 4 up, 4 in 2026-02-24T07:31:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:02 trial022 ceph-mon[39108]: pgmap v732: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 270 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:03.079 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142758]: starting. 2026-02-24T07:31:03.079 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142758]: deleting pool ceph_test_rados_delete_pools_parallel.trial022-142756 2026-02-24T07:31:03.079 INFO:tasks.workunit.client.0.trial022.stdout:process_2_[142758]: shutting down. 2026-02-24T07:31:03.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:03 trial022 ceph-mon[39108]: osdmap e464: 4 total, 4 up, 4 in 2026-02-24T07:31:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:04 trial022 ceph-mon[39108]: osdmap e465: 4 total, 4 up, 4 in 2026-02-24T07:31:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:04 trial022 ceph-mon[39108]: pgmap v735: 33 pgs: 33 active+clean; 577 KiB data, 270 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:05.129 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:31:05.130 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142791]: starting. 2026-02-24T07:31:05.130 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142791]: creating pool ceph_test_rados_delete_pools_parallel.trial022-142756 2026-02-24T07:31:05.130 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142791]: created object 0... 2026-02-24T07:31:05.130 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142791]: created object 25... 2026-02-24T07:31:05.130 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142791]: created object 49... 2026-02-24T07:31:05.130 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142791]: finishing. 2026-02-24T07:31:05.130 INFO:tasks.workunit.client.0.trial022.stdout:process_3_[142791]: shutting down. 2026-02-24T07:31:05.138 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:31:05.138 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142793]: starting. 2026-02-24T07:31:05.138 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142793]: listing objects. 2026-02-24T07:31:05.138 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142793]: listed object 0... 2026-02-24T07:31:05.138 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142793]: listed object 25... 2026-02-24T07:31:05.138 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142793]: saw 50 objects 2026-02-24T07:31:05.138 INFO:tasks.workunit.client.0.trial022.stdout:process_5_[142793]: shutting down. 2026-02-24T07:31:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:05 trial022 ceph-mon[39108]: osdmap e466: 4 total, 4 up, 4 in 2026-02-24T07:31:06.084 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:31:06.084 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142792]: starting. 2026-02-24T07:31:06.084 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142792]: deleting pool ceph_test_rados_delete_pools_parallel.trial022-142756 2026-02-24T07:31:06.085 INFO:tasks.workunit.client.0.trial022.stdout:process_4_[142792]: shutting down. 2026-02-24T07:31:06.085 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:31:06.086 INFO:tasks.workunit.client.0.trial022.stdout:******************************* 2026-02-24T07:31:06.086 INFO:tasks.workunit.client.0.trial022.stdout:******* SUCCESS ********** 2026-02-24T07:31:06.087 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:31:06.087 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_cls 2026-02-24T07:31:06.087 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:31:06.087 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:31:06.087 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:31:06.088 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' cls = ec_io ']' 2026-02-24T07:31:06.088 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' cls = ec_list ']' 2026-02-24T07:31:06.088 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_cls 2026-02-24T07:31:06.100 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:31:06.101 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 1 test from 1 test suite. 2026-02-24T07:31:06.101 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:31:06.101 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from NeoRadosCls 2026-02-24T07:31:06.101 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosCls.DNE 2026-02-24T07:31:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:06 trial022 ceph-mon[39108]: osdmap e467: 4 total, 4 up, 4 in 2026-02-24T07:31:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:06 trial022 ceph-mon[39108]: pgmap v738: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 270 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:07.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:07 trial022 ceph-mon[39108]: osdmap e468: 4 total, 4 up, 4 in 2026-02-24T07:31:08.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:08 trial022 ceph-mon[39108]: osdmap e469: 4 total, 4 up, 4 in 2026-02-24T07:31:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:08 trial022 ceph-mon[39108]: pgmap v741: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 270 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:09.090 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosCls.DNE (2989 ms) 2026-02-24T07:31:09.091 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from NeoRadosCls (2989 ms total) 2026-02-24T07:31:09.091 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:31:09.091 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:31:09.091 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 1 test from 1 test suite ran. (2989 ms total) 2026-02-24T07:31:09.091 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 1 test. 2026-02-24T07:31:09.093 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:31:09.094 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_cmd 2026-02-24T07:31:09.094 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:31:09.094 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:31:09.094 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:31:09.094 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' cmd = ec_io ']' 2026-02-24T07:31:09.094 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' cmd = ec_list ']' 2026-02-24T07:31:09.094 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_cmd 2026-02-24T07:31:09.107 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:31:09.107 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 3 tests from 1 test suite. 2026-02-24T07:31:09.108 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:31:09.108 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from NeoRadosCmd 2026-02-24T07:31:09.108 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2026-02-24T07:31:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:09 trial022 ceph-mon[39108]: osdmap e470: 4 total, 4 up, 4 in 2026-02-24T07:31:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:10 trial022 ceph-mon[39108]: osdmap e471: 4 total, 4 up, 4 in 2026-02-24T07:31:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:10 trial022 ceph-mon[39108]: pgmap v744: 33 pgs: 33 active+clean; 577 KiB data, 270 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:11.097 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosCmd.MonDescribe (1989 ms) 2026-02-24T07:31:11.097 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2026-02-24T07:31:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:11 trial022 ceph-mon[39108]: osdmap e472: 4 total, 4 up, 4 in 2026-02-24T07:31:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:31:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:31:10] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:31:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:31:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:31:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:31:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:12 trial022 ceph-mon[39108]: osdmap e473: 4 total, 4 up, 4 in 2026-02-24T07:31:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:12 trial022 ceph-mon[39108]: pgmap v747: 33 pgs: 33 active+clean; 577 KiB data, 271 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:13.102 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosCmd.OSDCmd (2004 ms) 2026-02-24T07:31:13.102 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosCmd.PGCmd 2026-02-24T07:31:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:13 trial022 ceph-mon[39108]: osdmap e474: 4 total, 4 up, 4 in 2026-02-24T07:31:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:14 trial022 ceph-mon[39108]: osdmap e475: 4 total, 4 up, 4 in 2026-02-24T07:31:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:14 trial022 ceph-mon[39108]: pgmap v750: 33 pgs: 33 active+clean; 577 KiB data, 271 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:15.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:15 trial022 ceph-mon[39108]: osdmap e476: 4 total, 4 up, 4 in 2026-02-24T07:31:16.110 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosCmd.PGCmd (3007 ms) 2026-02-24T07:31:16.110 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from NeoRadosCmd (7002 ms total) 2026-02-24T07:31:16.110 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:31:16.110 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:31:16.110 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 3 tests from 1 test suite ran. (7002 ms total) 2026-02-24T07:31:16.110 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 3 tests. 2026-02-24T07:31:16.113 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:31:16.114 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_handler_error 2026-02-24T07:31:16.114 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:31:16.114 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:31:16.114 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:31:16.114 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' handler_error = ec_io ']' 2026-02-24T07:31:16.114 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' handler_error = ec_list ']' 2026-02-24T07:31:16.114 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_handler_error 2026-02-24T07:31:16.127 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:31:16.127 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 1 test from 1 test suite. 2026-02-24T07:31:16.127 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:31:16.127 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from neocls_handler_error 2026-02-24T07:31:16.127 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] neocls_handler_error.test_handler_error 2026-02-24T07:31:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:16 trial022 ceph-mon[39108]: osdmap e477: 4 total, 4 up, 4 in 2026-02-24T07:31:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:16 trial022 ceph-mon[39108]: pgmap v753: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 271 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:17.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:17 trial022 ceph-mon[39108]: osdmap e478: 4 total, 4 up, 4 in 2026-02-24T07:31:18.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:18 trial022 ceph-mon[39108]: osdmap e479: 4 total, 4 up, 4 in 2026-02-24T07:31:18.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:18 trial022 ceph-mon[39108]: pgmap v756: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 271 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:19.118 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] neocls_handler_error.test_handler_error (2990 ms) 2026-02-24T07:31:19.118 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 1 test from neocls_handler_error (2990 ms total) 2026-02-24T07:31:19.118 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:31:19.118 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:31:19.119 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 1 test from 1 test suite ran. (2991 ms total) 2026-02-24T07:31:19.119 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 1 test. 2026-02-24T07:31:19.121 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:31:19.121 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_io 2026-02-24T07:31:19.121 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:31:19.121 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:31:19.121 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:31:19.121 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' io = ec_io ']' 2026-02-24T07:31:19.121 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' io = ec_list ']' 2026-02-24T07:31:19.121 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_io 2026-02-24T07:31:19.134 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:31:19.134 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 14 tests from 1 test suite. 2026-02-24T07:31:19.134 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:31:19.134 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 14 tests from NeoRadosIo 2026-02-24T07:31:19.134 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.Limits 2026-02-24T07:31:19.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:19 trial022 ceph-mon[39108]: osdmap e480: 4 total, 4 up, 4 in 2026-02-24T07:31:20.120 INFO:tasks.workunit.client.0.trial022.stderr:Not supported by crimson yet. Skipped 2026-02-24T07:31:20.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:20 trial022 ceph-mon[39108]: osdmap e481: 4 total, 4 up, 4 in 2026-02-24T07:31:20.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:20 trial022 ceph-mon[39108]: pgmap v759: 33 pgs: 33 active+clean; 577 KiB data, 271 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:21.122 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.Limits (1987 ms) 2026-02-24T07:31:21.122 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2026-02-24T07:31:21.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:21 trial022 ceph-mon[39108]: osdmap e482: 4 total, 4 up, 4 in 2026-02-24T07:31:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:31:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:31:20] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:31:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:31:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:31:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:31:22.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:22 trial022 ceph-mon[39108]: osdmap e483: 4 total, 4 up, 4 in 2026-02-24T07:31:22.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:22 trial022 ceph-mon[39108]: pgmap v762: 33 pgs: 33 active+clean; 577 KiB data, 271 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:23.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:23 trial022 ceph-mon[39108]: osdmap e484: 4 total, 4 up, 4 in 2026-02-24T07:31:24.131 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.SimpleWrite (3008 ms) 2026-02-24T07:31:24.131 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.ReadOp 2026-02-24T07:31:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:24 trial022 ceph-mon[39108]: osdmap e485: 4 total, 4 up, 4 in 2026-02-24T07:31:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:24 trial022 ceph-mon[39108]: pgmap v765: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 271 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:25 trial022 ceph-mon[39108]: osdmap e486: 4 total, 4 up, 4 in 2026-02-24T07:31:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:25 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:31:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:25 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:31:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:25 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:31:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:25 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:31:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:25 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:31:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: osdmap e487: 4 total, 4 up, 4 in 2026-02-24T07:31:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:31:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:31:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-24T07:31:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-24T07:31:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: Adjusting osd_memory_target on trial022 to 41511M 2026-02-24T07:31:26.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:31:26.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-24T07:31:26.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-24T07:31:26.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: Adjusting osd_memory_target on trial195 to 43559M 2026-02-24T07:31:26.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:31:26.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:31:26.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:31:26.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:31:26.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:31:26.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:26 trial022 ceph-mon[39108]: pgmap v768: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 271 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:27.136 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.ReadOp (3005 ms) 2026-02-24T07:31:27.136 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.SparseRead 2026-02-24T07:31:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:27 trial022 ceph-mon[39108]: osdmap e488: 4 total, 4 up, 4 in 2026-02-24T07:31:28.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:28 trial022 ceph-mon[39108]: osdmap e489: 4 total, 4 up, 4 in 2026-02-24T07:31:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:28 trial022 ceph-mon[39108]: pgmap v771: 33 pgs: 33 active+clean; 577 KiB data, 272 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:29.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:29 trial022 ceph-mon[39108]: osdmap e490: 4 total, 4 up, 4 in 2026-02-24T07:31:30.144 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.SparseRead (3008 ms) 2026-02-24T07:31:30.144 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.RoundTrip 2026-02-24T07:31:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:30 trial022 ceph-mon[39108]: osdmap e491: 4 total, 4 up, 4 in 2026-02-24T07:31:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:30 trial022 ceph-mon[39108]: pgmap v774: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 272 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:31 trial022 ceph-mon[39108]: osdmap e492: 4 total, 4 up, 4 in 2026-02-24T07:31:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:31:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:31:30] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:31:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:31:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:31:30.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:31:32.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:32 trial022 ceph-mon[39108]: osdmap e493: 4 total, 4 up, 4 in 2026-02-24T07:31:32.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:32 trial022 ceph-mon[39108]: pgmap v777: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 289 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:33.152 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.RoundTrip (3007 ms) 2026-02-24T07:31:33.152 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2026-02-24T07:31:33.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:33 trial022 ceph-mon[39108]: osdmap e494: 4 total, 4 up, 4 in 2026-02-24T07:31:34.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:34 trial022 ceph-mon[39108]: osdmap e495: 4 total, 4 up, 4 in 2026-02-24T07:31:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:34 trial022 ceph-mon[39108]: pgmap v780: 33 pgs: 33 active+clean; 577 KiB data, 289 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:35.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:35 trial022 ceph-mon[39108]: osdmap e496: 4 total, 4 up, 4 in 2026-02-24T07:31:36.158 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3005 ms) 2026-02-24T07:31:36.158 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2026-02-24T07:31:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:36 trial022 ceph-mon[39108]: osdmap e497: 4 total, 4 up, 4 in 2026-02-24T07:31:36.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:36 trial022 ceph-mon[39108]: pgmap v783: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 289 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:37.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:37 trial022 ceph-mon[39108]: osdmap e498: 4 total, 4 up, 4 in 2026-02-24T07:31:38.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:38 trial022 ceph-mon[39108]: osdmap e499: 4 total, 4 up, 4 in 2026-02-24T07:31:38.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:38 trial022 ceph-mon[39108]: pgmap v786: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 290 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:39.167 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3008 ms) 2026-02-24T07:31:39.167 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2026-02-24T07:31:39.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:39 trial022 ceph-mon[39108]: osdmap e500: 4 total, 4 up, 4 in 2026-02-24T07:31:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:40 trial022 ceph-mon[39108]: osdmap e501: 4 total, 4 up, 4 in 2026-02-24T07:31:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:40 trial022 ceph-mon[39108]: pgmap v789: 33 pgs: 33 active+clean; 577 KiB data, 290 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:41 trial022 ceph-mon[39108]: osdmap e502: 4 total, 4 up, 4 in 2026-02-24T07:31:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:31:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:31:40] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:31:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:31:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:31:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:31:42.174 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3007 ms) 2026-02-24T07:31:42.174 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2026-02-24T07:31:42.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:42 trial022 ceph-mon[39108]: osdmap e503: 4 total, 4 up, 4 in 2026-02-24T07:31:42.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:42 trial022 ceph-mon[39108]: pgmap v792: 65 pgs: 65 active+clean; 577 KiB data, 290 MiB used, 2.7 TiB / 2.7 TiB avail; 511 B/s rd, 767 B/s wr, 1 op/s 2026-02-24T07:31:43.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:43 trial022 ceph-mon[39108]: osdmap e504: 4 total, 4 up, 4 in 2026-02-24T07:31:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:44 trial022 ceph-mon[39108]: osdmap e505: 4 total, 4 up, 4 in 2026-02-24T07:31:44.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:44 trial022 ceph-mon[39108]: pgmap v795: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 290 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:45.180 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3005 ms) 2026-02-24T07:31:45.180 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.Trunc 2026-02-24T07:31:45.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:45 trial022 ceph-mon[39108]: osdmap e506: 4 total, 4 up, 4 in 2026-02-24T07:31:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:46 trial022 ceph-mon[39108]: osdmap e507: 4 total, 4 up, 4 in 2026-02-24T07:31:46.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:46 trial022 ceph-mon[39108]: pgmap v798: 33 pgs: 33 active+clean; 577 KiB data, 290 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:47 trial022 ceph-mon[39108]: osdmap e508: 4 total, 4 up, 4 in 2026-02-24T07:31:48.189 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.Trunc (3008 ms) 2026-02-24T07:31:48.189 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.Remove 2026-02-24T07:31:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:48 trial022 ceph-mon[39108]: osdmap e509: 4 total, 4 up, 4 in 2026-02-24T07:31:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:48 trial022 ceph-mon[39108]: pgmap v801: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 290 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:49 trial022 ceph-mon[39108]: osdmap e510: 4 total, 4 up, 4 in 2026-02-24T07:31:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:50 trial022 ceph-mon[39108]: osdmap e511: 4 total, 4 up, 4 in 2026-02-24T07:31:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:50 trial022 ceph-mon[39108]: pgmap v804: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 290 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:51.195 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.Remove (3006 ms) 2026-02-24T07:31:51.195 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2026-02-24T07:31:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:51 trial022 ceph-mon[39108]: osdmap e512: 4 total, 4 up, 4 in 2026-02-24T07:31:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:31:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:31:50] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:31:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:31:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:31:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:31:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:52 trial022 ceph-mon[39108]: osdmap e513: 4 total, 4 up, 4 in 2026-02-24T07:31:52.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:52 trial022 ceph-mon[39108]: pgmap v807: 33 pgs: 33 active+clean; 577 KiB data, 290 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:53.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:53 trial022 ceph-mon[39108]: osdmap e514: 4 total, 4 up, 4 in 2026-02-24T07:31:54.204 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3008 ms) 2026-02-24T07:31:54.204 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.RmXattr 2026-02-24T07:31:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:54 trial022 ceph-mon[39108]: osdmap e515: 4 total, 4 up, 4 in 2026-02-24T07:31:54.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:54 trial022 ceph-mon[39108]: pgmap v810: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 290 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:55 trial022 ceph-mon[39108]: osdmap e516: 4 total, 4 up, 4 in 2026-02-24T07:31:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:56 trial022 ceph-mon[39108]: osdmap e517: 4 total, 4 up, 4 in 2026-02-24T07:31:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:56 trial022 ceph-mon[39108]: pgmap v813: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 290 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:57.211 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.RmXattr (3006 ms) 2026-02-24T07:31:57.211 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosIo.GetXattrs 2026-02-24T07:31:57.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:57 trial022 ceph-mon[39108]: osdmap e518: 4 total, 4 up, 4 in 2026-02-24T07:31:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:58 trial022 ceph-mon[39108]: osdmap e519: 4 total, 4 up, 4 in 2026-02-24T07:31:58.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:58 trial022 ceph-mon[39108]: pgmap v816: 33 pgs: 33 active+clean; 577 KiB data, 291 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:31:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:31:59 trial022 ceph-mon[39108]: osdmap e520: 4 total, 4 up, 4 in 2026-02-24T07:32:00.218 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosIo.GetXattrs (3007 ms) 2026-02-24T07:32:00.219 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 14 tests from NeoRadosIo (41083 ms total) 2026-02-24T07:32:00.219 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:32:00.219 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:32:00.219 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 14 tests from 1 test suite ran. (41083 ms total) 2026-02-24T07:32:00.219 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 14 tests. 2026-02-24T07:32:00.223 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:32:00.223 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_ec_io 2026-02-24T07:32:00.223 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:00.223 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:00.223 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:32:00.223 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' ec_io = ec_io ']' 2026-02-24T07:32:00.224 INFO:tasks.workunit.client.0.trial022.stdout:Skipping EC with Crimson 2026-02-24T07:32:00.225 INFO:tasks.workunit.client.0.trial022.stderr:+ echo 'Skipping EC with Crimson' 2026-02-24T07:32:00.225 INFO:tasks.workunit.client.0.trial022.stderr:+ continue 2026-02-24T07:32:00.225 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:32:00.225 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_list 2026-02-24T07:32:00.225 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:00.225 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:00.225 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:32:00.225 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' list = ec_io ']' 2026-02-24T07:32:00.225 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' list = ec_list ']' 2026-02-24T07:32:00.225 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_list 2026-02-24T07:32:00.238 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:32:00.238 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 3 tests from 1 test suite. 2026-02-24T07:32:00.238 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:32:00.238 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from NeoradosList 2026-02-24T07:32:00.238 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoradosList.ListObjects 2026-02-24T07:32:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:00 trial022 ceph-mon[39108]: osdmap e521: 4 total, 4 up, 4 in 2026-02-24T07:32:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:00 trial022 ceph-mon[39108]: pgmap v819: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 291 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:01.217 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:32:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:32:00] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:32:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:32:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:32:00.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:32:01.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:01 trial022 ceph-mon[39108]: osdmap e522: 4 total, 4 up, 4 in 2026-02-24T07:32:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:02 trial022 ceph-mon[39108]: osdmap e523: 4 total, 4 up, 4 in 2026-02-24T07:32:02.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:02 trial022 ceph-mon[39108]: pgmap v822: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 291 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:03.226 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoradosList.ListObjects (2987 ms) 2026-02-24T07:32:03.226 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoradosList.ListObjectsNS 2026-02-24T07:32:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:03 trial022 ceph-mon[39108]: osdmap e524: 4 total, 4 up, 4 in 2026-02-24T07:32:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:04 trial022 ceph-mon[39108]: osdmap e525: 4 total, 4 up, 4 in 2026-02-24T07:32:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:04 trial022 ceph-mon[39108]: pgmap v825: 33 pgs: 33 active+clean; 577 KiB data, 291 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:05 trial022 ceph-mon[39108]: osdmap e526: 4 total, 4 up, 4 in 2026-02-24T07:32:06.232 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoradosList.ListObjectsNS (3005 ms) 2026-02-24T07:32:06.232 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoradosList.ListObjectsMany 2026-02-24T07:32:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:06 trial022 ceph-mon[39108]: osdmap e527: 4 total, 4 up, 4 in 2026-02-24T07:32:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:06 trial022 ceph-mon[39108]: pgmap v828: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 291 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:07.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:07 trial022 ceph-mon[39108]: osdmap e528: 4 total, 4 up, 4 in 2026-02-24T07:32:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:08 trial022 ceph-mon[39108]: osdmap e529: 4 total, 4 up, 4 in 2026-02-24T07:32:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:08 trial022 ceph-mon[39108]: pgmap v831: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 291 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:09.242 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoradosList.ListObjectsMany (3010 ms) 2026-02-24T07:32:09.243 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 3 tests from NeoradosList (9004 ms total) 2026-02-24T07:32:09.243 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:32:09.243 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:32:09.243 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 3 tests from 1 test suite ran. (9004 ms total) 2026-02-24T07:32:09.243 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 3 tests. 2026-02-24T07:32:09.245 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:32:09.245 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_ec_list 2026-02-24T07:32:09.245 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:09.245 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:09.245 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:32:09.246 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' ec_list = ec_io ']' 2026-02-24T07:32:09.246 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' ec_list = ec_list ']' 2026-02-24T07:32:09.246 INFO:tasks.workunit.client.0.trial022.stderr:+ echo 'Skipping EC with Crimson' 2026-02-24T07:32:09.246 INFO:tasks.workunit.client.0.trial022.stdout:Skipping EC with Crimson 2026-02-24T07:32:09.247 INFO:tasks.workunit.client.0.trial022.stderr:+ continue 2026-02-24T07:32:09.247 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:32:09.247 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_misc 2026-02-24T07:32:09.247 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:09.247 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:09.247 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:32:09.247 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' misc = ec_io ']' 2026-02-24T07:32:09.247 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' misc = ec_list ']' 2026-02-24T07:32:09.247 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_misc 2026-02-24T07:32:09.259 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:32:09.259 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 12 tests from 1 test suite. 2026-02-24T07:32:09.259 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:32:09.259 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 12 tests from NeoRadosMisc 2026-02-24T07:32:09.260 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.Version 2026-02-24T07:32:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:09 trial022 ceph-mon[39108]: osdmap e530: 4 total, 4 up, 4 in 2026-02-24T07:32:10.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:10 trial022 ceph-mon[39108]: osdmap e531: 4 total, 4 up, 4 in 2026-02-24T07:32:10.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:10 trial022 ceph-mon[39108]: pgmap v834: 33 pgs: 33 active+clean; 577 KiB data, 291 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:32:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:32:10] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:32:11.247 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.Version (1987 ms) 2026-02-24T07:32:11.247 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2026-02-24T07:32:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:32:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:32:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:32:11.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:11 trial022 ceph-mon[39108]: osdmap e532: 4 total, 4 up, 4 in 2026-02-24T07:32:12.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:12 trial022 ceph-mon[39108]: osdmap e533: 4 total, 4 up, 4 in 2026-02-24T07:32:12.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:12 trial022 ceph-mon[39108]: pgmap v837: 33 pgs: 33 active+clean; 577 KiB data, 291 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:13.251 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (2004 ms) 2026-02-24T07:32:13.251 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.LongName 2026-02-24T07:32:13.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:13 trial022 ceph-mon[39108]: osdmap e534: 4 total, 4 up, 4 in 2026-02-24T07:32:14.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:14 trial022 ceph-mon[39108]: osdmap e535: 4 total, 4 up, 4 in 2026-02-24T07:32:14.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:14 trial022 ceph-mon[39108]: pgmap v840: 33 pgs: 33 active+clean; 577 KiB data, 291 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:15.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:15 trial022 ceph-mon[39108]: osdmap e536: 4 total, 4 up, 4 in 2026-02-24T07:32:16.258 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.LongName (3007 ms) 2026-02-24T07:32:16.258 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.LongLocator 2026-02-24T07:32:16.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:16 trial022 ceph-mon[39108]: osdmap e537: 4 total, 4 up, 4 in 2026-02-24T07:32:16.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:16 trial022 ceph-mon[39108]: pgmap v843: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 291 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:17.263 INFO:tasks.workunit.client.0.trial022.stderr:Not supported by crimson yet. Skipped 2026-02-24T07:32:17.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:17 trial022 ceph-mon[39108]: osdmap e538: 4 total, 4 up, 4 in 2026-02-24T07:32:18.266 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.LongLocator (2007 ms) 2026-02-24T07:32:18.266 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2026-02-24T07:32:18.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:18 trial022 ceph-mon[39108]: osdmap e539: 4 total, 4 up, 4 in 2026-02-24T07:32:18.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:18 trial022 ceph-mon[39108]: pgmap v846: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 292 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:19.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:19 trial022 ceph-mon[39108]: osdmap e540: 4 total, 4 up, 4 in 2026-02-24T07:32:20.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:20 trial022 ceph-mon[39108]: osdmap e541: 4 total, 4 up, 4 in 2026-02-24T07:32:20.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:20 trial022 ceph-mon[39108]: pgmap v849: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 292 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:32:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:32:20] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:32:21.271 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.LongNamespace (3005 ms) 2026-02-24T07:32:21.272 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2026-02-24T07:32:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:32:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:32:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:32:21.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:21 trial022 ceph-mon[39108]: osdmap e542: 4 total, 4 up, 4 in 2026-02-24T07:32:22.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:22 trial022 ceph-mon[39108]: osdmap e543: 4 total, 4 up, 4 in 2026-02-24T07:32:22.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:22 trial022 ceph-mon[39108]: pgmap v852: 33 pgs: 33 active+clean; 577 KiB data, 292 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:23.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:23 trial022 ceph-mon[39108]: osdmap e544: 4 total, 4 up, 4 in 2026-02-24T07:32:24.280 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.LongAttrName (3007 ms) 2026-02-24T07:32:24.280 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.Exec 2026-02-24T07:32:24.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:24 trial022 ceph-mon[39108]: osdmap e545: 4 total, 4 up, 4 in 2026-02-24T07:32:24.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:24 trial022 ceph-mon[39108]: pgmap v855: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 292 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:25.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:25 trial022 ceph-mon[39108]: osdmap e546: 4 total, 4 up, 4 in 2026-02-24T07:32:26.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:26 trial022 ceph-mon[39108]: osdmap e547: 4 total, 4 up, 4 in 2026-02-24T07:32:26.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:32:26.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:32:26.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:32:26.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:32:26.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:32:26.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:26 trial022 ceph-mon[39108]: pgmap v858: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 292 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:27.288 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.Exec (3008 ms) 2026-02-24T07:32:27.288 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.Operate1 2026-02-24T07:32:27.642 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:27 trial022 ceph-mon[39108]: osdmap e548: 4 total, 4 up, 4 in 2026-02-24T07:32:28.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:28 trial022 ceph-mon[39108]: osdmap e549: 4 total, 4 up, 4 in 2026-02-24T07:32:28.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:28 trial022 ceph-mon[39108]: pgmap v861: 33 pgs: 33 active+clean; 577 KiB data, 292 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:29.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:29 trial022 ceph-mon[39108]: osdmap e550: 4 total, 4 up, 4 in 2026-02-24T07:32:30.294 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.Operate1 (3006 ms) 2026-02-24T07:32:30.295 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.Operate2 2026-02-24T07:32:30.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:30 trial022 ceph-mon[39108]: osdmap e551: 4 total, 4 up, 4 in 2026-02-24T07:32:30.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:30 trial022 ceph-mon[39108]: pgmap v864: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 292 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:32:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:32:30] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:32:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:32:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:32:30.954Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:32:31.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:31 trial022 ceph-mon[39108]: osdmap e552: 4 total, 4 up, 4 in 2026-02-24T07:32:32.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:32 trial022 ceph-mon[39108]: osdmap e553: 4 total, 4 up, 4 in 2026-02-24T07:32:32.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:32 trial022 ceph-mon[39108]: pgmap v867: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 292 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:33.301 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.Operate2 (3005 ms) 2026-02-24T07:32:33.301 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.BigObject 2026-02-24T07:32:33.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:33 trial022 ceph-mon[39108]: osdmap e554: 4 total, 4 up, 4 in 2026-02-24T07:32:34.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:34 trial022 ceph-mon[39108]: osdmap e555: 4 total, 4 up, 4 in 2026-02-24T07:32:34.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:34 trial022 ceph-mon[39108]: pgmap v870: 33 pgs: 33 active+clean; 577 KiB data, 292 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:35.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:35 trial022 ceph-mon[39108]: osdmap e556: 4 total, 4 up, 4 in 2026-02-24T07:32:36.307 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.BigObject (3006 ms) 2026-02-24T07:32:36.307 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.BigAttr 2026-02-24T07:32:36.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:36 trial022 ceph-mon[39108]: osdmap e557: 4 total, 4 up, 4 in 2026-02-24T07:32:36.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:36 trial022 ceph-mon[39108]: pgmap v873: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 292 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:37.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:37 trial022 ceph-mon[39108]: osdmap e558: 4 total, 4 up, 4 in 2026-02-24T07:32:38.313 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.BigAttr (2006 ms) 2026-02-24T07:32:38.314 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosMisc.WriteSame 2026-02-24T07:32:38.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:38 trial022 ceph-mon[39108]: osdmap e559: 4 total, 4 up, 4 in 2026-02-24T07:32:38.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:38 trial022 ceph-mon[39108]: pgmap v876: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 293 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:39.315 INFO:tasks.workunit.client.0.trial022.stderr:Not supported by crimson yet. Skipped 2026-02-24T07:32:39.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:39 trial022 ceph-mon[39108]: osdmap e560: 4 total, 4 up, 4 in 2026-02-24T07:32:40.318 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosMisc.WriteSame (2004 ms) 2026-02-24T07:32:40.318 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 12 tests from NeoRadosMisc (31058 ms total) 2026-02-24T07:32:40.318 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:32:40.318 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:32:40.319 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 12 tests from 1 test suite ran. (31058 ms total) 2026-02-24T07:32:40.319 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 12 tests. 2026-02-24T07:32:40.323 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:32:40.323 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_pool 2026-02-24T07:32:40.323 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:40.323 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:40.323 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:32:40.323 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' pool = ec_io ']' 2026-02-24T07:32:40.323 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' pool = ec_list ']' 2026-02-24T07:32:40.323 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_pool 2026-02-24T07:32:40.338 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:32:40.338 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 6 tests from 1 test suite. 2026-02-24T07:32:40.338 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:32:40.338 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 6 tests from NeoRadosPools 2026-02-24T07:32:40.338 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosPools.PoolList 2026-02-24T07:32:40.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:40 trial022 ceph-mon[39108]: osdmap e561: 4 total, 4 up, 4 in 2026-02-24T07:32:40.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:40 trial022 ceph-mon[39108]: pgmap v879: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 293 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:32:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:32:40] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:32:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:32:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:32:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:32:41.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:41 trial022 ceph-mon[39108]: osdmap e562: 4 total, 4 up, 4 in 2026-02-24T07:32:42.322 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosPools.PoolList (1984 ms) 2026-02-24T07:32:42.322 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosPools.PoolLookup 2026-02-24T07:32:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:42 trial022 ceph-mon[39108]: osdmap e563: 4 total, 4 up, 4 in 2026-02-24T07:32:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:42 trial022 ceph-mon[39108]: pgmap v882: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 311 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:43.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:43 trial022 ceph-mon[39108]: osdmap e564: 4 total, 4 up, 4 in 2026-02-24T07:32:44.328 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosPools.PoolLookup (2005 ms) 2026-02-24T07:32:44.328 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2026-02-24T07:32:44.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:44 trial022 ceph-mon[39108]: osdmap e565: 4 total, 4 up, 4 in 2026-02-24T07:32:44.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:44 trial022 ceph-mon[39108]: pgmap v885: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 311 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:45.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:45 trial022 ceph-mon[39108]: osdmap e566: 4 total, 4 up, 4 in 2026-02-24T07:32:46.331 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (2004 ms) 2026-02-24T07:32:46.332 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosPools.PoolDelete 2026-02-24T07:32:46.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:46 trial022 ceph-mon[39108]: osdmap e567: 4 total, 4 up, 4 in 2026-02-24T07:32:46.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:46 trial022 ceph-mon[39108]: pgmap v888: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 311 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:47.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:47 trial022 ceph-mon[39108]: osdmap e568: 4 total, 4 up, 4 in 2026-02-24T07:32:48.338 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosPools.PoolDelete (2007 ms) 2026-02-24T07:32:48.339 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2026-02-24T07:32:48.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:48 trial022 ceph-mon[39108]: osdmap e569: 4 total, 4 up, 4 in 2026-02-24T07:32:48.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:48 trial022 ceph-mon[39108]: pgmap v891: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 311 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:49.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:49 trial022 ceph-mon[39108]: osdmap e570: 4 total, 4 up, 4 in 2026-02-24T07:32:50.343 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (2004 ms) 2026-02-24T07:32:50.343 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2026-02-24T07:32:50.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:50 trial022 ceph-mon[39108]: osdmap e571: 4 total, 4 up, 4 in 2026-02-24T07:32:50.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:50 trial022 ceph-mon[39108]: pgmap v894: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 311 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:32:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:32:50] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:32:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:32:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:32:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:32:51.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:51 trial022 ceph-mon[39108]: osdmap e572: 4 total, 4 up, 4 in 2026-02-24T07:32:52.347 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2004 ms) 2026-02-24T07:32:52.347 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 6 tests from NeoRadosPools (12009 ms total) 2026-02-24T07:32:52.347 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:32:52.347 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:32:52.347 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 6 tests from 1 test suite ran. (12009 ms total) 2026-02-24T07:32:52.347 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 6 tests. 2026-02-24T07:32:52.352 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:32:52.352 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_read_operations 2026-02-24T07:32:52.352 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:52.353 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:32:52.353 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:32:52.353 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' read_operations = ec_io ']' 2026-02-24T07:32:52.353 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' read_operations = ec_list ']' 2026-02-24T07:32:52.353 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_read_operations 2026-02-24T07:32:52.366 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:32:52.366 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 15 tests from 1 test suite. 2026-02-24T07:32:52.366 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:32:52.366 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 15 tests from NeoRadosReadOps 2026-02-24T07:32:52.367 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2026-02-24T07:32:52.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:52 trial022 ceph-mon[39108]: osdmap e573: 4 total, 4 up, 4 in 2026-02-24T07:32:52.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:52 trial022 ceph-mon[39108]: pgmap v897: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 311 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:53.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:53 trial022 ceph-mon[39108]: osdmap e574: 4 total, 4 up, 4 in 2026-02-24T07:32:54.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:54 trial022 ceph-mon[39108]: osdmap e575: 4 total, 4 up, 4 in 2026-02-24T07:32:54.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:54 trial022 ceph-mon[39108]: pgmap v900: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 311 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:55.355 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2988 ms) 2026-02-24T07:32:55.356 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2026-02-24T07:32:55.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:55 trial022 ceph-mon[39108]: osdmap e576: 4 total, 4 up, 4 in 2026-02-24T07:32:56.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:56 trial022 ceph-mon[39108]: osdmap e577: 4 total, 4 up, 4 in 2026-02-24T07:32:56.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:56 trial022 ceph-mon[39108]: pgmap v903: 33 pgs: 33 active+clean; 577 KiB data, 311 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:57.642 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:57 trial022 ceph-mon[39108]: osdmap e578: 4 total, 4 up, 4 in 2026-02-24T07:32:58.363 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.AssertExists (3007 ms) 2026-02-24T07:32:58.363 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2026-02-24T07:32:58.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:58 trial022 ceph-mon[39108]: osdmap e579: 4 total, 4 up, 4 in 2026-02-24T07:32:58.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:58 trial022 ceph-mon[39108]: pgmap v906: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 311 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:32:59.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:32:59 trial022 ceph-mon[39108]: osdmap e580: 4 total, 4 up, 4 in 2026-02-24T07:33:00.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:00 trial022 ceph-mon[39108]: osdmap e581: 4 total, 4 up, 4 in 2026-02-24T07:33:00.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:00 trial022 ceph-mon[39108]: pgmap v909: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 311 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:33:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:33:00] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:33:01.371 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3007 ms) 2026-02-24T07:33:01.371 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2026-02-24T07:33:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:33:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:33:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:33:01.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:01 trial022 ceph-mon[39108]: osdmap e582: 4 total, 4 up, 4 in 2026-02-24T07:33:02.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:02 trial022 ceph-mon[39108]: osdmap e583: 4 total, 4 up, 4 in 2026-02-24T07:33:02.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:02 trial022 ceph-mon[39108]: pgmap v912: 33 pgs: 33 active+clean; 577 KiB data, 312 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:03.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:03 trial022 ceph-mon[39108]: osdmap e584: 4 total, 4 up, 4 in 2026-02-24T07:33:04.378 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.CmpXattr (3007 ms) 2026-02-24T07:33:04.378 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.Read 2026-02-24T07:33:04.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:04 trial022 ceph-mon[39108]: osdmap e585: 4 total, 4 up, 4 in 2026-02-24T07:33:04.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:04 trial022 ceph-mon[39108]: pgmap v915: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 312 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:05.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:05 trial022 ceph-mon[39108]: osdmap e586: 4 total, 4 up, 4 in 2026-02-24T07:33:06.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:06 trial022 ceph-mon[39108]: osdmap e587: 4 total, 4 up, 4 in 2026-02-24T07:33:06.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:06 trial022 ceph-mon[39108]: pgmap v918: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 312 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:07.387 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.Read (3008 ms) 2026-02-24T07:33:07.388 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.Checksum 2026-02-24T07:33:07.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:07 trial022 ceph-mon[39108]: osdmap e588: 4 total, 4 up, 4 in 2026-02-24T07:33:08.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:08 trial022 ceph-mon[39108]: osdmap e589: 4 total, 4 up, 4 in 2026-02-24T07:33:08.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:08 trial022 ceph-mon[39108]: pgmap v921: 33 pgs: 33 active+clean; 577 KiB data, 312 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:09.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:09 trial022 ceph-mon[39108]: osdmap e590: 4 total, 4 up, 4 in 2026-02-24T07:33:10.395 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.Checksum (3008 ms) 2026-02-24T07:33:10.396 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2026-02-24T07:33:10.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:10 trial022 ceph-mon[39108]: osdmap e591: 4 total, 4 up, 4 in 2026-02-24T07:33:10.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:10 trial022 ceph-mon[39108]: pgmap v924: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 312 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:33:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:33:10] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:33:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:33:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:33:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:33:11.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:11 trial022 ceph-mon[39108]: osdmap e592: 4 total, 4 up, 4 in 2026-02-24T07:33:12.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:12 trial022 ceph-mon[39108]: osdmap e593: 4 total, 4 up, 4 in 2026-02-24T07:33:12.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:12 trial022 ceph-mon[39108]: pgmap v927: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 312 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:13.402 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3006 ms) 2026-02-24T07:33:13.402 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2026-02-24T07:33:13.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:13 trial022 ceph-mon[39108]: osdmap e594: 4 total, 4 up, 4 in 2026-02-24T07:33:14.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:14 trial022 ceph-mon[39108]: osdmap e595: 4 total, 4 up, 4 in 2026-02-24T07:33:14.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:14 trial022 ceph-mon[39108]: pgmap v930: 33 pgs: 33 active+clean; 577 KiB data, 312 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:15.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:15 trial022 ceph-mon[39108]: osdmap e596: 4 total, 4 up, 4 in 2026-02-24T07:33:16.411 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.ShortRead (3008 ms) 2026-02-24T07:33:16.411 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.Exec 2026-02-24T07:33:16.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:16 trial022 ceph-mon[39108]: osdmap e597: 4 total, 4 up, 4 in 2026-02-24T07:33:16.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:16 trial022 ceph-mon[39108]: pgmap v933: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 312 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:17.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:17 trial022 ceph-mon[39108]: osdmap e598: 4 total, 4 up, 4 in 2026-02-24T07:33:18.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:18 trial022 ceph-mon[39108]: osdmap e599: 4 total, 4 up, 4 in 2026-02-24T07:33:18.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:18 trial022 ceph-mon[39108]: pgmap v936: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 330 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:19.419 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.Exec (3007 ms) 2026-02-24T07:33:19.419 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.Stat 2026-02-24T07:33:19.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:19 trial022 ceph-mon[39108]: osdmap e600: 4 total, 4 up, 4 in 2026-02-24T07:33:20.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:20 trial022 ceph-mon[39108]: osdmap e601: 4 total, 4 up, 4 in 2026-02-24T07:33:20.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:20 trial022 ceph-mon[39108]: pgmap v939: 33 pgs: 33 active+clean; 577 KiB data, 330 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:33:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:33:20] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:33:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:33:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:33:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:33:21.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:21 trial022 ceph-mon[39108]: osdmap e602: 4 total, 4 up, 4 in 2026-02-24T07:33:22.426 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.Stat (3008 ms) 2026-02-24T07:33:22.426 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.Omap 2026-02-24T07:33:22.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:22 trial022 ceph-mon[39108]: osdmap e603: 4 total, 4 up, 4 in 2026-02-24T07:33:22.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:22 trial022 ceph-mon[39108]: pgmap v942: 65 pgs: 65 active+clean; 577 KiB data, 330 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 511 B/s wr, 1 op/s 2026-02-24T07:33:23.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:23 trial022 ceph-mon[39108]: osdmap e604: 4 total, 4 up, 4 in 2026-02-24T07:33:24.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:24 trial022 ceph-mon[39108]: osdmap e605: 4 total, 4 up, 4 in 2026-02-24T07:33:24.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:24 trial022 ceph-mon[39108]: pgmap v945: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 330 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:25.433 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.Omap (3006 ms) 2026-02-24T07:33:25.433 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2026-02-24T07:33:25.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:25 trial022 ceph-mon[39108]: osdmap e606: 4 total, 4 up, 4 in 2026-02-24T07:33:26.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:26 trial022 ceph-mon[39108]: osdmap e607: 4 total, 4 up, 4 in 2026-02-24T07:33:26.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:33:26.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:26 trial022 ceph-mon[39108]: pgmap v948: 33 pgs: 33 active+clean; 577 KiB data, 330 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:26.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:33:26.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:33:26.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:33:26.742 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:33:27.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:27 trial022 ceph-mon[39108]: osdmap e608: 4 total, 4 up, 4 in 2026-02-24T07:33:28.441 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3008 ms) 2026-02-24T07:33:28.442 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2026-02-24T07:33:28.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:28 trial022 ceph-mon[39108]: osdmap e609: 4 total, 4 up, 4 in 2026-02-24T07:33:28.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:28 trial022 ceph-mon[39108]: pgmap v951: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 366 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:29.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:29 trial022 ceph-mon[39108]: osdmap e610: 4 total, 4 up, 4 in 2026-02-24T07:33:30.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:30 trial022 ceph-mon[39108]: osdmap e611: 4 total, 4 up, 4 in 2026-02-24T07:33:30.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:30 trial022 ceph-mon[39108]: pgmap v954: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 366 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:33:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:33:30] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:33:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:33:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:33:30.954Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:33:31.448 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3006 ms) 2026-02-24T07:33:31.449 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2026-02-24T07:33:31.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:31 trial022 ceph-mon[39108]: osdmap e612: 4 total, 4 up, 4 in 2026-02-24T07:33:32.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:32 trial022 ceph-mon[39108]: osdmap e613: 4 total, 4 up, 4 in 2026-02-24T07:33:32.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:32 trial022 ceph-mon[39108]: pgmap v957: 33 pgs: 33 active+clean; 577 KiB data, 384 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:33.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:33 trial022 ceph-mon[39108]: osdmap e614: 4 total, 4 up, 4 in 2026-02-24T07:33:34.456 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.CmpExt (3007 ms) 2026-02-24T07:33:34.456 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosReadOps.Cancel 2026-02-24T07:33:34.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:34 trial022 ceph-mon[39108]: osdmap e615: 4 total, 4 up, 4 in 2026-02-24T07:33:34.762 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:34 trial022 ceph-mon[39108]: pgmap v960: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 384 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:35.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:35 trial022 ceph-mon[39108]: osdmap e616: 4 total, 4 up, 4 in 2026-02-24T07:33:36.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:36 trial022 ceph-mon[39108]: osdmap e617: 4 total, 4 up, 4 in 2026-02-24T07:33:36.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:36 trial022 ceph-mon[39108]: pgmap v963: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 384 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:37.464 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosReadOps.Cancel (3008 ms) 2026-02-24T07:33:37.464 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 15 tests from NeoRadosReadOps (45097 ms total) 2026-02-24T07:33:37.465 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:33:37.465 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:33:37.465 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 15 tests from 1 test suite ran. (45097 ms total) 2026-02-24T07:33:37.465 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 15 tests. 2026-02-24T07:33:37.468 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:33:37.468 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_snapshots 2026-02-24T07:33:37.469 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:33:37.469 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:33:37.469 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:33:37.469 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' snapshots = ec_io ']' 2026-02-24T07:33:37.469 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' snapshots = ec_list ']' 2026-02-24T07:33:37.469 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_snapshots 2026-02-24T07:33:37.483 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:33:37.483 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 11 tests from 2 test suites. 2026-02-24T07:33:37.483 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:33:37.483 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 5 tests from NeoRadosSnapshots 2026-02-24T07:33:37.483 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2026-02-24T07:33:37.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:37 trial022 ceph-mon[39108]: osdmap e618: 4 total, 4 up, 4 in 2026-02-24T07:33:38.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:38 trial022 ceph-mon[39108]: osdmap e619: 4 total, 4 up, 4 in 2026-02-24T07:33:38.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:38 trial022 ceph-mon[39108]: pgmap v966: 33 pgs: 33 active+clean; 577 KiB data, 384 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:39.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:39 trial022 ceph-mon[39108]: osdmap e620: 4 total, 4 up, 4 in 2026-02-24T07:33:40.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:40 trial022 ceph-mon[39108]: osdmap e621: 4 total, 4 up, 4 in 2026-02-24T07:33:40.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:40 trial022 ceph-mon[39108]: pgmap v969: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 384 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:33:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:33:40] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:33:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:33:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:33:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:33:41.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:41 trial022 ceph-mon[39108]: osdmap e622: 4 total, 4 up, 4 in 2026-02-24T07:33:42.477 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSnapshots.SnapList (4993 ms) 2026-02-24T07:33:42.478 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2026-02-24T07:33:42.740 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:42 trial022 ceph-mon[39108]: osdmap e623: 4 total, 4 up, 4 in 2026-02-24T07:33:42.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:42 trial022 ceph-mon[39108]: pgmap v972: 65 pgs: 65 active+clean; 577 KiB data, 384 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:43.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:43 trial022 ceph-mon[39108]: osdmap e624: 4 total, 4 up, 4 in 2026-02-24T07:33:44.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:44 trial022 ceph-mon[39108]: osdmap e625: 4 total, 4 up, 4 in 2026-02-24T07:33:44.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:44 trial022 ceph-mon[39108]: pgmap v975: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 384 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:45.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:45 trial022 ceph-mon[39108]: osdmap e626: 4 total, 4 up, 4 in 2026-02-24T07:33:46.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:46 trial022 ceph-mon[39108]: osdmap e627: 4 total, 4 up, 4 in 2026-02-24T07:33:46.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:46 trial022 ceph-mon[39108]: pgmap v978: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 384 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:47.488 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (5010 ms) 2026-02-24T07:33:47.488 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2026-02-24T07:33:47.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:47 trial022 ceph-mon[39108]: osdmap e628: 4 total, 4 up, 4 in 2026-02-24T07:33:48.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:48 trial022 ceph-mon[39108]: osdmap e629: 4 total, 4 up, 4 in 2026-02-24T07:33:48.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:48 trial022 ceph-mon[39108]: pgmap v981: 33 pgs: 33 active+clean; 577 KiB data, 385 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:49.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:49 trial022 ceph-mon[39108]: osdmap e630: 4 total, 4 up, 4 in 2026-02-24T07:33:50.951 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:50 trial022 ceph-mon[39108]: osdmap e631: 4 total, 4 up, 4 in 2026-02-24T07:33:50.951 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:50 trial022 ceph-mon[39108]: pgmap v984: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 385 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:33:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:33:50] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:33:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:33:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:33:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:33:51.500 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSnapshots.Rollback (4011 ms) 2026-02-24T07:33:51.500 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2026-02-24T07:33:51.990 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:51 trial022 ceph-mon[39108]: osdmap e632: 4 total, 4 up, 4 in 2026-02-24T07:33:52.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:52 trial022 ceph-mon[39108]: osdmap e633: 4 total, 4 up, 4 in 2026-02-24T07:33:52.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:52 trial022 ceph-mon[39108]: pgmap v987: 33 pgs: 33 active+clean; 577 KiB data, 385 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:53.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:53 trial022 ceph-mon[39108]: osdmap e634: 4 total, 4 up, 4 in 2026-02-24T07:33:54.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:54 trial022 ceph-mon[39108]: osdmap e635: 4 total, 4 up, 4 in 2026-02-24T07:33:54.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:54 trial022 ceph-mon[39108]: pgmap v990: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 385 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:55.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:55 trial022 ceph-mon[39108]: osdmap e636: 4 total, 4 up, 4 in 2026-02-24T07:33:56.510 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5010 ms) 2026-02-24T07:33:56.510 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2026-02-24T07:33:56.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:56 trial022 ceph-mon[39108]: osdmap e637: 4 total, 4 up, 4 in 2026-02-24T07:33:56.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:56 trial022 ceph-mon[39108]: pgmap v993: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 385 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:57.892 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:57 trial022 ceph-mon[39108]: osdmap e638: 4 total, 4 up, 4 in 2026-02-24T07:33:58.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:58 trial022 ceph-mon[39108]: osdmap e639: 4 total, 4 up, 4 in 2026-02-24T07:33:58.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:58 trial022 ceph-mon[39108]: pgmap v996: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 385 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:33:59.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:33:59 trial022 ceph-mon[39108]: osdmap e640: 4 total, 4 up, 4 in 2026-02-24T07:34:00.950 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:00 trial022 ceph-mon[39108]: osdmap e641: 4 total, 4 up, 4 in 2026-02-24T07:34:00.951 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:00 trial022 ceph-mon[39108]: pgmap v999: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 385 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:34:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:34:00] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:34:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:34:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:34:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:34:01.990 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:01 trial022 ceph-mon[39108]: osdmap e642: 4 total, 4 up, 4 in 2026-02-24T07:34:02.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:02 trial022 ceph-mon[39108]: osdmap e643: 4 total, 4 up, 4 in 2026-02-24T07:34:02.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:02 trial022 ceph-mon[39108]: pgmap v1002: 65 pgs: 65 active+clean; 577 KiB data, 385 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s wr, 0 op/s 2026-02-24T07:34:03.526 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (7016 ms) 2026-02-24T07:34:03.527 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 5 tests from NeoRadosSnapshots (26043 ms total) 2026-02-24T07:34:03.527 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:34:03.527 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2026-02-24T07:34:03.527 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2026-02-24T07:34:03.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:03 trial022 ceph-mon[39108]: osdmap e644: 4 total, 4 up, 4 in 2026-02-24T07:34:04.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:04 trial022 ceph-mon[39108]: osdmap e645: 4 total, 4 up, 4 in 2026-02-24T07:34:04.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:04 trial022 ceph-mon[39108]: pgmap v1005: 33 pgs: 33 active+clean; 577 KiB data, 385 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:05.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:05 trial022 ceph-mon[39108]: osdmap e646: 4 total, 4 up, 4 in 2026-02-24T07:34:06.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:06 trial022 ceph-mon[39108]: osdmap e647: 4 total, 4 up, 4 in 2026-02-24T07:34:06.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:06 trial022 ceph-mon[39108]: pgmap v1008: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 385 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:07.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:07 trial022 ceph-mon[39108]: osdmap e648: 4 total, 4 up, 4 in 2026-02-24T07:34:08.538 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5011 ms) 2026-02-24T07:34:08.539 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2026-02-24T07:34:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:08 trial022 ceph-mon[39108]: osdmap e649: 4 total, 4 up, 4 in 2026-02-24T07:34:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:08 trial022 ceph-mon[39108]: pgmap v1011: 65 pgs: 65 active+clean; 577 KiB data, 386 MiB used, 2.7 TiB / 2.7 TiB avail; 255 B/s rd, 511 B/s wr, 0 op/s 2026-02-24T07:34:09.540 INFO:tasks.workunit.client.0.trial022.stderr:Not supported by crimson yet. Skipped 2026-02-24T07:34:09.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:09 trial022 ceph-mon[39108]: osdmap e650: 4 total, 4 up, 4 in 2026-02-24T07:34:10.543 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2004 ms) 2026-02-24T07:34:10.543 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2026-02-24T07:34:10.951 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:10 trial022 ceph-mon[39108]: osdmap e651: 4 total, 4 up, 4 in 2026-02-24T07:34:10.951 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:10 trial022 ceph-mon[39108]: pgmap v1014: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 386 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:34:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:34:10] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:34:11.377 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:34:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:34:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:34:11.544 INFO:tasks.workunit.client.0.trial022.stderr:Not supported by crimson yet. Skipped 2026-02-24T07:34:11.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:11 trial022 ceph-mon[39108]: osdmap e652: 4 total, 4 up, 4 in 2026-02-24T07:34:12.547 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2004 ms) 2026-02-24T07:34:12.547 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2026-02-24T07:34:12.990 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:12 trial022 ceph-mon[39108]: osdmap e653: 4 total, 4 up, 4 in 2026-02-24T07:34:12.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:12 trial022 ceph-mon[39108]: pgmap v1017: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 386 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:13.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:13 trial022 ceph-mon[39108]: osdmap e654: 4 total, 4 up, 4 in 2026-02-24T07:34:14.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:14 trial022 ceph-mon[39108]: osdmap e655: 4 total, 4 up, 4 in 2026-02-24T07:34:14.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:14 trial022 ceph-mon[39108]: pgmap v1020: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 386 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:15.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:15 trial022 ceph-mon[39108]: osdmap e656: 4 total, 4 up, 4 in 2026-02-24T07:34:16.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:16 trial022 ceph-mon[39108]: osdmap e657: 4 total, 4 up, 4 in 2026-02-24T07:34:16.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:16 trial022 ceph-mon[39108]: pgmap v1023: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 386 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:17.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:17 trial022 ceph-mon[39108]: osdmap e658: 4 total, 4 up, 4 in 2026-02-24T07:34:18.560 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6012 ms) 2026-02-24T07:34:18.560 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2026-02-24T07:34:18.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:18 trial022 ceph-mon[39108]: osdmap e659: 4 total, 4 up, 4 in 2026-02-24T07:34:18.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:18 trial022 ceph-mon[39108]: pgmap v1026: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 256 KiB/s wr, 0 op/s 2026-02-24T07:34:19.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:19 trial022 ceph-mon[39108]: osdmap e660: 4 total, 4 up, 4 in 2026-02-24T07:34:20.950 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:20 trial022 ceph-mon[39108]: osdmap e661: 4 total, 4 up, 4 in 2026-02-24T07:34:20.951 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:20 trial022 ceph-mon[39108]: pgmap v1029: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:34:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:34:20] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:34:21.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:34:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:34:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:34:21.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:21 trial022 ceph-mon[39108]: osdmap e662: 4 total, 4 up, 4 in 2026-02-24T07:34:22.570 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4009 ms) 2026-02-24T07:34:22.570 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2026-02-24T07:34:22.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:22 trial022 ceph-mon[39108]: osdmap e663: 4 total, 4 up, 4 in 2026-02-24T07:34:22.741 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:22 trial022 ceph-mon[39108]: pgmap v1032: 65 pgs: 65 active+clean; 577 KiB data, 386 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s wr, 0 op/s 2026-02-24T07:34:23.990 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:23 trial022 ceph-mon[39108]: osdmap e664: 4 total, 4 up, 4 in 2026-02-24T07:34:24.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:24 trial022 ceph-mon[39108]: osdmap e665: 4 total, 4 up, 4 in 2026-02-24T07:34:24.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:24 trial022 ceph-mon[39108]: pgmap v1035: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 386 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:25.576 INFO:tasks.workunit.client.0.trial022.stdout:Deleting snap 3 in pool ReusePurgedSnaptrial022-144343-11. 2026-02-24T07:34:25.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:25 trial022 ceph-mon[39108]: osdmap e666: 4 total, 4 up, 4 in 2026-02-24T07:34:26.579 INFO:tasks.workunit.client.0.trial022.stdout:Waiting for snaps to purge. 2026-02-24T07:34:26.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:26 trial022 ceph-mon[39108]: osdmap e667: 4 total, 4 up, 4 in 2026-02-24T07:34:26.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:26 trial022 ceph-mon[39108]: pgmap v1038: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 386 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:26.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:34:26.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:34:26.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:34:26.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:34:26.992 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:34:27.892 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:27 trial022 ceph-mon[39108]: osdmap e668: 4 total, 4 up, 4 in 2026-02-24T07:34:28.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:28 trial022 ceph-mon[39108]: pgmap v1040: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail; 236 B/s wr, 0 op/s 2026-02-24T07:34:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:30 trial022 ceph-mon[39108]: pgmap v1041: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail; 170 B/s wr, 0 op/s 2026-02-24T07:34:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:34:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:34:30] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:34:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:34:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:34:30.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:34:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:32 trial022 ceph-mon[39108]: pgmap v1042: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail; 139 B/s wr, 0 op/s 2026-02-24T07:34:35.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:34 trial022 ceph-mon[39108]: pgmap v1043: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail; 122 B/s wr, 0 op/s 2026-02-24T07:34:35.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:34 trial022 ceph-mon[39108]: osdmap e669: 4 total, 4 up, 4 in 2026-02-24T07:34:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:36 trial022 ceph-mon[39108]: pgmap v1045: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail; 109 B/s wr, 0 op/s 2026-02-24T07:34:39.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:38 trial022 ceph-mon[39108]: pgmap v1046: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:40 trial022 ceph-mon[39108]: pgmap v1047: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:34:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:34:40] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:34:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:34:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:34:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:34:41.965 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19395 ms) 2026-02-24T07:34:41.966 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (38439 ms total) 2026-02-24T07:34:41.966 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:34:41.966 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:34:41.966 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 11 tests from 2 test suites ran. (64482 ms total) 2026-02-24T07:34:41.966 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 11 tests. 2026-02-24T07:34:41.971 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:34:41.971 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_watch_notify 2026-02-24T07:34:41.972 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:34:41.972 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:34:41.972 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:34:41.972 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' watch_notify = ec_io ']' 2026-02-24T07:34:41.972 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' watch_notify = ec_list ']' 2026-02-24T07:34:41.972 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_watch_notify 2026-02-24T07:34:41.986 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:34:41.986 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 6 tests from 2 test suites. 2026-02-24T07:34:41.986 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:34:41.986 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from NeoRadosWatchNotify 2026-02-24T07:34:41.986 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2026-02-24T07:34:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:42 trial022 ceph-mon[39108]: pgmap v1048: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail; 102 B/s wr, 0 op/s 2026-02-24T07:34:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:42 trial022 ceph-mon[39108]: osdmap e670: 4 total, 4 up, 4 in 2026-02-24T07:34:43.981 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 36261632 notify_id 2886218022918 notifier_gid 23003 2026-02-24T07:34:44.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:43 trial022 ceph-mon[39108]: osdmap e671: 4 total, 4 up, 4 in 2026-02-24T07:34:44.974 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2988 ms) 2026-02-24T07:34:44.974 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2026-02-24T07:34:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:44 trial022 ceph-mon[39108]: pgmap v1051: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:44 trial022 ceph-mon[39108]: osdmap e672: 4 total, 4 up, 4 in 2026-02-24T07:34:46.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:45 trial022 ceph-mon[39108]: osdmap e673: 4 total, 4 up, 4 in 2026-02-24T07:34:46.992 INFO:tasks.workunit.client.0.trial022.stdout:Trying... 2026-02-24T07:34:46.992 INFO:tasks.workunit.client.0.trial022.stdout:handle_notify cookie 37049536 notify_id 2899102924807 notifier_gid 23005 2026-02-24T07:34:46.992 INFO:tasks.workunit.client.0.trial022.stdout:Waiting for 3.000000000s 2026-02-24T07:34:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:46 trial022 ceph-mon[39108]: pgmap v1054: 33 pgs: 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:46 trial022 ceph-mon[39108]: osdmap e674: 4 total, 4 up, 4 in 2026-02-24T07:34:47.992 INFO:tasks.workunit.client.0.trial022.stdout:Timed out. 2026-02-24T07:34:47.993 INFO:tasks.workunit.client.0.trial022.stdout:Flushing... 2026-02-24T07:34:47.993 INFO:tasks.workunit.client.0.trial022.stdout:Flushed... 2026-02-24T07:34:48.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:47 trial022 ceph-mon[39108]: osdmap e675: 4 total, 4 up, 4 in 2026-02-24T07:34:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:48 trial022 ceph-mon[39108]: pgmap v1057: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:48 trial022 ceph-mon[39108]: osdmap e676: 4 total, 4 up, 4 in 2026-02-24T07:34:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:50 trial022 ceph-mon[39108]: pgmap v1059: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:34:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:34:50] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:34:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:34:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:34:50.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:34:51.984 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7010 ms) 2026-02-24T07:34:51.984 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 2 tests from NeoRadosWatchNotify (9998 ms total) 2026-02-24T07:34:51.984 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:34:51.984 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from NeoRadosWatchNotifyPoll 2026-02-24T07:34:51.984 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWatchNotifyPoll.WatchNotify 2026-02-24T07:34:53.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:52 trial022 ceph-mon[39108]: pgmap v1060: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail; 0 B/s rd, 0 op/s 2026-02-24T07:34:53.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:52 trial022 ceph-mon[39108]: osdmap e677: 4 total, 4 up, 4 in 2026-02-24T07:34:54.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:53 trial022 ceph-mon[39108]: osdmap e678: 4 total, 4 up, 4 in 2026-02-24T07:34:54.991 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWatchNotifyPoll.WatchNotify (3006 ms) 2026-02-24T07:34:54.991 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout 2026-02-24T07:34:55.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:54 trial022 ceph-mon[39108]: pgmap v1063: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:55.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:54 trial022 ceph-mon[39108]: osdmap e679: 4 total, 4 up, 4 in 2026-02-24T07:34:56.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:55 trial022 ceph-mon[39108]: osdmap e680: 4 total, 4 up, 4 in 2026-02-24T07:34:57.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:56 trial022 ceph-mon[39108]: pgmap v1066: 33 pgs: 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:57.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:56 trial022 ceph-mon[39108]: osdmap e681: 4 total, 4 up, 4 in 2026-02-24T07:34:58.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:57 trial022 ceph-mon[39108]: osdmap e682: 4 total, 4 up, 4 in 2026-02-24T07:34:59.001 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout (4010 ms) 2026-02-24T07:34:59.002 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWatchNotifyPoll.WrongWatchType 2026-02-24T07:34:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:59 trial022 ceph-mon[39108]: pgmap v1069: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:34:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:34:59 trial022 ceph-mon[39108]: osdmap e683: 4 total, 4 up, 4 in 2026-02-24T07:35:00.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:00 trial022 ceph-mon[39108]: osdmap e684: 4 total, 4 up, 4 in 2026-02-24T07:35:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:01 trial022 ceph-mon[39108]: pgmap v1072: 33 pgs: 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:01 trial022 ceph-mon[39108]: osdmap e685: 4 total, 4 up, 4 in 2026-02-24T07:35:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:35:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:35:00] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:35:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:35:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:35:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:35:02.009 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWatchNotifyPoll.WrongWatchType (3007 ms) 2026-02-24T07:35:02.009 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyCancel 2026-02-24T07:35:02.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:02 trial022 ceph-mon[39108]: osdmap e686: 4 total, 4 up, 4 in 2026-02-24T07:35:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:03 trial022 ceph-mon[39108]: pgmap v1075: 65 pgs: 65 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:03 trial022 ceph-mon[39108]: osdmap e687: 4 total, 4 up, 4 in 2026-02-24T07:35:04.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:04 trial022 ceph-mon[39108]: osdmap e688: 4 total, 4 up, 4 in 2026-02-24T07:35:05.015 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWatchNotifyPoll.WatchNotifyCancel (3006 ms) 2026-02-24T07:35:05.016 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 4 tests from NeoRadosWatchNotifyPoll (13031 ms total) 2026-02-24T07:35:05.016 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:35:05.016 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:35:05.016 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 6 tests from 2 test suites ran. (23029 ms total) 2026-02-24T07:35:05.016 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 6 tests. 2026-02-24T07:35:05.019 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T07:35:05.019 INFO:tasks.workunit.client.0.trial022.stderr:+ executable=ceph_test_neorados_write_operations 2026-02-24T07:35:05.019 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:35:05.019 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:35:05.020 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T07:35:05.020 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' write_operations = ec_io ']' 2026-02-24T07:35:05.020 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' write_operations = ec_list ']' 2026-02-24T07:35:05.020 INFO:tasks.workunit.client.0.trial022.stderr:+ timeout 5400 ceph_test_neorados_write_operations 2026-02-24T07:35:05.034 INFO:tasks.workunit.client.0.trial022.stdout:Running main() from gmock_main.cc 2026-02-24T07:35:05.034 INFO:tasks.workunit.client.0.trial022.stdout:[==========] Running 8 tests from 1 test suite. 2026-02-24T07:35:05.034 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment set-up. 2026-02-24T07:35:05.034 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from NeoRadosWriteOps 2026-02-24T07:35:05.034 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2026-02-24T07:35:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:05 trial022 ceph-mon[39108]: pgmap v1078: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:05 trial022 ceph-mon[39108]: osdmap e689: 4 total, 4 up, 4 in 2026-02-24T07:35:06.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:06 trial022 ceph-mon[39108]: osdmap e690: 4 total, 4 up, 4 in 2026-02-24T07:35:07.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:07 trial022 ceph-mon[39108]: pgmap v1081: 33 pgs: 33 active+clean; 577 KiB data, 387 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:07.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:07 trial022 ceph-mon[39108]: osdmap e691: 4 total, 4 up, 4 in 2026-02-24T07:35:08.025 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2991 ms) 2026-02-24T07:35:08.025 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2026-02-24T07:35:08.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:08 trial022 ceph-mon[39108]: osdmap e692: 4 total, 4 up, 4 in 2026-02-24T07:35:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:09 trial022 ceph-mon[39108]: pgmap v1084: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 388 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:09.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:09 trial022 ceph-mon[39108]: osdmap e693: 4 total, 4 up, 4 in 2026-02-24T07:35:10.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:10 trial022 ceph-mon[39108]: osdmap e694: 4 total, 4 up, 4 in 2026-02-24T07:35:11.031 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3005 ms) 2026-02-24T07:35:11.031 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2026-02-24T07:35:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:11 trial022 ceph-mon[39108]: pgmap v1087: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 388 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:11 trial022 ceph-mon[39108]: osdmap e695: 4 total, 4 up, 4 in 2026-02-24T07:35:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:35:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:35:10] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:35:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:35:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:35:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:35:12.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:12 trial022 ceph-mon[39108]: osdmap e696: 4 total, 4 up, 4 in 2026-02-24T07:35:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:13 trial022 ceph-mon[39108]: pgmap v1090: 33 pgs: 33 active+clean; 577 KiB data, 388 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:13 trial022 ceph-mon[39108]: osdmap e697: 4 total, 4 up, 4 in 2026-02-24T07:35:14.040 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWriteOps.Xattrs (3009 ms) 2026-02-24T07:35:14.040 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWriteOps.Write 2026-02-24T07:35:14.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:14 trial022 ceph-mon[39108]: osdmap e698: 4 total, 4 up, 4 in 2026-02-24T07:35:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:15 trial022 ceph-mon[39108]: pgmap v1093: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 388 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:15 trial022 ceph-mon[39108]: osdmap e699: 4 total, 4 up, 4 in 2026-02-24T07:35:16.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:16 trial022 ceph-mon[39108]: osdmap e700: 4 total, 4 up, 4 in 2026-02-24T07:35:17.045 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWriteOps.Write (3005 ms) 2026-02-24T07:35:17.045 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWriteOps.Exec 2026-02-24T07:35:17.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:17 trial022 ceph-mon[39108]: pgmap v1096: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 388 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:17.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:17 trial022 ceph-mon[39108]: osdmap e701: 4 total, 4 up, 4 in 2026-02-24T07:35:18.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:18 trial022 ceph-mon[39108]: osdmap e702: 4 total, 4 up, 4 in 2026-02-24T07:35:19.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:19 trial022 ceph-mon[39108]: pgmap v1099: 33 pgs: 33 active+clean; 577 KiB data, 388 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:19.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:19 trial022 ceph-mon[39108]: osdmap e703: 4 total, 4 up, 4 in 2026-02-24T07:35:20.053 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWriteOps.Exec (3006 ms) 2026-02-24T07:35:20.053 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2026-02-24T07:35:20.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:20 trial022 ceph-mon[39108]: osdmap e704: 4 total, 4 up, 4 in 2026-02-24T07:35:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:21 trial022 ceph-mon[39108]: pgmap v1102: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 388 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:21 trial022 ceph-mon[39108]: osdmap e705: 4 total, 4 up, 4 in 2026-02-24T07:35:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:35:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:35:20] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:35:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:35:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:35:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:35:22.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:22 trial022 ceph-mon[39108]: osdmap e706: 4 total, 4 up, 4 in 2026-02-24T07:35:23.060 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3007 ms) 2026-02-24T07:35:23.060 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2026-02-24T07:35:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:23 trial022 ceph-mon[39108]: pgmap v1105: 65 pgs: 32 creating+peering, 33 active+clean; 577 KiB data, 389 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:23.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:23 trial022 ceph-mon[39108]: osdmap e707: 4 total, 4 up, 4 in 2026-02-24T07:35:24.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:24 trial022 ceph-mon[39108]: osdmap e708: 4 total, 4 up, 4 in 2026-02-24T07:35:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:25 trial022 ceph-mon[39108]: pgmap v1108: 33 pgs: 33 active+clean; 577 KiB data, 389 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:25.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:25 trial022 ceph-mon[39108]: osdmap e709: 4 total, 4 up, 4 in 2026-02-24T07:35:26.068 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWriteOps.CmpExt (3008 ms) 2026-02-24T07:35:26.068 INFO:tasks.workunit.client.0.trial022.stdout:[ RUN ] NeoRadosWriteOps.Cancel 2026-02-24T07:35:26.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:26 trial022 ceph-mon[39108]: osdmap e710: 4 total, 4 up, 4 in 2026-02-24T07:35:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:27 trial022 ceph-mon[39108]: pgmap v1111: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 389 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:27.392 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:27 trial022 ceph-mon[39108]: osdmap e711: 4 total, 4 up, 4 in 2026-02-24T07:35:27.393 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:27 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:35:27.393 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:27 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:35:27.393 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:27 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:35:27.393 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:27 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:35:27.393 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:27 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:35:28.075 INFO:tasks.workunit.client.0.trial022.stdout:[ OK ] NeoRadosWriteOps.Cancel (2007 ms) 2026-02-24T07:35:28.076 INFO:tasks.workunit.client.0.trial022.stdout:[----------] 8 tests from NeoRadosWriteOps (23041 ms total) 2026-02-24T07:35:28.076 INFO:tasks.workunit.client.0.trial022.stdout: 2026-02-24T07:35:28.076 INFO:tasks.workunit.client.0.trial022.stdout:[----------] Global test environment tear-down 2026-02-24T07:35:28.076 INFO:tasks.workunit.client.0.trial022.stdout:[==========] 8 tests from 1 test suite ran. (23041 ms total) 2026-02-24T07:35:28.076 INFO:tasks.workunit.client.0.trial022.stdout:[ PASSED ] 8 tests. 2026-02-24T07:35:28.080 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:35:28.080 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -eq 1 ']' 2026-02-24T07:35:28.080 INFO:tasks.workunit.client.0.trial022.stderr:+ exit 0 2026-02-24T07:35:28.080 INFO:tasks.workunit.client.0.trial022.stderr:+ cleanup 2026-02-24T07:35:28.081 INFO:tasks.workunit.client.0.trial022.stderr:+ pkill -P 77139 2026-02-24T07:35:28.090 INFO:tasks.workunit.client.0.trial022.stderr:+ true 2026-02-24T07:35:28.091 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-24T07:35:28.091 DEBUG:teuthology.orchestra.run.trial022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-24T07:35:28.118 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2026-02-24T07:35:28.121 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2026-02-24T07:35:28.121 DEBUG:teuthology.orchestra.run.trial022:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a78040ddef3ba5a489697ca2fe95df59a7d8bd08 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2026-02-24T07:35:28.178 INFO:tasks.workunit.client.0.trial022.stderr:++ uuidgen 2026-02-24T07:35:28.179 INFO:tasks.workunit.client.0.trial022.stderr:+ p=a2c74e2a-745f-46c9-86bd-7822655f6745 2026-02-24T07:35:28.179 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool create a2c74e2a-745f-46c9-86bd-7822655f6745 12 2026-02-24T07:35:28.234 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.232+0000 7fc7b47a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:35:28.235 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.232+0000 7fc7b47a4640 1 -- 10.20.193.22:0/30294462 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc7ac10ca70 msgr2=0x7fc7ac10ce80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:35:28.235 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.232+0000 7fc7b47a4640 1 --2- 10.20.193.22:0/30294462 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc7ac10ca70 0x7fc7ac10ce80 crc :-1 s=READY pgs=8938 gs=1 cs=0 l=1 c_cookie=15409144802358724232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:28.235 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.232+0000 7fc7b47a4640 1 -- 10.20.193.22:0/30294462 shutdown_connections 2026-02-24T07:35:28.235 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.232+0000 7fc7b47a4640 1 --2- 10.20.193.22:0/30294462 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc7ac10ca70 0x7fc7ac10ce80 unknown :-1 s=CLOSED pgs=8938 gs=1 cs=0 l=1 c_cookie=15409144802358724232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:28.235 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.232+0000 7fc7b47a4640 1 -- 10.20.193.22:0/30294462 >> 10.20.193.22:0/30294462 conn(0x7fc7ac0ea250 msgr2=0x7fc7ac10a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:35:28.235 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.232+0000 7fc7b47a4640 1 -- 10.20.193.22:0/30294462 shutdown_connections 2026-02-24T07:35:28.235 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.232+0000 7fc7b47a4640 1 -- 10.20.193.22:0/30294462 wait complete. 2026-02-24T07:35:28.235 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.232+0000 7fc7b47a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b47a4640 1 Processor -- start 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b47a4640 1 -- start start 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b47a4640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc7ac10ca70 0x7fc7ac0f18c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b47a4640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac0f1e00 con 0x7fc7ac10ca70 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b2519640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc7ac10ca70 0x7fc7ac0f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b2519640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc7ac10ca70 0x7fc7ac0f18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:60754/0 (socket says 10.20.193.22:60754) 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b2519640 1 -- 10.20.193.22:0/1075793885 learned_addr learned my addr 10.20.193.22:0/1075793885 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b2519640 1 -- 10.20.193.22:0/1075793885 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac0f1f40 con 0x7fc7ac10ca70 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b2519640 1 --2- 10.20.193.22:0/1075793885 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc7ac10ca70 0x7fc7ac0f18c0 crc :-1 s=READY pgs=8939 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7937fe640 1 -- 10.20.193.22:0/1075793885 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc79c00d690 con 0x7fc7ac10ca70 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ac0f2190 con 0x7fc7ac10ca70 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7937fe640 1 -- 10.20.193.22:0/1075793885 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fc79c00d7f0 con 0x7fc7ac10ca70 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7937fe640 1 -- 10.20.193.22:0/1075793885 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fc79c00fe70 con 0x7fc7ac10ca70 2026-02-24T07:35:28.236 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.233+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ac0f24e0 con 0x7fc7ac10ca70 2026-02-24T07:35:28.237 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.234+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ac10dd20 con 0x7fc7ac10ca70 2026-02-24T07:35:28.237 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.234+0000 7fc7937fe640 1 -- 10.20.193.22:0/1075793885 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7fc79c00e5c0 con 0x7fc7ac10ca70 2026-02-24T07:35:28.237 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.234+0000 7fc7937fe640 1 --2- 10.20.193.22:0/1075793885 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fc78803f9e0 0x7fc78805fef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:35:28.237 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.234+0000 7fc7937fe640 1 -- 10.20.193.22:0/1075793885 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(713..713 src has 1..713) ==== 4479+0+0 (crc 0 0 0) 0x7fc79c052c70 con 0x7fc7ac10ca70 2026-02-24T07:35:28.237 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.234+0000 7fc7b1d18640 1 --2- 10.20.193.22:0/1075793885 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fc78803f9e0 0x7fc78805fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:35:28.237 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.235+0000 7fc7b1d18640 1 --2- 10.20.193.22:0/1075793885 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fc78803f9e0 0x7fc78805fef0 crc :-1 s=READY pgs=2602 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:35:28.239 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.237+0000 7fc7937fe640 1 -- 10.20.193.22:0/1075793885 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fc79c00cc10 con 0x7fc7ac10ca70 2026-02-24T07:35:28.343 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:28.341+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pg_num": 12} v 0) -- 0x7fc7ac1346d0 con 0x7fc7ac10ca70 2026-02-24T07:35:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:28 trial022 ceph-mon[39108]: osdmap e712: 4 total, 4 up, 4 in 2026-02-24T07:35:29.078 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.075+0000 7fc7937fe640 1 -- 10.20.193.22:0/1075793885 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pg_num": 12}]=0 pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' created v714) ==== 176+0+0 (crc 0 0 0) 0x7fc79c009520 con 0x7fc7ac10ca70 2026-02-24T07:35:29.136 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.133+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pg_num": 12} v 0) -- 0x7fc7ac061c10 con 0x7fc7ac10ca70 2026-02-24T07:35:29.137 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.134+0000 7fc7937fe640 1 -- 10.20.193.22:0/1075793885 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pg_num": 12}]=0 pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' already exists v714) ==== 183+0+0 (crc 0 0 0) 0x7fc79c015640 con 0x7fc7ac10ca70 2026-02-24T07:35:29.137 INFO:tasks.workunit.client.0.trial022.stderr:pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' already exists 2026-02-24T07:35:29.138 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.135+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fc78803f9e0 msgr2=0x7fc78805fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:35:29.138 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.135+0000 7fc7b47a4640 1 --2- 10.20.193.22:0/1075793885 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fc78803f9e0 0x7fc78805fef0 crc :-1 s=READY pgs=2602 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:29.138 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.135+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc7ac10ca70 msgr2=0x7fc7ac0f18c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:35:29.138 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.135+0000 7fc7b47a4640 1 --2- 10.20.193.22:0/1075793885 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc7ac10ca70 0x7fc7ac0f18c0 crc :-1 s=READY pgs=8939 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:29.138 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.135+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 shutdown_connections 2026-02-24T07:35:29.138 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.135+0000 7fc7b47a4640 1 --2- 10.20.193.22:0/1075793885 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fc78803f9e0 0x7fc78805fef0 unknown :-1 s=CLOSED pgs=2602 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:29.139 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.135+0000 7fc7b47a4640 1 --2- 10.20.193.22:0/1075793885 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fc7ac10ca70 0x7fc7ac0f18c0 unknown :-1 s=CLOSED pgs=8939 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:29.139 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.135+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 >> 10.20.193.22:0/1075793885 conn(0x7fc7ac0ea250 msgr2=0x7fc7ac111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:35:29.139 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.135+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 shutdown_connections 2026-02-24T07:35:29.139 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.135+0000 7fc7b47a4640 1 -- 10.20.193.22:0/1075793885 wait complete. 2026-02-24T07:35:29.144 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool set-quota a2c74e2a-745f-46c9-86bd-7822655f6745 max_objects 10 2026-02-24T07:35:29.204 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:35:29.204 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/2482395855 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f7e5810fd60 msgr2=0x7f7e58110170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:35:29.204 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 --2- 10.20.193.22:0/2482395855 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f7e5810fd60 0x7f7e58110170 crc :-1 s=READY pgs=8940 gs=1 cs=0 l=1 c_cookie=11178479363215703323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:29.204 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/2482395855 shutdown_connections 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 --2- 10.20.193.22:0/2482395855 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f7e5810fd60 0x7f7e58110170 unknown :-1 s=CLOSED pgs=8940 gs=1 cs=0 l=1 c_cookie=11178479363215703323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/2482395855 >> 10.20.193.22:0/2482395855 conn(0x7f7e580ed5e0 msgr2=0x7f7e5810da30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/2482395855 shutdown_connections 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/2482395855 wait complete. 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 Processor -- start 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 -- start start 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f7e5810fd60 0x7f7e580f0970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.199+0000 7f7e5fd9c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580f0eb0 con 0x7f7e5810fd60 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e5db11640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f7e5810fd60 0x7f7e580f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:35:29.205 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e5db11640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f7e5810fd60 0x7f7e580f0970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:60778/0 (socket says 10.20.193.22:60778) 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e5db11640 1 -- 10.20.193.22:0/3839802575 learned_addr learned my addr 10.20.193.22:0/3839802575 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e5db11640 1 -- 10.20.193.22:0/3839802575 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e580f0ff0 con 0x7f7e5810fd60 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e5db11640 1 --2- 10.20.193.22:0/3839802575 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f7e5810fd60 0x7f7e580f0970 crc :-1 s=READY pgs=8941 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e46ffd640 1 -- 10.20.193.22:0/3839802575 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f7e4800d690 con 0x7f7e5810fd60 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e46ffd640 1 -- 10.20.193.22:0/3839802575 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f7e4800d7f0 con 0x7f7e5810fd60 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e46ffd640 1 -- 10.20.193.22:0/3839802575 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f7e4800fd70 con 0x7f7e5810fd60 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e580f1240 con 0x7f7e5810fd60 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e580f1590 con 0x7f7e5810fd60 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.200+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e581110d0 con 0x7f7e5810fd60 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.201+0000 7f7e46ffd640 1 -- 10.20.193.22:0/3839802575 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7f7e4800f6b0 con 0x7f7e5810fd60 2026-02-24T07:35:29.206 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.201+0000 7f7e46ffd640 1 --2- 10.20.193.22:0/3839802575 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f7e3403fa10 0x7f7e3405ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:35:29.207 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.201+0000 7f7e46ffd640 1 -- 10.20.193.22:0/3839802575 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(714..714 src has 1..714) ==== 4857+0+0 (crc 0 0 0) 0x7f7e48052c80 con 0x7f7e5810fd60 2026-02-24T07:35:29.207 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.201+0000 7f7e5d310640 1 --2- 10.20.193.22:0/3839802575 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f7e3403fa10 0x7f7e3405ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:35:29.207 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.201+0000 7f7e5d310640 1 --2- 10.20.193.22:0/3839802575 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f7e3403fa10 0x7f7e3405ff20 crc :-1 s=READY pgs=2603 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:35:29.207 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.203+0000 7f7e46ffd640 1 -- 10.20.193.22:0/3839802575 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f7e4800aaa0 con 0x7f7e5810fd60 2026-02-24T07:35:29.308 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:29.306+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "10"} v 0) -- 0x7f7e58137a60 con 0x7f7e5810fd60 2026-02-24T07:35:29.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:29 trial022 ceph-mon[39108]: pgmap v1114: 65 pgs: 32 unknown, 33 active+clean; 577 KiB data, 389 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:29.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:29 trial022 ceph-mon[39108]: osdmap e713: 4 total, 4 up, 4 in 2026-02-24T07:35:29.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:29 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1075793885' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pg_num": 12} : dispatch 2026-02-24T07:35:30.080 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:30.077+0000 7f7e46ffd640 1 -- 10.20.193.22:0/3839802575 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v715) ==== 223+0+0 (crc 0 0 0) 0x7f7e4800aaa0 con 0x7f7e5810fd60 2026-02-24T07:35:30.138 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:30.137+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "10"} v 0) -- 0x7f7e58138200 con 0x7f7e5810fd60 2026-02-24T07:35:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:30 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1075793885' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pg_num": 12}]': finished 2026-02-24T07:35:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:30 trial022 ceph-mon[39108]: osdmap e714: 4 total, 4 up, 4 in 2026-02-24T07:35:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:30 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1075793885' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pg_num": 12} : dispatch 2026-02-24T07:35:30.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:30 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3839802575' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "10"} : dispatch 2026-02-24T07:35:31.084 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.083+0000 7f7e46ffd640 1 -- 10.20.193.22:0/3839802575 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v716) ==== 223+0+0 (crc 0 0 0) 0x7f7e480071c0 con 0x7f7e5810fd60 2026-02-24T07:35:31.085 INFO:tasks.workunit.client.0.trial022.stderr:set-quota max_objects = 10 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 2026-02-24T07:35:31.087 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.085+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f7e3403fa10 msgr2=0x7f7e3405ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:35:31.087 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.085+0000 7f7e5fd9c640 1 --2- 10.20.193.22:0/3839802575 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f7e3403fa10 0x7f7e3405ff20 crc :-1 s=READY pgs=2603 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:31.087 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.085+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f7e5810fd60 msgr2=0x7f7e580f0970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:35:31.087 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.085+0000 7f7e5fd9c640 1 --2- 10.20.193.22:0/3839802575 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f7e5810fd60 0x7f7e580f0970 crc :-1 s=READY pgs=8941 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:31.088 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.085+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 shutdown_connections 2026-02-24T07:35:31.088 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.085+0000 7f7e5fd9c640 1 --2- 10.20.193.22:0/3839802575 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f7e3403fa10 0x7f7e3405ff20 unknown :-1 s=CLOSED pgs=2603 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:31.088 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.085+0000 7f7e5fd9c640 1 --2- 10.20.193.22:0/3839802575 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f7e5810fd60 0x7f7e580f0970 unknown :-1 s=CLOSED pgs=8941 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:31.088 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.085+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 >> 10.20.193.22:0/3839802575 conn(0x7f7e580ed5e0 msgr2=0x7f7e58112690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:35:31.088 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.085+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 shutdown_connections 2026-02-24T07:35:31.088 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.085+0000 7f7e5fd9c640 1 -- 10.20.193.22:0/3839802575 wait complete. 2026-02-24T07:35:31.094 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool application enable a2c74e2a-745f-46c9-86bd-7822655f6745 rados 2026-02-24T07:35:31.150 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.148+0000 7fe8e11b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:35:31.150 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.148+0000 7fe8e11b8640 1 -- 10.20.193.22:0/1292300585 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8dc10dba0 msgr2=0x7fe8dc10dfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:35:31.150 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.148+0000 7fe8e11b8640 1 --2- 10.20.193.22:0/1292300585 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8dc10dba0 0x7fe8dc10dfb0 crc :-1 s=READY pgs=8942 gs=1 cs=0 l=1 c_cookie=10006579458109945853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:31.150 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.148+0000 7fe8e11b8640 1 -- 10.20.193.22:0/1292300585 shutdown_connections 2026-02-24T07:35:31.150 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.148+0000 7fe8e11b8640 1 --2- 10.20.193.22:0/1292300585 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8dc10dba0 0x7fe8dc10dfb0 unknown :-1 s=CLOSED pgs=8942 gs=1 cs=0 l=1 c_cookie=10006579458109945853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:31.150 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.148+0000 7fe8e11b8640 1 -- 10.20.193.22:0/1292300585 >> 10.20.193.22:0/1292300585 conn(0x7fe8dc0eb360 msgr2=0x7fe8dc10b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:35:31.150 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.148+0000 7fe8e11b8640 1 -- 10.20.193.22:0/1292300585 shutdown_connections 2026-02-24T07:35:31.150 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.148+0000 7fe8e11b8640 1 -- 10.20.193.22:0/1292300585 wait complete. 2026-02-24T07:35:31.150 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8e11b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8e11b8640 1 Processor -- start 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8e11b8640 1 -- start start 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8e11b8640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8dc10dba0 0x7fe8dc0eea40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8e11b8640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc0eef80 con 0x7fe8dc10dba0 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8dad76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8dc10dba0 0x7fe8dc0eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8dad76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8dc10dba0 0x7fe8dc0eea40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:60798/0 (socket says 10.20.193.22:60798) 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8dad76640 1 -- 10.20.193.22:0/265704534 learned_addr learned my addr 10.20.193.22:0/265704534 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8dad76640 1 -- 10.20.193.22:0/265704534 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc0ef0c0 con 0x7fe8dc10dba0 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8dad76640 1 --2- 10.20.193.22:0/265704534 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8dc10dba0 0x7fe8dc0eea40 crc :-1 s=READY pgs=8943 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8bbfff640 1 -- 10.20.193.22:0/265704534 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe8d000d690 con 0x7fe8dc10dba0 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8bbfff640 1 -- 10.20.193.22:0/265704534 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fe8d000d7f0 con 0x7fe8dc10dba0 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8bbfff640 1 -- 10.20.193.22:0/265704534 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fe8d000fd70 con 0x7fe8dc10dba0 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.149+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc0ef310 con 0x7fe8dc10dba0 2026-02-24T07:35:31.151 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.150+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc0ef660 con 0x7fe8dc10dba0 2026-02-24T07:35:31.152 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.150+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc10ee50 con 0x7fe8dc10dba0 2026-02-24T07:35:31.152 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.150+0000 7fe8bbfff640 1 -- 10.20.193.22:0/265704534 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7fe8d00026a0 con 0x7fe8dc10dba0 2026-02-24T07:35:31.152 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.150+0000 7fe8bbfff640 1 --2- 10.20.193.22:0/265704534 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe8b003fa60 0x7fe8b005ff70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:35:31.152 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.150+0000 7fe8bbfff640 1 -- 10.20.193.22:0/265704534 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4857+0+0 (crc 0 0 0) 0x7fe8d0052ca0 con 0x7fe8dc10dba0 2026-02-24T07:35:31.152 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.150+0000 7fe8da575640 1 --2- 10.20.193.22:0/265704534 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe8b003fa60 0x7fe8b005ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:35:31.152 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.151+0000 7fe8da575640 1 --2- 10.20.193.22:0/265704534 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe8b003fa60 0x7fe8b005ff70 crc :-1 s=READY pgs=2604 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:35:31.153 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.152+0000 7fe8bbfff640 1 -- 10.20.193.22:0/265704534 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fe8d0007a50 con 0x7fe8dc10dba0 2026-02-24T07:35:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:35:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:35:30] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:35:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:31 trial022 ceph-mon[39108]: pgmap v1117: 45 pgs: 12 unknown, 33 active+clean; 577 KiB data, 389 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:31.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:31 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3839802575' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "10"}]': finished 2026-02-24T07:35:31.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:31 trial022 ceph-mon[39108]: osdmap e715: 4 total, 4 up, 4 in 2026-02-24T07:35:31.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:31 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3839802575' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "10"} : dispatch 2026-02-24T07:35:31.256 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:31.255+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "app": "rados"} v 0) -- 0x7fe8dc135890 con 0x7fe8dc10dba0 2026-02-24T07:35:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:35:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:35:30.954Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:35:32.087 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:32.086+0000 7fe8bbfff640 1 -- 10.20.193.22:0/265704534 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "app": "rados"}]=0 enabled application 'rados' on pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' v717) ==== 213+0+0 (crc 0 0 0) 0x7fe8d0007a50 con 0x7fe8dc10dba0 2026-02-24T07:35:32.146 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:32.145+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "app": "rados"} v 0) -- 0x7fe8dc063de0 con 0x7fe8dc10dba0 2026-02-24T07:35:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:32 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3839802575' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "10"}]': finished 2026-02-24T07:35:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:32 trial022 ceph-mon[39108]: osdmap e716: 4 total, 4 up, 4 in 2026-02-24T07:35:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:32 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/265704534' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "app": "rados"} : dispatch 2026-02-24T07:35:32.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:32 trial022 ceph-mon[39108]: pgmap v1120: 45 pgs: 45 active+clean; 577 KiB data, 389 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:33.090 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.088+0000 7fe8bbfff640 1 -- 10.20.193.22:0/265704534 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "app": "rados"}]=0 enabled application 'rados' on pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' v718) ==== 213+0+0 (crc 0 0 0) 0x7fe8d0007a50 con 0x7fe8dc10dba0 2026-02-24T07:35:33.090 INFO:tasks.workunit.client.0.trial022.stderr:enabled application 'rados' on pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' 2026-02-24T07:35:33.094 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.092+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe8b003fa60 msgr2=0x7fe8b005ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:35:33.095 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.092+0000 7fe8e11b8640 1 --2- 10.20.193.22:0/265704534 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe8b003fa60 0x7fe8b005ff70 crc :-1 s=READY pgs=2604 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:33.095 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.092+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8dc10dba0 msgr2=0x7fe8dc0eea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:35:33.095 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.092+0000 7fe8e11b8640 1 --2- 10.20.193.22:0/265704534 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8dc10dba0 0x7fe8dc0eea40 crc :-1 s=READY pgs=8943 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:33.095 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.092+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 shutdown_connections 2026-02-24T07:35:33.095 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.092+0000 7fe8e11b8640 1 --2- 10.20.193.22:0/265704534 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fe8b003fa60 0x7fe8b005ff70 unknown :-1 s=CLOSED pgs=2604 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:33.095 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.092+0000 7fe8e11b8640 1 --2- 10.20.193.22:0/265704534 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fe8dc10dba0 0x7fe8dc0eea40 unknown :-1 s=CLOSED pgs=8943 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:35:33.095 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.092+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 >> 10.20.193.22:0/265704534 conn(0x7fe8dc0eb360 msgr2=0x7fe8dc13ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:35:33.095 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.092+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 shutdown_connections 2026-02-24T07:35:33.095 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:35:33.092+0000 7fe8e11b8640 1 -- 10.20.193.22:0/265704534 wait complete. 2026-02-24T07:35:33.102 INFO:tasks.workunit.client.0.trial022.stderr:++ seq 1 10 2026-02-24T07:35:33.102 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:35:33.102 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put obj1 /etc/passwd 2026-02-24T07:35:33.133 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:35:33.133 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put obj2 /etc/passwd 2026-02-24T07:35:33.163 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:35:33.163 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put obj3 /etc/passwd 2026-02-24T07:35:33.193 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:35:33.194 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put obj4 /etc/passwd 2026-02-24T07:35:33.222 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:35:33.222 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put obj5 /etc/passwd 2026-02-24T07:35:33.251 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:35:33.251 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put obj6 /etc/passwd 2026-02-24T07:35:33.280 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:35:33.280 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put obj7 /etc/passwd 2026-02-24T07:35:33.309 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:35:33.309 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put obj8 /etc/passwd 2026-02-24T07:35:33.339 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:35:33.339 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put obj9 /etc/passwd 2026-02-24T07:35:33.369 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:35:33.369 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put obj10 /etc/passwd 2026-02-24T07:35:33.398 INFO:tasks.workunit.client.0.trial022.stderr:+ sleep 30 2026-02-24T07:35:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:33 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/265704534' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "app": "rados"}]': finished 2026-02-24T07:35:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:33 trial022 ceph-mon[39108]: osdmap e717: 4 total, 4 up, 4 in 2026-02-24T07:35:33.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:33 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/265704534' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "app": "rados"} : dispatch 2026-02-24T07:35:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:34 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/265704534' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "app": "rados"}]': finished 2026-02-24T07:35:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:34 trial022 ceph-mon[39108]: osdmap e718: 4 total, 4 up, 4 in 2026-02-24T07:35:34.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:34 trial022 ceph-mon[39108]: pgmap v1123: 45 pgs: 45 active+clean; 577 KiB data, 389 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:36 trial022 ceph-mon[39108]: pgmap v1124: 45 pgs: 45 active+clean; 577 KiB data, 389 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:38 trial022 ceph-mon[39108]: pgmap v1125: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 22 KiB/s wr, 1 op/s 2026-02-24T07:35:40.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:39 trial022 ceph-mon[39108]: pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' is full (reached quota's max_objects: 10) 2026-02-24T07:35:40.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:39 trial022 ceph-mon[39108]: Health check failed: 1 pool(s) full (POOL_FULL) 2026-02-24T07:35:40.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:39 trial022 ceph-mon[39108]: osdmap e719: 4 total, 4 up, 4 in 2026-02-24T07:35:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:40 trial022 ceph-mon[39108]: pgmap v1127: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 19 KiB/s wr, 1 op/s 2026-02-24T07:35:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:35:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:35:40] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:35:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:35:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:35:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:35:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:42 trial022 ceph-mon[39108]: pgmap v1128: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 17 KiB/s wr, 1 op/s 2026-02-24T07:35:45.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:44 trial022 ceph-mon[39108]: pgmap v1129: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s wr, 0 op/s 2026-02-24T07:35:47.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:46 trial022 ceph-mon[39108]: pgmap v1130: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s wr, 0 op/s 2026-02-24T07:35:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:48 trial022 ceph-mon[39108]: pgmap v1131: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:50 trial022 ceph-mon[39108]: pgmap v1132: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:35:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:35:50] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:35:51.287 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:35:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:35:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:35:53.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:52 trial022 ceph-mon[39108]: pgmap v1133: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:55.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:54 trial022 ceph-mon[39108]: pgmap v1134: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:57.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:56 trial022 ceph-mon[39108]: pgmap v1135: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:35:59.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:35:58 trial022 ceph-mon[39108]: pgmap v1136: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:00.950 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:00 trial022 ceph-mon[39108]: pgmap v1137: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:36:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:36:00] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:36:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:36:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:36:00.952Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:36:03.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:02 trial022 ceph-mon[39108]: pgmap v1138: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:03.400 INFO:tasks.workunit.client.0.trial022.stderr:+ pid=145273 2026-02-24T07:36:03.400 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool set-quota a2c74e2a-745f-46c9-86bd-7822655f6745 max_objects 100 2026-02-24T07:36:03.400 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put onemore /etc/passwd 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.455+0000 7fec899dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.455+0000 7fec899dc640 1 -- 10.20.193.22:0/1098019668 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fec8410fd60 msgr2=0x7fec84110170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.455+0000 7fec899dc640 1 --2- 10.20.193.22:0/1098019668 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fec8410fd60 0x7fec84110170 crc :-1 s=READY pgs=8977 gs=1 cs=0 l=1 c_cookie=6866198781389038331 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.455+0000 7fec899dc640 1 -- 10.20.193.22:0/1098019668 shutdown_connections 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.455+0000 7fec899dc640 1 --2- 10.20.193.22:0/1098019668 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fec8410fd60 0x7fec84110170 unknown :-1 s=CLOSED pgs=8977 gs=1 cs=0 l=1 c_cookie=6866198781389038331 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.455+0000 7fec899dc640 1 -- 10.20.193.22:0/1098019668 >> 10.20.193.22:0/1098019668 conn(0x7fec840ed5e0 msgr2=0x7fec8410da30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.455+0000 7fec899dc640 1 -- 10.20.193.22:0/1098019668 shutdown_connections 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.455+0000 7fec899dc640 1 -- 10.20.193.22:0/1098019668 wait complete. 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.455+0000 7fec899dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec899dc640 1 Processor -- start 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec899dc640 1 -- start start 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec899dc640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fec8410fd60 0x7fec840f0970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec899dc640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fec840f0eb0 con 0x7fec8410fd60 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec82ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fec8410fd60 0x7fec840f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec82ffd640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fec8410fd60 0x7fec840f0970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:59396/0 (socket says 10.20.193.22:59396) 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec82ffd640 1 -- 10.20.193.22:0/2705868257 learned_addr learned my addr 10.20.193.22:0/2705868257 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec82ffd640 1 -- 10.20.193.22:0/2705868257 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec840f0ff0 con 0x7fec8410fd60 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec82ffd640 1 --2- 10.20.193.22:0/2705868257 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fec8410fd60 0x7fec840f0970 crc :-1 s=READY pgs=8978 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fec7800d690 con 0x7fec8410fd60 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fec7800d7f0 con 0x7fec8410fd60 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec840f1240 con 0x7fec8410fd60 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fec7800fd70 con 0x7fec8410fd60 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.456+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec840f1590 con 0x7fec8410fd60 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.457+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec841110d0 con 0x7fec8410fd60 2026-02-24T07:36:03.460 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.457+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7fec7800e5c0 con 0x7fec8410fd60 2026-02-24T07:36:03.461 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.457+0000 7fec889da640 1 --2- 10.20.193.22:0/2705868257 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fec5803fa60 0x7fec5805ff70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:03.461 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.457+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(719..719 src has 1..719) ==== 4870+0+0 (crc 0 0 0) 0x7fec78052d30 con 0x7fec8410fd60 2026-02-24T07:36:03.461 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.457+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=720}) -- 0x7fec58064450 con 0x7fec8410fd60 2026-02-24T07:36:03.461 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.457+0000 7fec827fc640 1 --2- 10.20.193.22:0/2705868257 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fec5803fa60 0x7fec5805ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:03.461 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.458+0000 7fec827fc640 1 --2- 10.20.193.22:0/2705868257 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fec5803fa60 0x7fec5805ff70 crc :-1 s=READY pgs=2616 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:03.461 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.460+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fec7800cc10 con 0x7fec8410fd60 2026-02-24T07:36:03.565 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.563+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "100"} v 0) -- 0x7fec84137a60 con 0x7fec8410fd60 2026-02-24T07:36:03.975 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.974+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v720) ==== 225+0+0 (crc 0 0 0) 0x7fec78025180 con 0x7fec8410fd60 2026-02-24T07:36:03.976 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.974+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 <== mon.0 v2:10.20.193.22:3300/0 8 ==== osd_map(720..720 src has 1..720) ==== 631+0+0 (crc 0 0 0) 0x7fec78015940 con 0x7fec8410fd60 2026-02-24T07:36:03.976 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:03.974+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=721}) -- 0x7fec58065410 con 0x7fec8410fd60 2026-02-24T07:36:04.034 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.033+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "100"} v 0) -- 0x7fec841383b0 con 0x7fec8410fd60 2026-02-24T07:36:04.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:03 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2705868257' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "100"} : dispatch 2026-02-24T07:36:04.496 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.494+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 <== mon.0 v2:10.20.193.22:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v721) ==== 225+0+0 (crc 0 0 0) 0x7fec78015130 con 0x7fec8410fd60 2026-02-24T07:36:04.496 INFO:tasks.workunit.client.0.trial022.stderr:set-quota max_objects = 100 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 2026-02-24T07:36:04.496 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.494+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 <== mon.0 v2:10.20.193.22:3300/0 10 ==== osd_map(721..721 src has 1..721) ==== 631+0+0 (crc 0 0 0) 0x7fec78051750 con 0x7fec8410fd60 2026-02-24T07:36:04.496 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.494+0000 7fec889da640 1 -- 10.20.193.22:0/2705868257 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=722}) -- 0x7fec58065500 con 0x7fec8410fd60 2026-02-24T07:36:04.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.497+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fec5803fa60 msgr2=0x7fec5805ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:04.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.497+0000 7fec899dc640 1 --2- 10.20.193.22:0/2705868257 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fec5803fa60 0x7fec5805ff70 crc :-1 s=READY pgs=2616 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:04.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.497+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fec8410fd60 msgr2=0x7fec840f0970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:04.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.497+0000 7fec899dc640 1 --2- 10.20.193.22:0/2705868257 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fec8410fd60 0x7fec840f0970 crc :-1 s=READY pgs=8978 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:04.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.497+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 shutdown_connections 2026-02-24T07:36:04.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.497+0000 7fec899dc640 1 --2- 10.20.193.22:0/2705868257 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fec5803fa60 0x7fec5805ff70 unknown :-1 s=CLOSED pgs=2616 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:04.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.497+0000 7fec899dc640 1 --2- 10.20.193.22:0/2705868257 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fec8410fd60 0x7fec840f0970 unknown :-1 s=CLOSED pgs=8978 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:04.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.497+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 >> 10.20.193.22:0/2705868257 conn(0x7fec840ed5e0 msgr2=0x7fec84112690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:04.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.497+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 shutdown_connections 2026-02-24T07:36:04.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.497+0000 7fec899dc640 1 -- 10.20.193.22:0/2705868257 wait complete. 2026-02-24T07:36:04.507 INFO:tasks.workunit.client.0.trial022.stderr:+ wait 145273 2026-02-24T07:36:04.507 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -ne 0 ']' 2026-02-24T07:36:04.507 INFO:tasks.workunit.client.0.trial022.stderr:+ true 2026-02-24T07:36:04.508 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put twomore /etc/passwd 2026-02-24T07:36:04.537 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool set-quota a2c74e2a-745f-46c9-86bd-7822655f6745 max_bytes 100 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.590+0000 7f6098b5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.590+0000 7f6098b5c640 1 -- 10.20.193.22:0/2482763626 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f609410dba0 msgr2=0x7f609410dfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.590+0000 7f6098b5c640 1 --2- 10.20.193.22:0/2482763626 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f609410dba0 0x7f609410dfb0 crc :-1 s=READY pgs=8982 gs=1 cs=0 l=1 c_cookie=572877307686998670 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.590+0000 7f6098b5c640 1 -- 10.20.193.22:0/2482763626 shutdown_connections 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6098b5c640 1 --2- 10.20.193.22:0/2482763626 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f609410dba0 0x7f609410dfb0 unknown :-1 s=CLOSED pgs=8982 gs=1 cs=0 l=1 c_cookie=572877307686998670 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6098b5c640 1 -- 10.20.193.22:0/2482763626 >> 10.20.193.22:0/2482763626 conn(0x7f60940eb3a0 msgr2=0x7f609410b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6098b5c640 1 -- 10.20.193.22:0/2482763626 shutdown_connections 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6098b5c640 1 -- 10.20.193.22:0/2482763626 wait complete. 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6098b5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6098b5c640 1 Processor -- start 2026-02-24T07:36:04.594 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6098b5c640 1 -- start start 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6098b5c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f609410dba0 0x7f60940eeae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6098b5c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f60940ef020 con 0x7f609410dba0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6092575640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f609410dba0 0x7f60940eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6092575640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f609410dba0 0x7f60940eeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:59444/0 (socket says 10.20.193.22:59444) 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6092575640 1 -- 10.20.193.22:0/1811977425 learned_addr learned my addr 10.20.193.22:0/1811977425 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6092575640 1 -- 10.20.193.22:0/1811977425 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60940ef160 con 0x7f609410dba0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f6092575640 1 --2- 10.20.193.22:0/1811977425 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f609410dba0 0x7f60940eeae0 crc :-1 s=READY pgs=8983 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.591+0000 7f607b7fe640 1 -- 10.20.193.22:0/1811977425 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f608800d690 con 0x7f609410dba0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.592+0000 7f607b7fe640 1 -- 10.20.193.22:0/1811977425 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f608800d7f0 con 0x7f609410dba0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.592+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60940ef3b0 con 0x7f609410dba0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.592+0000 7f607b7fe640 1 -- 10.20.193.22:0/1811977425 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f608800fd70 con 0x7f609410dba0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.592+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60940ef700 con 0x7f609410dba0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.592+0000 7f607b7fe640 1 -- 10.20.193.22:0/1811977425 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7f608800e5c0 con 0x7f609410dba0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.592+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609410ee50 con 0x7f609410dba0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.592+0000 7f607b7fe640 1 --2- 10.20.193.22:0/1811977425 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f606c03fa60 0x7f606c05ff70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.592+0000 7f607b7fe640 1 -- 10.20.193.22:0/1811977425 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(721..721 src has 1..721) ==== 4870+0+0 (crc 0 0 0) 0x7f6088053d70 con 0x7f609410dba0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.593+0000 7f6091d74640 1 --2- 10.20.193.22:0/1811977425 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f606c03fa60 0x7f606c05ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:04.595 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.593+0000 7f6091d74640 1 --2- 10.20.193.22:0/1811977425 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f606c03fa60 0x7f606c05ff70 crc :-1 s=READY pgs=2618 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:04.596 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.595+0000 7f607b7fe640 1 -- 10.20.193.22:0/1811977425 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f608800cc10 con 0x7f609410dba0 2026-02-24T07:36:04.701 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:04.700+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "100"} v 0) -- 0x7f6094135890 con 0x7f609410dba0 2026-02-24T07:36:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:04 trial022 ceph-mon[39108]: pgmap v1139: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:04 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2705868257' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "100"}]': finished 2026-02-24T07:36:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:04 trial022 ceph-mon[39108]: osdmap e720: 4 total, 4 up, 4 in 2026-02-24T07:36:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:04 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2705868257' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "100"} : dispatch 2026-02-24T07:36:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:04 trial022 ceph-mon[39108]: pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' no longer out of quota; removing NO_QUOTA flag 2026-02-24T07:36:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:04 trial022 ceph-mon[39108]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2026-02-24T07:36:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:04 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2705868257' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "100"}]': finished 2026-02-24T07:36:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:04 trial022 ceph-mon[39108]: osdmap e721: 4 total, 4 up, 4 in 2026-02-24T07:36:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:04 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1811977425' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "100"} : dispatch 2026-02-24T07:36:05.496 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:05.494+0000 7f607b7fe640 1 -- 10.20.193.22:0/1811977425 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v722) ==== 221+0+0 (crc 0 0 0) 0x7f6088015640 con 0x7f609410dba0 2026-02-24T07:36:05.555 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:05.554+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "100"} v 0) -- 0x7f6094063c10 con 0x7f609410dba0 2026-02-24T07:36:06.498 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.496+0000 7f607b7fe640 1 -- 10.20.193.22:0/1811977425 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v723) ==== 221+0+0 (crc 0 0 0) 0x7f6088015e40 con 0x7f609410dba0 2026-02-24T07:36:06.498 INFO:tasks.workunit.client.0.trial022.stderr:set-quota max_bytes = 100 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 2026-02-24T07:36:06.501 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.499+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f606c03fa60 msgr2=0x7f606c05ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:06.501 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.499+0000 7f6098b5c640 1 --2- 10.20.193.22:0/1811977425 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f606c03fa60 0x7f606c05ff70 crc :-1 s=READY pgs=2618 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:06.501 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.499+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f609410dba0 msgr2=0x7f60940eeae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:06.501 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.499+0000 7f6098b5c640 1 --2- 10.20.193.22:0/1811977425 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f609410dba0 0x7f60940eeae0 crc :-1 s=READY pgs=8983 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:06.501 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.499+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 shutdown_connections 2026-02-24T07:36:06.501 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.499+0000 7f6098b5c640 1 --2- 10.20.193.22:0/1811977425 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f606c03fa60 0x7f606c05ff70 unknown :-1 s=CLOSED pgs=2618 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:06.501 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.499+0000 7f6098b5c640 1 --2- 10.20.193.22:0/1811977425 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f609410dba0 0x7f60940eeae0 unknown :-1 s=CLOSED pgs=8983 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:06.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.499+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 >> 10.20.193.22:0/1811977425 conn(0x7f60940eb3a0 msgr2=0x7f6094111460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:06.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.499+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 shutdown_connections 2026-02-24T07:36:06.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:06.500+0000 7f6098b5c640 1 -- 10.20.193.22:0/1811977425 wait complete. 2026-02-24T07:36:06.509 INFO:tasks.workunit.client.0.trial022.stderr:+ sleep 30 2026-02-24T07:36:06.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:06 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1811977425' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "100"}]': finished 2026-02-24T07:36:06.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:06 trial022 ceph-mon[39108]: osdmap e722: 4 total, 4 up, 4 in 2026-02-24T07:36:06.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:06 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1811977425' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "100"} : dispatch 2026-02-24T07:36:06.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:06 trial022 ceph-mon[39108]: pgmap v1143: 45 pgs: 45 active+clean; 725 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:07.990 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:07 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1811977425' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "100"}]': finished 2026-02-24T07:36:07.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:07 trial022 ceph-mon[39108]: osdmap e723: 4 total, 4 up, 4 in 2026-02-24T07:36:08.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:08 trial022 ceph-mon[39108]: pgmap v1145: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 7.5 KiB/s wr, 0 op/s 2026-02-24T07:36:09.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:09 trial022 ceph-mon[39108]: pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' is full (reached quota's max_bytes: 100 B) 2026-02-24T07:36:09.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:09 trial022 ceph-mon[39108]: Health check failed: 1 pool(s) full (POOL_FULL) 2026-02-24T07:36:09.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:09 trial022 ceph-mon[39108]: osdmap e724: 4 total, 4 up, 4 in 2026-02-24T07:36:10.951 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:10 trial022 ceph-mon[39108]: pgmap v1147: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 5.5 KiB/s wr, 0 op/s 2026-02-24T07:36:11.240 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:36:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:36:10] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:36:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:36:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:36:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:36:13.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:12 trial022 ceph-mon[39108]: pgmap v1148: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 4.7 KiB/s wr, 0 op/s 2026-02-24T07:36:15.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:14 trial022 ceph-mon[39108]: pgmap v1149: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 3.7 KiB/s wr, 0 op/s 2026-02-24T07:36:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:16 trial022 ceph-mon[39108]: pgmap v1150: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 3.2 KiB/s wr, 0 op/s 2026-02-24T07:36:19.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:18 trial022 ceph-mon[39108]: pgmap v1151: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:20 trial022 ceph-mon[39108]: pgmap v1152: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:36:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:36:20] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:36:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:36:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:36:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:36:23.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:22 trial022 ceph-mon[39108]: pgmap v1153: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:24 trial022 ceph-mon[39108]: pgmap v1154: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:26 trial022 ceph-mon[39108]: pgmap v1155: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:36:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:36:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:36:27.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:36:27.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:36:29.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:28 trial022 ceph-mon[39108]: pgmap v1156: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:31.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:30 trial022 ceph-mon[39108]: pgmap v1157: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:36:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:36:30] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:36:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:36:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:36:30.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:36:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:32 trial022 ceph-mon[39108]: pgmap v1158: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:35.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:34 trial022 ceph-mon[39108]: pgmap v1159: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:36.510 INFO:tasks.workunit.client.0.trial022.stderr:+ pid=145465 2026-02-24T07:36:36.511 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool set-quota a2c74e2a-745f-46c9-86bd-7822655f6745 max_bytes 0 2026-02-24T07:36:36.511 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put two /etc/passwd 2026-02-24T07:36:36.571 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.567+0000 7ff6a8cc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:36.571 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.567+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/1898572404 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff6a4116160 msgr2=0x7ff6a4116570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:36.571 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.567+0000 7ff6a8cc2640 1 --2- 10.20.193.22:0/1898572404 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff6a4116160 0x7ff6a4116570 crc :-1 s=READY pgs=8987 gs=1 cs=0 l=1 c_cookie=17557985781108106396 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:36.571 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.567+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/1898572404 shutdown_connections 2026-02-24T07:36:36.571 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.567+0000 7ff6a8cc2640 1 --2- 10.20.193.22:0/1898572404 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff6a4116160 0x7ff6a4116570 unknown :-1 s=CLOSED pgs=8987 gs=1 cs=0 l=1 c_cookie=17557985781108106396 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.567+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/1898572404 >> 10.20.193.22:0/1898572404 conn(0x7ff6a405e4f0 msgr2=0x7ff6a41140d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.567+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/1898572404 shutdown_connections 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.567+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/1898572404 wait complete. 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.567+0000 7ff6a8cc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a8cc2640 1 Processor -- start 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a8cc2640 1 -- start start 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a8cc2640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff6a4116160 0x7ff6a4059610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a8cc2640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a4057a90 con 0x7ff6a4116160 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a2575640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff6a4116160 0x7ff6a4059610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a2575640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff6a4116160 0x7ff6a4059610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46166/0 (socket says 10.20.193.22:46166) 2026-02-24T07:36:36.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a2575640 1 -- 10.20.193.22:0/3176054380 learned_addr learned my addr 10.20.193.22:0/3176054380 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a2575640 1 -- 10.20.193.22:0/3176054380 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a4057bd0 con 0x7ff6a4116160 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a2575640 1 --2- 10.20.193.22:0/3176054380 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff6a4116160 0x7ff6a4059610 crc :-1 s=READY pgs=8988 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff69800d690 con 0x7ff6a4116160 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a4057e20 con 0x7ff6a4116160 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7ff69800d7f0 con 0x7ff6a4116160 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7ff69800fd70 con 0x7ff6a4116160 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.568+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a4058310 con 0x7ff6a4116160 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.569+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7ff69800e5c0 con 0x7ff6a4116160 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.569+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a4117410 con 0x7ff6a4116160 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.569+0000 7ff68b7fe640 1 --2- 10.20.193.22:0/3176054380 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff67c03fa10 0x7ff67c05ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.569+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 4870+0+0 (crc 0 0 0) 0x7ff698052d70 con 0x7ff6a4116160 2026-02-24T07:36:36.573 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.569+0000 7ff6a1d74640 1 --2- 10.20.193.22:0/3176054380 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff67c03fa10 0x7ff67c05ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:36.574 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.569+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=725}) -- 0x7ff67c064400 con 0x7ff6a4116160 2026-02-24T07:36:36.574 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.569+0000 7ff6a1d74640 1 --2- 10.20.193.22:0/3176054380 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff67c03fa10 0x7ff67c05ff20 crc :-1 s=READY pgs=2629 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:36.574 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.571+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7ff69800cc10 con 0x7ff6a4116160 2026-02-24T07:36:36.679 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.677+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"} v 0) -- 0x7ff6a413de50 con 0x7ff6a4116160 2026-02-24T07:36:36.985 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.983+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v725) ==== 217+0+0 (crc 0 0 0) 0x7ff698015640 con 0x7ff6a4116160 2026-02-24T07:36:36.985 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.983+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 <== mon.0 v2:10.20.193.22:3300/0 8 ==== osd_map(725..725 src has 1..725) ==== 631+0+0 (crc 0 0 0) 0x7ff698014e40 con 0x7ff6a4116160 2026-02-24T07:36:36.985 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:36.983+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=726}) -- 0x7ff67c065200 con 0x7ff6a4116160 2026-02-24T07:36:37.044 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.042+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"} v 0) -- 0x7ff6a413e5f0 con 0x7ff6a4116160 2026-02-24T07:36:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:36 trial022 ceph-mon[39108]: pgmap v1160: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:37.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:36 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3176054380' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"} : dispatch 2026-02-24T07:36:37.987 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.985+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 <== mon.0 v2:10.20.193.22:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v726) ==== 217+0+0 (crc 0 0 0) 0x7ff698015e40 con 0x7ff6a4116160 2026-02-24T07:36:37.987 INFO:tasks.workunit.client.0.trial022.stderr:set-quota max_bytes = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 2026-02-24T07:36:37.988 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.987+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 <== mon.0 v2:10.20.193.22:3300/0 10 ==== osd_map(726..726 src has 1..726) ==== 631+0+0 (crc 0 0 0) 0x7ff698026180 con 0x7ff6a4116160 2026-02-24T07:36:37.989 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.987+0000 7ff68b7fe640 1 -- 10.20.193.22:0/3176054380 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=727}) -- 0x7ff67c0654b0 con 0x7ff6a4116160 2026-02-24T07:36:37.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.990+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff67c03fa10 msgr2=0x7ff67c05ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:37.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.990+0000 7ff6a8cc2640 1 --2- 10.20.193.22:0/3176054380 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff67c03fa10 0x7ff67c05ff20 crc :-1 s=READY pgs=2629 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:37.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.990+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff6a4116160 msgr2=0x7ff6a4059610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:37.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.990+0000 7ff6a8cc2640 1 --2- 10.20.193.22:0/3176054380 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff6a4116160 0x7ff6a4059610 crc :-1 s=READY pgs=8988 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:37.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.990+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 shutdown_connections 2026-02-24T07:36:37.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.990+0000 7ff6a8cc2640 1 --2- 10.20.193.22:0/3176054380 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7ff67c03fa10 0x7ff67c05ff20 unknown :-1 s=CLOSED pgs=2629 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:37.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.990+0000 7ff6a8cc2640 1 --2- 10.20.193.22:0/3176054380 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7ff6a4116160 0x7ff6a4059610 unknown :-1 s=CLOSED pgs=8988 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:37.993 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.990+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 >> 10.20.193.22:0/3176054380 conn(0x7ff6a405e4f0 msgr2=0x7ff6a4143220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:37.993 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.990+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 shutdown_connections 2026-02-24T07:36:37.993 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:37.990+0000 7ff6a8cc2640 1 -- 10.20.193.22:0/3176054380 wait complete. 2026-02-24T07:36:37.999 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool set-quota a2c74e2a-745f-46c9-86bd-7822655f6745 max_objects 0 2026-02-24T07:36:38.059 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.052+0000 7f9d4721a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:38.059 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.052+0000 7f9d4721a640 1 -- 10.20.193.22:0/3760040141 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9d4010fdd0 msgr2=0x7f9d401101e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:38.059 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.052+0000 7f9d4721a640 1 --2- 10.20.193.22:0/3760040141 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9d4010fdd0 0x7f9d401101e0 crc :-1 s=READY pgs=8989 gs=1 cs=0 l=1 c_cookie=16765932195596514162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:38.059 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.052+0000 7f9d4721a640 1 -- 10.20.193.22:0/3760040141 shutdown_connections 2026-02-24T07:36:38.059 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.052+0000 7f9d4721a640 1 --2- 10.20.193.22:0/3760040141 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9d4010fdd0 0x7f9d401101e0 unknown :-1 s=CLOSED pgs=8989 gs=1 cs=0 l=1 c_cookie=16765932195596514162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:38.060 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.052+0000 7f9d4721a640 1 -- 10.20.193.22:0/3760040141 >> 10.20.193.22:0/3760040141 conn(0x7f9d400ed6f0 msgr2=0x7f9d4010db40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:38.060 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.052+0000 7f9d4721a640 1 -- 10.20.193.22:0/3760040141 shutdown_connections 2026-02-24T07:36:38.060 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.052+0000 7f9d4721a640 1 -- 10.20.193.22:0/3760040141 wait complete. 2026-02-24T07:36:38.060 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d4721a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:38.060 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d4721a640 1 Processor -- start 2026-02-24T07:36:38.060 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d4721a640 1 -- start start 2026-02-24T07:36:38.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d4721a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9d4010fdd0 0x7f9d400f0af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:38.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d4721a640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9d400f1030 con 0x7f9d4010fdd0 2026-02-24T07:36:38.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d44f8f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9d4010fdd0 0x7f9d400f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:38.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d44f8f640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9d4010fdd0 0x7f9d400f0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46178/0 (socket says 10.20.193.22:46178) 2026-02-24T07:36:38.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d44f8f640 1 -- 10.20.193.22:0/2669909411 learned_addr learned my addr 10.20.193.22:0/2669909411 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:36:38.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d44f8f640 1 -- 10.20.193.22:0/2669909411 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d400f1170 con 0x7f9d4010fdd0 2026-02-24T07:36:38.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d44f8f640 1 --2- 10.20.193.22:0/2669909411 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9d4010fdd0 0x7f9d400f0af0 crc :-1 s=READY pgs=8990 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f9d3000d690 con 0x7f9d4010fdd0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d400f13c0 con 0x7f9d4010fdd0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f9d3000d7f0 con 0x7f9d4010fdd0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f9d3000fd70 con 0x7f9d4010fdd0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.053+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d400f1710 con 0x7f9d4010fdd0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.054+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d40111140 con 0x7f9d4010fdd0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.054+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7f9d3000e5c0 con 0x7f9d4010fdd0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.054+0000 7f9d35ffb640 1 --2- 10.20.193.22:0/2669909411 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f9d1c03fa60 0x7f9d1c05ff70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.054+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(726..726 src has 1..726) ==== 4870+0+0 (crc 0 0 0) 0x7f9d30052c60 con 0x7f9d4010fdd0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.055+0000 7f9d37fff640 1 --2- 10.20.193.22:0/2669909411 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f9d1c03fa60 0x7f9d1c05ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.055+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=727}) -- 0x7f9d1c064450 con 0x7f9d4010fdd0 2026-02-24T07:36:38.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.055+0000 7f9d37fff640 1 --2- 10.20.193.22:0/2669909411 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f9d1c03fa60 0x7f9d1c05ff70 crc :-1 s=READY pgs=2630 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:38.063 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.056+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f9d3000cc10 con 0x7f9d4010fdd0 2026-02-24T07:36:38.162 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.161+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"} v 0) -- 0x7f9d40137ad0 con 0x7f9d4010fdd0 2026-02-24T07:36:38.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:37 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3176054380' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"}]': finished 2026-02-24T07:36:38.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:37 trial022 ceph-mon[39108]: osdmap e725: 4 total, 4 up, 4 in 2026-02-24T07:36:38.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:37 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3176054380' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"} : dispatch 2026-02-24T07:36:38.991 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.990+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v727) ==== 221+0+0 (crc 0 0 0) 0x7f9d30015640 con 0x7f9d4010fdd0 2026-02-24T07:36:38.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.990+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 <== mon.0 v2:10.20.193.22:3300/0 8 ==== osd_map(727..727 src has 1..727) ==== 631+0+0 (crc 0 0 0) 0x7f9d30026100 con 0x7f9d4010fdd0 2026-02-24T07:36:38.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:38.990+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=728}) -- 0x7f9d1c065410 con 0x7f9d4010fdd0 2026-02-24T07:36:39.049 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.048+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"} v 0) -- 0x7f9d40138430 con 0x7f9d4010fdd0 2026-02-24T07:36:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:38 trial022 ceph-mon[39108]: pgmap v1162: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:38 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3176054380' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"}]': finished 2026-02-24T07:36:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:38 trial022 ceph-mon[39108]: osdmap e726: 4 total, 4 up, 4 in 2026-02-24T07:36:39.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:38 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2669909411' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"} : dispatch 2026-02-24T07:36:39.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.497+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 <== mon.0 v2:10.20.193.22:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v728) ==== 221+0+0 (crc 0 0 0) 0x7f9d30015e40 con 0x7f9d4010fdd0 2026-02-24T07:36:39.499 INFO:tasks.workunit.client.0.trial022.stderr:set-quota max_objects = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 2026-02-24T07:36:39.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.497+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 <== mon.0 v2:10.20.193.22:3300/0 10 ==== osd_map(728..728 src has 1..728) ==== 631+0+0 (crc 0 0 0) 0x7f9d30014df0 con 0x7f9d4010fdd0 2026-02-24T07:36:39.499 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.497+0000 7f9d35ffb640 1 -- 10.20.193.22:0/2669909411 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=729}) -- 0x7f9d1c065500 con 0x7f9d4010fdd0 2026-02-24T07:36:39.501 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.499+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f9d1c03fa60 msgr2=0x7f9d1c05ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:39.501 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.499+0000 7f9d4721a640 1 --2- 10.20.193.22:0/2669909411 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f9d1c03fa60 0x7f9d1c05ff70 crc :-1 s=READY pgs=2630 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:39.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.499+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9d4010fdd0 msgr2=0x7f9d400f0af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:39.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.499+0000 7f9d4721a640 1 --2- 10.20.193.22:0/2669909411 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9d4010fdd0 0x7f9d400f0af0 crc :-1 s=READY pgs=8990 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:39.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.499+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 shutdown_connections 2026-02-24T07:36:39.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.499+0000 7f9d4721a640 1 --2- 10.20.193.22:0/2669909411 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f9d1c03fa60 0x7f9d1c05ff70 unknown :-1 s=CLOSED pgs=2630 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:39.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.499+0000 7f9d4721a640 1 --2- 10.20.193.22:0/2669909411 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f9d4010fdd0 0x7f9d400f0af0 unknown :-1 s=CLOSED pgs=8990 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:39.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.499+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 >> 10.20.193.22:0/2669909411 conn(0x7f9d400ed6f0 msgr2=0x7f9d4013dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:39.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.499+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 shutdown_connections 2026-02-24T07:36:39.502 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.499+0000 7f9d4721a640 1 -- 10.20.193.22:0/2669909411 wait complete. 2026-02-24T07:36:39.510 INFO:tasks.workunit.client.0.trial022.stderr:+ wait 145465 2026-02-24T07:36:39.510 INFO:tasks.workunit.client.0.trial022.stderr:+ '[' 0 -ne 0 ']' 2026-02-24T07:36:39.510 INFO:tasks.workunit.client.0.trial022.stderr:+ true 2026-02-24T07:36:39.510 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put three /etc/passwd 2026-02-24T07:36:39.540 INFO:tasks.workunit.client.0.trial022.stderr:++ uuidgen 2026-02-24T07:36:39.541 INFO:tasks.workunit.client.0.trial022.stderr:+ pp=b566b70a-bbb5-475c-aa6d-9bb7619ca3eb 2026-02-24T07:36:39.541 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool create b566b70a-bbb5-475c-aa6d-9bb7619ca3eb 12 2026-02-24T07:36:39.599 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.595+0000 7fb55a046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:39.600 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.595+0000 7fb55a046640 1 -- 10.20.193.22:0/4073515677 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb55410dbc0 msgr2=0x7fb55410dfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:39.600 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.595+0000 7fb55a046640 1 --2- 10.20.193.22:0/4073515677 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb55410dbc0 0x7fb55410dfd0 crc :-1 s=READY pgs=8994 gs=1 cs=0 l=1 c_cookie=14750975917112361928 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:39.600 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb55a046640 1 -- 10.20.193.22:0/4073515677 shutdown_connections 2026-02-24T07:36:39.600 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb55a046640 1 --2- 10.20.193.22:0/4073515677 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb55410dbc0 0x7fb55410dfd0 unknown :-1 s=CLOSED pgs=8994 gs=1 cs=0 l=1 c_cookie=14750975917112361928 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:39.600 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb55a046640 1 -- 10.20.193.22:0/4073515677 >> 10.20.193.22:0/4073515677 conn(0x7fb5540eb400 msgr2=0x7fb55410b850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:39.600 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb55a046640 1 -- 10.20.193.22:0/4073515677 shutdown_connections 2026-02-24T07:36:39.600 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb55a046640 1 -- 10.20.193.22:0/4073515677 wait complete. 2026-02-24T07:36:39.600 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb55a046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:39.600 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb55a046640 1 Processor -- start 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb55a046640 1 -- start start 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb55a046640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb55410dbc0 0x7fb5540eeb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb55a046640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5540ef040 con 0x7fb55410dbc0 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb5537fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb55410dbc0 0x7fb5540eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb5537fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb55410dbc0 0x7fb5540eeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46234/0 (socket says 10.20.193.22:46234) 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb5537fe640 1 -- 10.20.193.22:0/2260166358 learned_addr learned my addr 10.20.193.22:0/2260166358 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb5537fe640 1 -- 10.20.193.22:0/2260166358 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5540ef180 con 0x7fb55410dbc0 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.596+0000 7fb5537fe640 1 --2- 10.20.193.22:0/2260166358 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb55410dbc0 0x7fb5540eeb00 crc :-1 s=READY pgs=8995 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.597+0000 7fb550ff9640 1 -- 10.20.193.22:0/2260166358 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fb54000d690 con 0x7fb55410dbc0 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.597+0000 7fb550ff9640 1 -- 10.20.193.22:0/2260166358 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7fb54000d7f0 con 0x7fb55410dbc0 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.597+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5540ef3d0 con 0x7fb55410dbc0 2026-02-24T07:36:39.601 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.597+0000 7fb550ff9640 1 -- 10.20.193.22:0/2260166358 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7fb54000fd70 con 0x7fb55410dbc0 2026-02-24T07:36:39.602 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.597+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5540ef720 con 0x7fb55410dbc0 2026-02-24T07:36:39.602 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.597+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb55410ee70 con 0x7fb55410dbc0 2026-02-24T07:36:39.602 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.597+0000 7fb550ff9640 1 -- 10.20.193.22:0/2260166358 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7fb5400026a0 con 0x7fb55410dbc0 2026-02-24T07:36:39.602 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.598+0000 7fb550ff9640 1 --2- 10.20.193.22:0/2260166358 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fb52803fa60 0x7fb52805ff70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:39.602 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.598+0000 7fb550ff9640 1 -- 10.20.193.22:0/2260166358 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(728..728 src has 1..728) ==== 4870+0+0 (crc 0 0 0) 0x7fb540052cb0 con 0x7fb55410dbc0 2026-02-24T07:36:39.602 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.598+0000 7fb552ffd640 1 --2- 10.20.193.22:0/2260166358 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fb52803fa60 0x7fb52805ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:39.602 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.598+0000 7fb552ffd640 1 --2- 10.20.193.22:0/2260166358 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fb52803fa60 0x7fb52805ff70 crc :-1 s=READY pgs=2632 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:39.603 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.600+0000 7fb550ff9640 1 -- 10.20.193.22:0/2260166358 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7fb540007a50 con 0x7fb55410dbc0 2026-02-24T07:36:39.706 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:39.704+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pg_num": 12} v 0) -- 0x7fb5541358b0 con 0x7fb55410dbc0 2026-02-24T07:36:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:39 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2669909411' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"}]': finished 2026-02-24T07:36:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:39 trial022 ceph-mon[39108]: osdmap e727: 4 total, 4 up, 4 in 2026-02-24T07:36:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:39 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2669909411' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"} : dispatch 2026-02-24T07:36:40.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:39 trial022 ceph-mon[39108]: pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' no longer out of quota; removing NO_QUOTA flag 2026-02-24T07:36:40.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:39 trial022 ceph-mon[39108]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2026-02-24T07:36:40.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:39 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2669909411' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"}]': finished 2026-02-24T07:36:40.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:39 trial022 ceph-mon[39108]: osdmap e728: 4 total, 4 up, 4 in 2026-02-24T07:36:40.492 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:39 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2260166358' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pg_num": 12} : dispatch 2026-02-24T07:36:40.500 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.498+0000 7fb550ff9640 1 -- 10.20.193.22:0/2260166358 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pg_num": 12}]=0 pool 'b566b70a-bbb5-475c-aa6d-9bb7619ca3eb' created v729) ==== 176+0+0 (crc 0 0 0) 0x7fb540007a50 con 0x7fb55410dbc0 2026-02-24T07:36:40.560 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.558+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pg_num": 12} v 0) -- 0x7fb554063c10 con 0x7fb55410dbc0 2026-02-24T07:36:40.560 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.558+0000 7fb550ff9640 1 -- 10.20.193.22:0/2260166358 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pg_num": 12}]=0 pool 'b566b70a-bbb5-475c-aa6d-9bb7619ca3eb' already exists v729) ==== 183+0+0 (crc 0 0 0) 0x7fb5400140c0 con 0x7fb55410dbc0 2026-02-24T07:36:40.560 INFO:tasks.workunit.client.0.trial022.stderr:pool 'b566b70a-bbb5-475c-aa6d-9bb7619ca3eb' already exists 2026-02-24T07:36:40.562 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.560+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fb52803fa60 msgr2=0x7fb52805ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:40.562 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.560+0000 7fb55a046640 1 --2- 10.20.193.22:0/2260166358 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fb52803fa60 0x7fb52805ff70 crc :-1 s=READY pgs=2632 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:40.562 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.560+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb55410dbc0 msgr2=0x7fb5540eeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:40.562 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.560+0000 7fb55a046640 1 --2- 10.20.193.22:0/2260166358 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb55410dbc0 0x7fb5540eeb00 crc :-1 s=READY pgs=8995 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:40.562 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.560+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 shutdown_connections 2026-02-24T07:36:40.562 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.560+0000 7fb55a046640 1 --2- 10.20.193.22:0/2260166358 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7fb52803fa60 0x7fb52805ff70 unknown :-1 s=CLOSED pgs=2632 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:40.562 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.560+0000 7fb55a046640 1 --2- 10.20.193.22:0/2260166358 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7fb55410dbc0 0x7fb5540eeb00 unknown :-1 s=CLOSED pgs=8995 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:40.563 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.560+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 >> 10.20.193.22:0/2260166358 conn(0x7fb5540eb400 msgr2=0x7fb554110430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:40.563 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.560+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 shutdown_connections 2026-02-24T07:36:40.563 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.560+0000 7fb55a046640 1 -- 10.20.193.22:0/2260166358 wait complete. 2026-02-24T07:36:40.568 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool application enable b566b70a-bbb5-475c-aa6d-9bb7619ca3eb rados 2026-02-24T07:36:40.625 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.621+0000 7f83a250b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:40.625 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.621+0000 7f83a250b640 1 -- 10.20.193.22:0/133057191 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f839c10fe40 msgr2=0x7f839c110250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:40.625 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.621+0000 7f83a250b640 1 --2- 10.20.193.22:0/133057191 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f839c10fe40 0x7f839c110250 crc :-1 s=READY pgs=8996 gs=1 cs=0 l=1 c_cookie=17741772327362835746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:40.626 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.621+0000 7f83a250b640 1 -- 10.20.193.22:0/133057191 shutdown_connections 2026-02-24T07:36:40.626 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.621+0000 7f83a250b640 1 --2- 10.20.193.22:0/133057191 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f839c10fe40 0x7f839c110250 unknown :-1 s=CLOSED pgs=8996 gs=1 cs=0 l=1 c_cookie=17741772327362835746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:40.626 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.621+0000 7f83a250b640 1 -- 10.20.193.22:0/133057191 >> 10.20.193.22:0/133057191 conn(0x7f839c0ed620 msgr2=0x7f839c10da70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:40.626 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.621+0000 7f83a250b640 1 -- 10.20.193.22:0/133057191 shutdown_connections 2026-02-24T07:36:40.626 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.621+0000 7f83a250b640 1 -- 10.20.193.22:0/133057191 wait complete. 2026-02-24T07:36:40.626 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.621+0000 7f83a250b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:40.626 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f83a250b640 1 Processor -- start 2026-02-24T07:36:40.626 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f83a250b640 1 -- start start 2026-02-24T07:36:40.626 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f83a250b640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f839c10fe40 0x7f839c0f0d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:40.626 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f83a250b640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0f1270 con 0x7f839c10fe40 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f839bfff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f839c10fe40 0x7f839c0f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f839bfff640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f839c10fe40 0x7f839c0f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:46256/0 (socket says 10.20.193.22:46256) 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f839bfff640 1 -- 10.20.193.22:0/1147027096 learned_addr learned my addr 10.20.193.22:0/1147027096 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f839bfff640 1 -- 10.20.193.22:0/1147027096 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c0f13b0 con 0x7f839c10fe40 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f839bfff640 1 --2- 10.20.193.22:0/1147027096 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f839c10fe40 0x7f839c0f0d30 crc :-1 s=READY pgs=8997 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f83997fa640 1 -- 10.20.193.22:0/1147027096 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f838800d690 con 0x7f839c10fe40 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c0f1600 con 0x7f839c10fe40 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f83997fa640 1 -- 10.20.193.22:0/1147027096 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f838800d7f0 con 0x7f839c10fe40 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f83997fa640 1 -- 10.20.193.22:0/1147027096 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f838800fd70 con 0x7f839c10fe40 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.622+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c0f1950 con 0x7f839c10fe40 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.623+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c1110f0 con 0x7f839c10fe40 2026-02-24T07:36:40.627 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.623+0000 7f83997fa640 1 -- 10.20.193.22:0/1147027096 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7f838800e5c0 con 0x7f839c10fe40 2026-02-24T07:36:40.628 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.623+0000 7f83997fa640 1 --2- 10.20.193.22:0/1147027096 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f837003fa10 0x7f837005ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:40.628 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.623+0000 7f83997fa640 1 -- 10.20.193.22:0/1147027096 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(729..729 src has 1..729) ==== 5248+0+0 (crc 0 0 0) 0x7f8388052ed0 con 0x7f839c10fe40 2026-02-24T07:36:40.628 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.623+0000 7f839b7fe640 1 --2- 10.20.193.22:0/1147027096 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f837003fa10 0x7f837005ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:40.628 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.624+0000 7f839b7fe640 1 --2- 10.20.193.22:0/1147027096 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f837003fa10 0x7f837005ff20 crc :-1 s=READY pgs=2633 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:40.628 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.626+0000 7f83997fa640 1 -- 10.20.193.22:0/1147027096 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f8388015e40 con 0x7f839c10fe40 2026-02-24T07:36:40.736 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:40.734+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "app": "rados"} v 0) -- 0x7f839c137b30 con 0x7f839c10fe40 2026-02-24T07:36:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:40 trial022 ceph-mon[39108]: pgmap v1166: 45 pgs: 45 active+clean; 755 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:40 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2260166358' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pg_num": 12}]': finished 2026-02-24T07:36:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:40 trial022 ceph-mon[39108]: osdmap e729: 4 total, 4 up, 4 in 2026-02-24T07:36:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:40 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2260166358' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pg_num": 12} : dispatch 2026-02-24T07:36:41.242 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:40 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1147027096' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "app": "rados"} : dispatch 2026-02-24T07:36:41.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:36:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:36:40] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:36:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:36:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:36:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:36:41.500 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:41.499+0000 7f83997fa640 1 -- 10.20.193.22:0/1147027096 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "app": "rados"}]=0 enabled application 'rados' on pool 'b566b70a-bbb5-475c-aa6d-9bb7619ca3eb' v730) ==== 213+0+0 (crc 0 0 0) 0x7f8388015640 con 0x7f839c10fe40 2026-02-24T07:36:41.562 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:41.561+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "app": "rados"} v 0) -- 0x7f839c1382d0 con 0x7f839c10fe40 2026-02-24T07:36:42.503 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.501+0000 7f83997fa640 1 -- 10.20.193.22:0/1147027096 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "app": "rados"}]=0 enabled application 'rados' on pool 'b566b70a-bbb5-475c-aa6d-9bb7619ca3eb' v731) ==== 213+0+0 (crc 0 0 0) 0x7f8388015e40 con 0x7f839c10fe40 2026-02-24T07:36:42.503 INFO:tasks.workunit.client.0.trial022.stderr:enabled application 'rados' on pool 'b566b70a-bbb5-475c-aa6d-9bb7619ca3eb' 2026-02-24T07:36:42.507 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.505+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f837003fa10 msgr2=0x7f837005ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:42.507 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.505+0000 7f83a250b640 1 --2- 10.20.193.22:0/1147027096 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f837003fa10 0x7f837005ff20 crc :-1 s=READY pgs=2633 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:42.507 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.505+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f839c10fe40 msgr2=0x7f839c0f0d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:42.508 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.505+0000 7f83a250b640 1 --2- 10.20.193.22:0/1147027096 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f839c10fe40 0x7f839c0f0d30 crc :-1 s=READY pgs=8997 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:42.508 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.505+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 shutdown_connections 2026-02-24T07:36:42.508 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.505+0000 7f83a250b640 1 --2- 10.20.193.22:0/1147027096 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f837003fa10 0x7f837005ff20 unknown :-1 s=CLOSED pgs=2633 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:42.508 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.505+0000 7f83a250b640 1 --2- 10.20.193.22:0/1147027096 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f839c10fe40 0x7f839c0f0d30 unknown :-1 s=CLOSED pgs=8997 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:42.508 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.505+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 >> 10.20.193.22:0/1147027096 conn(0x7f839c0ed620 msgr2=0x7f839c13dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:42.508 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.505+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 shutdown_connections 2026-02-24T07:36:42.508 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.505+0000 7f83a250b640 1 -- 10.20.193.22:0/1147027096 wait complete. 2026-02-24T07:36:42.514 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool set-quota b566b70a-bbb5-475c-aa6d-9bb7619ca3eb max_objects 10 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.567+0000 7f2de2e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.567+0000 7f2de2e5a640 1 -- 10.20.193.22:0/1530935585 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2ddc10c5a0 msgr2=0x7f2ddc10c9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.567+0000 7f2de2e5a640 1 --2- 10.20.193.22:0/1530935585 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2ddc10c5a0 0x7f2ddc10c9b0 crc :-1 s=READY pgs=8998 gs=1 cs=0 l=1 c_cookie=11596609590002923475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.567+0000 7f2de2e5a640 1 -- 10.20.193.22:0/1530935585 shutdown_connections 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.567+0000 7f2de2e5a640 1 --2- 10.20.193.22:0/1530935585 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2ddc10c5a0 0x7f2ddc10c9b0 unknown :-1 s=CLOSED pgs=8998 gs=1 cs=0 l=1 c_cookie=11596609590002923475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.567+0000 7f2de2e5a640 1 -- 10.20.193.22:0/1530935585 >> 10.20.193.22:0/1530935585 conn(0x7f2ddc0ea180 msgr2=0x7f2ddc10a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.567+0000 7f2de2e5a640 1 -- 10.20.193.22:0/1530935585 shutdown_connections 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.567+0000 7f2de2e5a640 1 -- 10.20.193.22:0/1530935585 wait complete. 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.567+0000 7f2de2e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de2e5a640 1 Processor -- start 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de2e5a640 1 -- start start 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de2e5a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2ddc10c5a0 0x7f2ddc1188e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de2e5a640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc118e20 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.569 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de0bcf640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2ddc10c5a0 0x7f2ddc1188e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de0bcf640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2ddc10c5a0 0x7f2ddc1188e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:38638/0 (socket says 10.20.193.22:38638) 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de0bcf640 1 -- 10.20.193.22:0/3071190984 learned_addr learned my addr 10.20.193.22:0/3071190984 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de0bcf640 1 -- 10.20.193.22:0/3071190984 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc118f60 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de0bcf640 1 --2- 10.20.193.22:0/3071190984 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2ddc10c5a0 0x7f2ddc1188e0 crc :-1 s=READY pgs=8999 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2dd1ffb640 1 -- 10.20.193.22:0/3071190984 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f2dcc00d690 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ddc1191b0 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2dd1ffb640 1 -- 10.20.193.22:0/3071190984 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f2dcc00d7f0 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2dd1ffb640 1 -- 10.20.193.22:0/3071190984 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f2dcc00fd70 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.568+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ddc119500 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.569+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ddc13a5d0 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.569+0000 7f2dd1ffb640 1 -- 10.20.193.22:0/3071190984 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7f2dcc00e5c0 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.569+0000 7f2dd1ffb640 1 --2- 10.20.193.22:0/3071190984 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2db803fa10 0x7f2db805ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.569+0000 7f2dd1ffb640 1 -- 10.20.193.22:0/3071190984 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(731..731 src has 1..731) ==== 5261+0+0 (crc 0 0 0) 0x7f2dcc053030 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.570 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.569+0000 7f2dd3fff640 1 --2- 10.20.193.22:0/3071190984 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2db803fa10 0x7f2db805ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:36:42.571 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.570+0000 7f2dd3fff640 1 --2- 10.20.193.22:0/3071190984 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2db803fa10 0x7f2db805ff20 crc :-1 s=READY pgs=2634 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:36:42.572 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.571+0000 7f2dd1ffb640 1 -- 10.20.193.22:0/3071190984 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f2dcc015e40 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.680 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:42.679+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "field": "max_objects", "val": "10"} v 0) -- 0x7f2ddc05fe40 con 0x7f2ddc10c5a0 2026-02-24T07:36:42.990 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1147027096' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "app": "rados"}]': finished 2026-02-24T07:36:42.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:42 trial022 ceph-mon[39108]: osdmap e730: 4 total, 4 up, 4 in 2026-02-24T07:36:42.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:42 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1147027096' entity='client.admin' cmd={"prefix": "osd pool application enable", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "app": "rados"} : dispatch 2026-02-24T07:36:42.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:42 trial022 ceph-mon[39108]: pgmap v1169: 57 pgs: 57 active+clean; 784 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 7.6 KiB/s wr, 0 op/s 2026-02-24T07:36:43.506 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:43.505+0000 7f2dd1ffb640 1 -- 10.20.193.22:0/3071190984 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool b566b70a-bbb5-475c-aa6d-9bb7619ca3eb v732) ==== 223+0+0 (crc 0 0 0) 0x7f2dcc015640 con 0x7f2ddc10c5a0 2026-02-24T07:36:43.566 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:43.565+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "field": "max_objects", "val": "10"} v 0) -- 0x7f2ddc060cb0 con 0x7f2ddc10c5a0 2026-02-24T07:36:43.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:43 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1147027096' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "app": "rados"}]': finished 2026-02-24T07:36:43.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:43 trial022 ceph-mon[39108]: osdmap e731: 4 total, 4 up, 4 in 2026-02-24T07:36:43.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:43 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3071190984' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "field": "max_objects", "val": "10"} : dispatch 2026-02-24T07:36:44.507 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.505+0000 7f2dd1ffb640 1 -- 10.20.193.22:0/3071190984 <== mon.0 v2:10.20.193.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool b566b70a-bbb5-475c-aa6d-9bb7619ca3eb v733) ==== 223+0+0 (crc 0 0 0) 0x7f2dcc015e40 con 0x7f2ddc10c5a0 2026-02-24T07:36:44.507 INFO:tasks.workunit.client.0.trial022.stderr:set-quota max_objects = 10 for pool b566b70a-bbb5-475c-aa6d-9bb7619ca3eb 2026-02-24T07:36:44.511 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.509+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2db803fa10 msgr2=0x7f2db805ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:44.511 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.509+0000 7f2de2e5a640 1 --2- 10.20.193.22:0/3071190984 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2db803fa10 0x7f2db805ff20 crc :-1 s=READY pgs=2634 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:44.512 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.509+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2ddc10c5a0 msgr2=0x7f2ddc1188e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:36:44.512 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.509+0000 7f2de2e5a640 1 --2- 10.20.193.22:0/3071190984 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2ddc10c5a0 0x7f2ddc1188e0 crc :-1 s=READY pgs=8999 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:44.512 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.509+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 shutdown_connections 2026-02-24T07:36:44.512 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.509+0000 7f2de2e5a640 1 --2- 10.20.193.22:0/3071190984 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f2db803fa10 0x7f2db805ff20 unknown :-1 s=CLOSED pgs=2634 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:44.512 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.509+0000 7f2de2e5a640 1 --2- 10.20.193.22:0/3071190984 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f2ddc10c5a0 0x7f2ddc1188e0 unknown :-1 s=CLOSED pgs=8999 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:36:44.512 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.509+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 >> 10.20.193.22:0/3071190984 conn(0x7f2ddc0ea180 msgr2=0x7f2ddc10a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:36:44.513 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.509+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 shutdown_connections 2026-02-24T07:36:44.513 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:36:44.509+0000 7f2de2e5a640 1 -- 10.20.193.22:0/3071190984 wait complete. 2026-02-24T07:36:44.519 INFO:tasks.workunit.client.0.trial022.stderr:+ sleep 30 2026-02-24T07:36:44.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:44 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3071190984' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "field": "max_objects", "val": "10"}]': finished 2026-02-24T07:36:44.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:44 trial022 ceph-mon[39108]: osdmap e732: 4 total, 4 up, 4 in 2026-02-24T07:36:44.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:44 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3071190984' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "field": "max_objects", "val": "10"} : dispatch 2026-02-24T07:36:44.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:44 trial022 ceph-mon[39108]: pgmap v1172: 57 pgs: 57 active+clean; 784 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 7.5 KiB/s wr, 0 op/s 2026-02-24T07:36:45.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:45 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/3071190984' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "field": "max_objects", "val": "10"}]': finished 2026-02-24T07:36:45.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:45 trial022 ceph-mon[39108]: osdmap e733: 4 total, 4 up, 4 in 2026-02-24T07:36:46.991 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:46 trial022 ceph-mon[39108]: pgmap v1174: 57 pgs: 57 active+clean; 784 KiB data, 390 MiB used, 2.7 TiB / 2.7 TiB avail; 6.8 KiB/s wr, 0 op/s 2026-02-24T07:36:49.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:48 trial022 ceph-mon[39108]: pgmap v1175: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:50 trial022 ceph-mon[39108]: pgmap v1176: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:51.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:36:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:36:50] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:36:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:36:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:36:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:36:53.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:52 trial022 ceph-mon[39108]: pgmap v1177: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:55.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:54 trial022 ceph-mon[39108]: pgmap v1178: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:57.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:56 trial022 ceph-mon[39108]: pgmap v1179: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:36:59.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:36:58 trial022 ceph-mon[39108]: pgmap v1180: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:01.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:00 trial022 ceph-mon[39108]: pgmap v1181: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:37:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:37:00] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:37:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:37:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:37:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:37:03.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:02 trial022 ceph-mon[39108]: pgmap v1182: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:05.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:04 trial022 ceph-mon[39108]: pgmap v1183: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:07.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:06 trial022 ceph-mon[39108]: pgmap v1184: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:09.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:08 trial022 ceph-mon[39108]: pgmap v1185: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:10 trial022 ceph-mon[39108]: pgmap v1186: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:11.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:37:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:37:10] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:37:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:37:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:37:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:37:13.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:12 trial022 ceph-mon[39108]: pgmap v1187: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:14.521 INFO:tasks.workunit.client.0.trial022.stderr:++ seq 1 10 2026-02-24T07:37:14.521 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:37:14.521 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p b566b70a-bbb5-475c-aa6d-9bb7619ca3eb put obj1 /etc/passwd 2026-02-24T07:37:14.553 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:37:14.553 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p b566b70a-bbb5-475c-aa6d-9bb7619ca3eb put obj2 /etc/passwd 2026-02-24T07:37:14.583 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:37:14.583 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p b566b70a-bbb5-475c-aa6d-9bb7619ca3eb put obj3 /etc/passwd 2026-02-24T07:37:14.612 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:37:14.612 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p b566b70a-bbb5-475c-aa6d-9bb7619ca3eb put obj4 /etc/passwd 2026-02-24T07:37:14.642 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:37:14.642 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p b566b70a-bbb5-475c-aa6d-9bb7619ca3eb put obj5 /etc/passwd 2026-02-24T07:37:14.673 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:37:14.673 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p b566b70a-bbb5-475c-aa6d-9bb7619ca3eb put obj6 /etc/passwd 2026-02-24T07:37:14.700 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:37:14.700 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p b566b70a-bbb5-475c-aa6d-9bb7619ca3eb put obj7 /etc/passwd 2026-02-24T07:37:14.730 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:37:14.731 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p b566b70a-bbb5-475c-aa6d-9bb7619ca3eb put obj8 /etc/passwd 2026-02-24T07:37:14.759 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:37:14.760 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p b566b70a-bbb5-475c-aa6d-9bb7619ca3eb put obj9 /etc/passwd 2026-02-24T07:37:14.791 INFO:tasks.workunit.client.0.trial022.stderr:+ for f in `seq 1 10` 2026-02-24T07:37:14.791 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p b566b70a-bbb5-475c-aa6d-9bb7619ca3eb put obj10 /etc/passwd 2026-02-24T07:37:14.819 INFO:tasks.workunit.client.0.trial022.stderr:+ sleep 30 2026-02-24T07:37:15.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:14 trial022 ceph-mon[39108]: pgmap v1188: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:17.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:16 trial022 ceph-mon[39108]: pgmap v1189: 57 pgs: 57 active+clean; 784 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:19.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:18 trial022 ceph-mon[39108]: pgmap v1190: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail; 12 KiB/s wr, 0 op/s 2026-02-24T07:37:20.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:19 trial022 ceph-mon[39108]: pool 'b566b70a-bbb5-475c-aa6d-9bb7619ca3eb' is full (reached quota's max_objects: 10) 2026-02-24T07:37:20.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:19 trial022 ceph-mon[39108]: Health check failed: 1 pool(s) full (POOL_FULL) 2026-02-24T07:37:20.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:19 trial022 ceph-mon[39108]: osdmap e734: 4 total, 4 up, 4 in 2026-02-24T07:37:21.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:20 trial022 ceph-mon[39108]: pgmap v1192: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s wr, 0 op/s 2026-02-24T07:37:21.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:37:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:37:20] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:37:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:37:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:37:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:37:23.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:22 trial022 ceph-mon[39108]: pgmap v1193: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s wr, 0 op/s 2026-02-24T07:37:25.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:24 trial022 ceph-mon[39108]: pgmap v1194: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s wr, 0 op/s 2026-02-24T07:37:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:26 trial022 ceph-mon[39108]: pgmap v1195: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail; 15 KiB/s wr, 0 op/s 2026-02-24T07:37:27.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:26 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-24T07:37:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:27 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-24T07:37:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:27 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-24T07:37:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:27 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' 2026-02-24T07:37:28.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:27 trial022 ceph-mon[39108]: from='mgr.14284 10.20.193.22:0/2444275819' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-24T07:37:29.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:29 trial022 ceph-mon[39108]: pgmap v1196: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:30.950 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:30 trial022 ceph-mon[39108]: pgmap v1197: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:31.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:37:30 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:37:30] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:37:31.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:37:30 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:37:30.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:37:33.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:32 trial022 ceph-mon[39108]: pgmap v1198: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:35.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:34 trial022 ceph-mon[39108]: pgmap v1199: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:37.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:36 trial022 ceph-mon[39108]: pgmap v1200: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:39.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:38 trial022 ceph-mon[39108]: pgmap v1201: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:41.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:40 trial022 ceph-mon[39108]: pgmap v1202: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:41.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:37:40 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:37:40] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:37:41.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:37:40 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:37:40.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:37:43.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:42 trial022 ceph-mon[39108]: pgmap v1203: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:44.820 INFO:tasks.workunit.client.0.trial022.stderr:+ rados -p a2c74e2a-745f-46c9-86bd-7822655f6745 put threemore /etc/passwd 2026-02-24T07:37:44.852 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool set-quota a2c74e2a-745f-46c9-86bd-7822655f6745 max_bytes 0 2026-02-24T07:37:44.910 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:37:44.910 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 1 -- 10.20.193.22:0/3446133491 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f691010fe40 msgr2=0x7f6910110250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:37:44.910 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 1 --2- 10.20.193.22:0/3446133491 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f691010fe40 0x7f6910110250 crc :-1 s=READY pgs=9033 gs=1 cs=0 l=1 c_cookie=2000079694582651582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:44.911 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 1 -- 10.20.193.22:0/3446133491 shutdown_connections 2026-02-24T07:37:44.911 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 1 --2- 10.20.193.22:0/3446133491 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f691010fe40 0x7f6910110250 unknown :-1 s=CLOSED pgs=9033 gs=1 cs=0 l=1 c_cookie=2000079694582651582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:44.911 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 1 -- 10.20.193.22:0/3446133491 >> 10.20.193.22:0/3446133491 conn(0x7f69100ed620 msgr2=0x7f691010da70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:37:44.911 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 1 -- 10.20.193.22:0/3446133491 shutdown_connections 2026-02-24T07:37:44.911 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 1 -- 10.20.193.22:0/3446133491 wait complete. 2026-02-24T07:37:44.911 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:37:44.911 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 1 Processor -- start 2026-02-24T07:37:44.911 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.906+0000 7f691819c640 1 -- start start 2026-02-24T07:37:44.911 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f691819c640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f691010fe40 0x7f69100f0d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:37:44.911 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f691819c640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f69100f1270 con 0x7f691010fe40 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f6915f11640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f691010fe40 0x7f69100f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f6915f11640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f691010fe40 0x7f69100f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:49266/0 (socket says 10.20.193.22:49266) 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f6915f11640 1 -- 10.20.193.22:0/559457525 learned_addr learned my addr 10.20.193.22:0/559457525 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f6915f11640 1 -- 10.20.193.22:0/559457525 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69100f13b0 con 0x7f691010fe40 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f6915f11640 1 --2- 10.20.193.22:0/559457525 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f691010fe40 0x7f69100f0d30 crc :-1 s=READY pgs=9034 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f690000d690 con 0x7f691010fe40 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f690000d7f0 con 0x7f691010fe40 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69100f1600 con 0x7f691010fe40 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f690000fd70 con 0x7f691010fe40 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.907+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69100f1950 con 0x7f691010fe40 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.908+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69101110f0 con 0x7f691010fe40 2026-02-24T07:37:44.912 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.908+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7f690000e5c0 con 0x7f691010fe40 2026-02-24T07:37:44.913 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.908+0000 7f68feffd640 1 --2- 10.20.193.22:0/559457525 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f68ec03fa60 0x7f68ec05ff70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:37:44.913 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.908+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(734..734 src has 1..734) ==== 5261+0+0 (crc 0 0 0) 0x7f6900052dd0 con 0x7f691010fe40 2026-02-24T07:37:44.913 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.908+0000 7f6915710640 1 --2- 10.20.193.22:0/559457525 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f68ec03fa60 0x7f68ec05ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:37:44.913 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.908+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=735}) -- 0x7f68ec064c10 con 0x7f691010fe40 2026-02-24T07:37:44.913 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.908+0000 7f6915710640 1 --2- 10.20.193.22:0/559457525 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f68ec03fa60 0x7f68ec05ff70 crc :-1 s=READY pgs=2646 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:37:44.913 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:44.910+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f690000cc10 con 0x7f691010fe40 2026-02-24T07:37:45.015 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:45.013+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"} v 0) -- 0x7f6910137b30 con 0x7f691010fe40 2026-02-24T07:37:45.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:44 trial022 ceph-mon[39108]: pgmap v1204: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:45.991 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:45.989+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v735) ==== 217+0+0 (crc 0 0 0) 0x7f6900015640 con 0x7f691010fe40 2026-02-24T07:37:45.991 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:45.989+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 <== mon.0 v2:10.20.193.22:3300/0 8 ==== osd_map(735..735 src has 1..735) ==== 631+0+0 (crc 0 0 0) 0x7f6900026100 con 0x7f691010fe40 2026-02-24T07:37:45.991 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:45.989+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=736}) -- 0x7f68ec065bd0 con 0x7f691010fe40 2026-02-24T07:37:46.050 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.048+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"} v 0) -- 0x7f6910060180 con 0x7f691010fe40 2026-02-24T07:37:46.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:45 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559457525' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"} : dispatch 2026-02-24T07:37:46.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.990+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 <== mon.0 v2:10.20.193.22:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v736) ==== 217+0+0 (crc 0 0 0) 0x7f6900015e40 con 0x7f691010fe40 2026-02-24T07:37:46.992 INFO:tasks.workunit.client.0.trial022.stderr:set-quota max_bytes = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 2026-02-24T07:37:46.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.990+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 <== mon.0 v2:10.20.193.22:3300/0 10 ==== osd_map(736..736 src has 1..736) ==== 631+0+0 (crc 0 0 0) 0x7f6900014df0 con 0x7f691010fe40 2026-02-24T07:37:46.992 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.990+0000 7f68feffd640 1 -- 10.20.193.22:0/559457525 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=737}) -- 0x7f68ec065cc0 con 0x7f691010fe40 2026-02-24T07:37:46.995 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.994+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f68ec03fa60 msgr2=0x7f68ec05ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:37:46.995 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.994+0000 7f691819c640 1 --2- 10.20.193.22:0/559457525 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f68ec03fa60 0x7f68ec05ff70 crc :-1 s=READY pgs=2646 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:46.995 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.994+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f691010fe40 msgr2=0x7f69100f0d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:37:46.996 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.994+0000 7f691819c640 1 --2- 10.20.193.22:0/559457525 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f691010fe40 0x7f69100f0d30 crc :-1 s=READY pgs=9034 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:46.996 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.994+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 shutdown_connections 2026-02-24T07:37:46.996 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.994+0000 7f691819c640 1 --2- 10.20.193.22:0/559457525 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f68ec03fa60 0x7f68ec05ff70 unknown :-1 s=CLOSED pgs=2646 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:46.996 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.994+0000 7f691819c640 1 --2- 10.20.193.22:0/559457525 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f691010fe40 0x7f69100f0d30 unknown :-1 s=CLOSED pgs=9034 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:46.996 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.994+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 >> 10.20.193.22:0/559457525 conn(0x7f69100ed620 msgr2=0x7f691013dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:37:46.996 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.994+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 shutdown_connections 2026-02-24T07:37:46.996 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:46.994+0000 7f691819c640 1 -- 10.20.193.22:0/559457525 wait complete. 2026-02-24T07:37:47.004 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool set-quota a2c74e2a-745f-46c9-86bd-7822655f6745 max_objects 0 2026-02-24T07:37:47.060 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.059+0000 7f561d10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:37:47.060 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.059+0000 7f561d10b640 1 -- 10.20.193.22:0/3162255000 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f5618118830 msgr2=0x7f5618118c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.059+0000 7f561d10b640 1 --2- 10.20.193.22:0/3162255000 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f5618118830 0x7f5618118c40 crc :-1 s=READY pgs=9035 gs=1 cs=0 l=1 c_cookie=4688120848848029742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.059+0000 7f561d10b640 1 -- 10.20.193.22:0/3162255000 shutdown_connections 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.059+0000 7f561d10b640 1 --2- 10.20.193.22:0/3162255000 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f5618118830 0x7f5618118c40 unknown :-1 s=CLOSED pgs=9035 gs=1 cs=0 l=1 c_cookie=4688120848848029742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.059+0000 7f561d10b640 1 -- 10.20.193.22:0/3162255000 >> 10.20.193.22:0/3162255000 conn(0x7f56180f6030 msgr2=0x7f5618116480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.059+0000 7f561d10b640 1 -- 10.20.193.22:0/3162255000 shutdown_connections 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.059+0000 7f561d10b640 1 -- 10.20.193.22:0/3162255000 wait complete. 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.059+0000 7f561d10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f561d10b640 1 Processor -- start 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f561d10b640 1 -- start start 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f561d10b640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f5618118830 0x7f56180fc700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f561d10b640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f56180fcc40 con 0x7f5618118830 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f5616d76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f5618118830 0x7f56180fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f5616d76640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f5618118830 0x7f56180fc700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:49278/0 (socket says 10.20.193.22:49278) 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f5616d76640 1 -- 10.20.193.22:0/1726093603 learned_addr learned my addr 10.20.193.22:0/1726093603 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f5616d76640 1 -- 10.20.193.22:0/1726093603 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56180fcd80 con 0x7f5618118830 2026-02-24T07:37:47.061 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f5616d76640 1 --2- 10.20.193.22:0/1726093603 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f5618118830 0x7f56180fc700 crc :-1 s=READY pgs=9036 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f560c00d690 con 0x7f5618118830 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56180fcfd0 con 0x7f5618118830 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f560c00d7f0 con 0x7f5618118830 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f560c00fd70 con 0x7f5618118830 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.060+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56180fd320 con 0x7f5618118830 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.061+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5618119ae0 con 0x7f5618118830 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.061+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7f560c00e5c0 con 0x7f5618118830 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.061+0000 7f55f7fff640 1 --2- 10.20.193.22:0/1726093603 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f55ec03fa10 0x7f55ec05ff20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.061+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(736..736 src has 1..736) ==== 5261+0+0 (crc 0 0 0) 0x7f560c052f00 con 0x7f5618118830 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.061+0000 7f5616575640 1 --2- 10.20.193.22:0/1726093603 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f55ec03fa10 0x7f55ec05ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.061+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=737}) -- 0x7f55ec064bc0 con 0x7f5618118830 2026-02-24T07:37:47.062 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.061+0000 7f5616575640 1 --2- 10.20.193.22:0/1726093603 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f55ec03fa10 0x7f55ec05ff20 crc :-1 s=READY pgs=2647 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:37:47.064 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.063+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f560c00cc10 con 0x7f5618118830 2026-02-24T07:37:47.171 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.170+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"} v 0) -- 0x7f5618056560 con 0x7f5618118830 2026-02-24T07:37:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:46 trial022 ceph-mon[39108]: pgmap v1205: 57 pgs: 57 active+clean; 933 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:46 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559457525' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"}]': finished 2026-02-24T07:37:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:46 trial022 ceph-mon[39108]: osdmap e735: 4 total, 4 up, 4 in 2026-02-24T07:37:47.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:46 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559457525' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"} : dispatch 2026-02-24T07:37:47.999 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.996+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v737) ==== 221+0+0 (crc 0 0 0) 0x7f560c015640 con 0x7f5618118830 2026-02-24T07:37:47.999 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.997+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 <== mon.0 v2:10.20.193.22:3300/0 8 ==== osd_map(737..737 src has 1..737) ==== 631+0+0 (crc 0 0 0) 0x7f560c014e40 con 0x7f5618118830 2026-02-24T07:37:47.999 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:47.997+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=738}) -- 0x7f55ec065b80 con 0x7f5618118830 2026-02-24T07:37:48.056 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:48.055+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"} v 0) -- 0x7f5618140500 con 0x7f5618118830 2026-02-24T07:37:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:47 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/559457525' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_bytes", "val": "0"}]': finished 2026-02-24T07:37:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:47 trial022 ceph-mon[39108]: osdmap e736: 4 total, 4 up, 4 in 2026-02-24T07:37:48.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:47 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1726093603' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"} : dispatch 2026-02-24T07:37:48.999 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:48.997+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 <== mon.0 v2:10.20.193.22:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 v738) ==== 221+0+0 (crc 0 0 0) 0x7f560c015e40 con 0x7f5618118830 2026-02-24T07:37:48.999 INFO:tasks.workunit.client.0.trial022.stderr:set-quota max_objects = 0 for pool a2c74e2a-745f-46c9-86bd-7822655f6745 2026-02-24T07:37:48.999 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:48.997+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 <== mon.0 v2:10.20.193.22:3300/0 10 ==== osd_map(738..738 src has 1..738) ==== 631+0+0 (crc 0 0 0) 0x7f560c026180 con 0x7f5618118830 2026-02-24T07:37:49.000 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:48.997+0000 7f55f7fff640 1 -- 10.20.193.22:0/1726093603 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=739}) -- 0x7f55ec065c70 con 0x7f5618118830 2026-02-24T07:37:49.003 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:49.002+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f55ec03fa10 msgr2=0x7f55ec05ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:37:49.004 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:49.002+0000 7f561d10b640 1 --2- 10.20.193.22:0/1726093603 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f55ec03fa10 0x7f55ec05ff20 crc :-1 s=READY pgs=2647 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:49.004 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:49.002+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f5618118830 msgr2=0x7f56180fc700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:37:49.004 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:49.002+0000 7f561d10b640 1 --2- 10.20.193.22:0/1726093603 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f5618118830 0x7f56180fc700 crc :-1 s=READY pgs=9036 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:49.004 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:49.002+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 shutdown_connections 2026-02-24T07:37:49.004 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:49.002+0000 7f561d10b640 1 --2- 10.20.193.22:0/1726093603 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f55ec03fa10 0x7f55ec05ff20 unknown :-1 s=CLOSED pgs=2647 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:49.004 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:49.002+0000 7f561d10b640 1 --2- 10.20.193.22:0/1726093603 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f5618118830 0x7f56180fc700 unknown :-1 s=CLOSED pgs=9036 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:37:49.004 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:49.002+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 >> 10.20.193.22:0/1726093603 conn(0x7f56180f6030 msgr2=0x7f5618143580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:37:49.008 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:49.002+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 shutdown_connections 2026-02-24T07:37:49.008 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:37:49.002+0000 7f561d10b640 1 -- 10.20.193.22:0/1726093603 wait complete. 2026-02-24T07:37:49.012 INFO:tasks.workunit.client.0.trial022.stderr:+ sleep 30 2026-02-24T07:37:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:49 trial022 ceph-mon[39108]: pgmap v1208: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail; 1.9 KiB/s wr, 0 op/s 2026-02-24T07:37:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:49 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1726093603' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"}]': finished 2026-02-24T07:37:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:49 trial022 ceph-mon[39108]: osdmap e737: 4 total, 4 up, 4 in 2026-02-24T07:37:49.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:49 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1726093603' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"} : dispatch 2026-02-24T07:37:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:50 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/1726093603' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "field": "max_objects", "val": "0"}]': finished 2026-02-24T07:37:50.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:50 trial022 ceph-mon[39108]: osdmap e738: 4 total, 4 up, 4 in 2026-02-24T07:37:51.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:51 trial022 ceph-mon[39108]: pgmap v1211: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail; 3.7 KiB/s wr, 0 op/s 2026-02-24T07:37:51.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:37:50 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:37:50] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:37:51.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:37:50 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:37:50.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:37:53.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:53 trial022 ceph-mon[39108]: pgmap v1212: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail; 2.5 KiB/s wr, 0 op/s 2026-02-24T07:37:55.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:55 trial022 ceph-mon[39108]: pgmap v1213: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:57.292 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:57 trial022 ceph-mon[39108]: pgmap v1214: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:37:59.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:37:59 trial022 ceph-mon[39108]: pgmap v1215: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:01.240 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:01 trial022 ceph-mon[39108]: pgmap v1216: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:01.241 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:38:00 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:38:00] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:38:01.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:00 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:00.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:38:03.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:03 trial022 ceph-mon[39108]: pgmap v1217: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:05.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:05 trial022 ceph-mon[39108]: pgmap v1218: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:07.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:07 trial022 ceph-mon[39108]: pgmap v1219: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:09.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:09 trial022 ceph-mon[39108]: pgmap v1220: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:11.241 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:11 trial022 ceph-mon[39108]: pgmap v1221: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:11.242 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:38:10 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:38:10] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:38:11.376 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:10 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:10.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:38:13.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:13 trial022 ceph-mon[39108]: pgmap v1222: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:15.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:15 trial022 ceph-mon[39108]: pgmap v1223: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:17.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:17 trial022 ceph-mon[39108]: pgmap v1224: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:19.013 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool delete a2c74e2a-745f-46c9-86bd-7822655f6745 a2c74e2a-745f-46c9-86bd-7822655f6745 --yes-i-really-really-mean-it 2026-02-24T07:38:19.069 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:38:19.069 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 -- 10.20.193.22:0/2159602837 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f948c10fd60 msgr2=0x7f948c110170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:38:19.069 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 --2- 10.20.193.22:0/2159602837 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f948c10fd60 0x7f948c110170 crc :-1 s=READY pgs=9037 gs=1 cs=0 l=1 c_cookie=6306454224958107148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:19.069 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 -- 10.20.193.22:0/2159602837 shutdown_connections 2026-02-24T07:38:19.069 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 --2- 10.20.193.22:0/2159602837 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f948c10fd60 0x7f948c110170 unknown :-1 s=CLOSED pgs=9037 gs=1 cs=0 l=1 c_cookie=6306454224958107148 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:19.069 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 -- 10.20.193.22:0/2159602837 >> 10.20.193.22:0/2159602837 conn(0x7f948c0ed5e0 msgr2=0x7f948c10da30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:38:19.069 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 -- 10.20.193.22:0/2159602837 shutdown_connections 2026-02-24T07:38:19.069 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 -- 10.20.193.22:0/2159602837 wait complete. 2026-02-24T07:38:19.069 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 Processor -- start 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 -- start start 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f948c10fd60 0x7f948c0f0970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f949205a640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0f0eb0 con 0x7f948c10fd60 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f948b7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f948c10fd60 0x7f948c0f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f948b7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f948c10fd60 0x7f948c0f0970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:58650/0 (socket says 10.20.193.22:58650) 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.067+0000 7f948b7fe640 1 -- 10.20.193.22:0/424937323 learned_addr learned my addr 10.20.193.22:0/424937323 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.068+0000 7f948b7fe640 1 -- 10.20.193.22:0/424937323 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c0f0ff0 con 0x7f948c10fd60 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.068+0000 7f948b7fe640 1 --2- 10.20.193.22:0/424937323 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f948c10fd60 0x7f948c0f0970 crc :-1 s=READY pgs=9038 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.068+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f947800d690 con 0x7f948c10fd60 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.068+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f947800d7f0 con 0x7f948c10fd60 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.068+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948c0f1240 con 0x7f948c10fd60 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.068+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f947800fe70 con 0x7f948c10fd60 2026-02-24T07:38:19.070 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.068+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948c0f1590 con 0x7f948c10fd60 2026-02-24T07:38:19.071 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.068+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f948c1110d0 con 0x7f948c10fd60 2026-02-24T07:38:19.071 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.069+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7f947800e5c0 con 0x7f948c10fd60 2026-02-24T07:38:19.071 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.069+0000 7f9488ff9640 1 --2- 10.20.193.22:0/424937323 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f946003fa40 0x7f946005ff50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:38:19.071 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.069+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(738..738 src has 1..738) ==== 5261+0+0 (crc 0 0 0) 0x7f9478052e80 con 0x7f948c10fd60 2026-02-24T07:38:19.071 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.069+0000 7f948affd640 1 --2- 10.20.193.22:0/424937323 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f946003fa40 0x7f946005ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:38:19.071 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.069+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=739}) -- 0x7f9460064bf0 con 0x7f948c10fd60 2026-02-24T07:38:19.071 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.069+0000 7f948affd640 1 --2- 10.20.193.22:0/424937323 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f946003fa40 0x7f946005ff50 crc :-1 s=READY pgs=2648 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:38:19.073 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.071+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f947800cc10 con 0x7f948c10fd60 2026-02-24T07:38:19.177 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:19.174+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pool2": "a2c74e2a-745f-46c9-86bd-7822655f6745", "yes_i_really_really_mean_it": true} v 0) -- 0x7f948c137a60 con 0x7f948c10fd60 2026-02-24T07:38:19.490 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:19 trial022 ceph-mon[39108]: pgmap v1225: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:20.017 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.014+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pool2": "a2c74e2a-745f-46c9-86bd-7822655f6745", "yes_i_really_really_mean_it": true}]=0 pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' removed v739) ==== 248+0+0 (crc 0 0 0) 0x7f9478009520 con 0x7f948c10fd60 2026-02-24T07:38:20.017 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.014+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 <== mon.0 v2:10.20.193.22:3300/0 8 ==== osd_map(739..739 src has 1..739) ==== 296+0+0 (crc 0 0 0) 0x7f9478002dc0 con 0x7f948c10fd60 2026-02-24T07:38:20.017 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.014+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=740}) -- 0x7f94600658c0 con 0x7f948c10fd60 2026-02-24T07:38:20.074 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.072+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pool2": "a2c74e2a-745f-46c9-86bd-7822655f6745", "yes_i_really_really_mean_it": true} v 0) -- 0x7f948c1383d0 con 0x7f948c10fd60 2026-02-24T07:38:20.075 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.072+0000 7f9488ff9640 1 -- 10.20.193.22:0/424937323 <== mon.0 v2:10.20.193.22:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pool2": "a2c74e2a-745f-46c9-86bd-7822655f6745", "yes_i_really_really_mean_it": true}]=0 pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' does not exist v739) ==== 255+0+0 (crc 0 0 0) 0x7f9478015640 con 0x7f948c10fd60 2026-02-24T07:38:20.075 INFO:tasks.workunit.client.0.trial022.stderr:pool 'a2c74e2a-745f-46c9-86bd-7822655f6745' does not exist 2026-02-24T07:38:20.076 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.074+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f946003fa40 msgr2=0x7f946005ff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:38:20.076 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.074+0000 7f949205a640 1 --2- 10.20.193.22:0/424937323 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f946003fa40 0x7f946005ff50 crc :-1 s=READY pgs=2648 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:20.076 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.074+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f948c10fd60 msgr2=0x7f948c0f0970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:38:20.076 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.074+0000 7f949205a640 1 --2- 10.20.193.22:0/424937323 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f948c10fd60 0x7f948c0f0970 crc :-1 s=READY pgs=9038 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:20.076 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.074+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 shutdown_connections 2026-02-24T07:38:20.076 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.074+0000 7f949205a640 1 --2- 10.20.193.22:0/424937323 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f946003fa40 0x7f946005ff50 unknown :-1 s=CLOSED pgs=2648 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:20.076 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.074+0000 7f949205a640 1 --2- 10.20.193.22:0/424937323 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f948c10fd60 0x7f948c0f0970 unknown :-1 s=CLOSED pgs=9038 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:20.076 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.074+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 >> 10.20.193.22:0/424937323 conn(0x7f948c0ed5e0 msgr2=0x7f948c112690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:38:20.076 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.074+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 shutdown_connections 2026-02-24T07:38:20.076 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.074+0000 7f949205a640 1 -- 10.20.193.22:0/424937323 wait complete. 2026-02-24T07:38:20.082 INFO:tasks.workunit.client.0.trial022.stderr:+ ceph osd pool delete b566b70a-bbb5-475c-aa6d-9bb7619ca3eb b566b70a-bbb5-475c-aa6d-9bb7619ca3eb --yes-i-really-really-mean-it 2026-02-24T07:38:20.141 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.136+0000 7f76e20cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:38:20.141 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.136+0000 7f76e20cb640 1 -- 10.20.193.22:0/3582101301 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f76dc10fd60 msgr2=0x7f76dc110170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:38:20.142 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.136+0000 7f76e20cb640 1 --2- 10.20.193.22:0/3582101301 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f76dc10fd60 0x7f76dc110170 crc :-1 s=READY pgs=9039 gs=1 cs=0 l=1 c_cookie=1108065385416418983 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:20.142 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.136+0000 7f76e20cb640 1 -- 10.20.193.22:0/3582101301 shutdown_connections 2026-02-24T07:38:20.142 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.136+0000 7f76e20cb640 1 --2- 10.20.193.22:0/3582101301 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f76dc10fd60 0x7f76dc110170 unknown :-1 s=CLOSED pgs=9039 gs=1 cs=0 l=1 c_cookie=1108065385416418983 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:20.142 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.136+0000 7f76e20cb640 1 -- 10.20.193.22:0/3582101301 >> 10.20.193.22:0/3582101301 conn(0x7f76dc0ed5e0 msgr2=0x7f76dc10da30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:38:20.142 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.136+0000 7f76e20cb640 1 -- 10.20.193.22:0/3582101301 shutdown_connections 2026-02-24T07:38:20.142 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.136+0000 7f76e20cb640 1 -- 10.20.193.22:0/3582101301 wait complete. 2026-02-24T07:38:20.142 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.136+0000 7f76e20cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T07:38:20.142 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76e20cb640 1 Processor -- start 2026-02-24T07:38:20.142 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76e20cb640 1 -- start start 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76e20cb640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f76dc10fd60 0x7f76dc0f0970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76e20cb640 1 -- --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc0f0eb0 con 0x7f76dc10fd60 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76db7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f76dc10fd60 0x7f76dc0f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76db7fe640 1 --2- >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f76dc10fd60 0x7f76dc0f0970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.22:3300/0 says I am v2:10.20.193.22:58668/0 (socket says 10.20.193.22:58668) 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76db7fe640 1 -- 10.20.193.22:0/2359822949 learned_addr learned my addr 10.20.193.22:0/2359822949 (peer_addr_for_me v2:10.20.193.22:0/0) 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76db7fe640 1 -- 10.20.193.22:0/2359822949 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc0f0ff0 con 0x7f76dc10fd60 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76db7fe640 1 --2- 10.20.193.22:0/2359822949 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f76dc10fd60 0x7f76dc0f0970 crc :-1 s=READY pgs=9040 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 <== mon.0 v2:10.20.193.22:3300/0 1 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f76c800d690 con 0x7f76dc10fd60 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 <== mon.0 v2:10.20.193.22:3300/0 2 ==== config(29 keys) ==== 1190+0+0 (crc 0 0 0) 0x7f76c800d7f0 con 0x7f76dc10fd60 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76dc0f1240 con 0x7f76dc10fd60 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 <== mon.0 v2:10.20.193.22:3300/0 3 ==== mon_map magic: 0 ==== 213+0+0 (crc 0 0 0) 0x7f76c800fe70 con 0x7f76dc10fd60 2026-02-24T07:38:20.143 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.137+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76dc0f1590 con 0x7f76dc10fd60 2026-02-24T07:38:20.144 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.138+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76dc1110d0 con 0x7f76dc10fd60 2026-02-24T07:38:20.144 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.138+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 <== mon.0 v2:10.20.193.22:3300/0 4 ==== mgrmap(e 19) ==== 52983+0+0 (crc 0 0 0) 0x7f76c800e5c0 con 0x7f76dc10fd60 2026-02-24T07:38:20.144 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.138+0000 7f76d8ff9640 1 --2- 10.20.193.22:0/2359822949 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f76b003fa40 0x7f76b005ff50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-24T07:38:20.144 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.138+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 <== mon.0 v2:10.20.193.22:3300/0 5 ==== osd_map(739..739 src has 1..739) ==== 4870+0+0 (crc 0 0 0) 0x7f76c8052d40 con 0x7f76dc10fd60 2026-02-24T07:38:20.144 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.138+0000 7f76daffd640 1 --2- 10.20.193.22:0/2359822949 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f76b003fa40 0x7f76b005ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-24T07:38:20.144 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.138+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=740}) -- 0x7f76b0064430 con 0x7f76dc10fd60 2026-02-24T07:38:20.144 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.138+0000 7f76daffd640 1 --2- 10.20.193.22:0/2359822949 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f76b003fa40 0x7f76b005ff50 crc :-1 s=READY pgs=2649 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.14284 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-24T07:38:20.145 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.140+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 <== mon.0 v2:10.20.193.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231167 (crc 0 0 0) 0x7f76c800cc10 con 0x7f76dc10fd60 2026-02-24T07:38:20.250 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:20.247+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pool2": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "yes_i_really_really_mean_it": true} v 0) -- 0x7f76dc137a60 con 0x7f76dc10fd60 2026-02-24T07:38:20.491 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:20 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/424937323' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pool2": "a2c74e2a-745f-46c9-86bd-7822655f6745", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T07:38:21.020 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.017+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 <== mon.0 v2:10.20.193.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pool2": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "yes_i_really_really_mean_it": true}]=0 pool 'b566b70a-bbb5-475c-aa6d-9bb7619ca3eb' removed v740) ==== 248+0+0 (crc 0 0 0) 0x7f76c8015640 con 0x7f76dc10fd60 2026-02-24T07:38:21.021 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.018+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 <== mon.0 v2:10.20.193.22:3300/0 8 ==== osd_map(740..740 src has 1..740) ==== 296+0+0 (crc 0 0 0) 0x7f76c8014e40 con 0x7f76dc10fd60 2026-02-24T07:38:21.021 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.018+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_subscribe({osdmap=741}) -- 0x7f76b0064f10 con 0x7f76dc10fd60 2026-02-24T07:38:21.080 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.077+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 --> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pool2": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "yes_i_really_really_mean_it": true} v 0) -- 0x7f76dc1383d0 con 0x7f76dc10fd60 2026-02-24T07:38:21.080 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.077+0000 7f76d8ff9640 1 -- 10.20.193.22:0/2359822949 <== mon.0 v2:10.20.193.22:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pool2": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "yes_i_really_really_mean_it": true}]=0 pool 'b566b70a-bbb5-475c-aa6d-9bb7619ca3eb' does not exist v740) ==== 255+0+0 (crc 0 0 0) 0x7f76c8015e40 con 0x7f76dc10fd60 2026-02-24T07:38:21.080 INFO:tasks.workunit.client.0.trial022.stderr:pool 'b566b70a-bbb5-475c-aa6d-9bb7619ca3eb' does not exist 2026-02-24T07:38:21.082 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.079+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f76b003fa40 msgr2=0x7f76b005ff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:38:21.082 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.079+0000 7f76e20cb640 1 --2- 10.20.193.22:0/2359822949 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f76b003fa40 0x7f76b005ff50 crc :-1 s=READY pgs=2649 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:21.082 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.079+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f76dc10fd60 msgr2=0x7f76dc0f0970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T07:38:21.082 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.079+0000 7f76e20cb640 1 --2- 10.20.193.22:0/2359822949 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f76dc10fd60 0x7f76dc0f0970 crc :-1 s=READY pgs=9040 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:21.082 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.079+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 shutdown_connections 2026-02-24T07:38:21.082 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.079+0000 7f76e20cb640 1 --2- 10.20.193.22:0/2359822949 >> [v2:10.20.193.22:6800/1339855099,v1:10.20.193.22:6801/1339855099] conn(0x7f76b003fa40 0x7f76b005ff50 unknown :-1 s=CLOSED pgs=2649 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:21.082 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.079+0000 7f76e20cb640 1 --2- 10.20.193.22:0/2359822949 >> [v2:10.20.193.22:3300/0,v1:10.20.193.22:6789/0] conn(0x7f76dc10fd60 0x7f76dc0f0970 unknown :-1 s=CLOSED pgs=9040 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-24T07:38:21.082 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.079+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 >> 10.20.193.22:0/2359822949 conn(0x7f76dc0ed5e0 msgr2=0x7f76dc112690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T07:38:21.083 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.079+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 shutdown_connections 2026-02-24T07:38:21.083 INFO:tasks.workunit.client.0.trial022.stderr:2026-02-24T07:38:21.079+0000 7f76e20cb640 1 -- 10.20.193.22:0/2359822949 wait complete. 2026-02-24T07:38:21.088 INFO:tasks.workunit.client.0.trial022.stderr:+ echo OK 2026-02-24T07:38:21.089 INFO:tasks.workunit.client.0.trial022.stdout:OK 2026-02-24T07:38:21.090 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-24T07:38:21.090 DEBUG:teuthology.orchestra.run.trial022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-24T07:38:21.156 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2026-02-24T07:38:21.157 DEBUG:teuthology.orchestra.run.trial022:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-24T07:38:21.217 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:38:20 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-mgr-x[39436]: ::ffff:10.20.193.195 - - [24/Feb/2026:07:38:20] "GET /metrics HTTP/1.1" 200 4215 "" "Prometheus/3.6.0" 2026-02-24T07:38:21.217 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:21 trial022 ceph-mon[39108]: pgmap v1226: 57 pgs: 57 active+clean; 948 KiB data, 391 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-24T07:38:21.218 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:21 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/424937323' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pool2": "a2c74e2a-745f-46c9-86bd-7822655f6745", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T07:38:21.218 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:21 trial022 ceph-mon[39108]: osdmap e739: 4 total, 4 up, 4 in 2026-02-24T07:38:21.218 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:21 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/424937323' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "a2c74e2a-745f-46c9-86bd-7822655f6745", "pool2": "a2c74e2a-745f-46c9-86bd-7822655f6745", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T07:38:21.218 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:21 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2359822949' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pool2": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T07:38:21.286 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:20 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:20.953Z level=ERROR source=scrape.go:1630 msg="Failed to determine correct type of scrape target." component="scrape manager" scrape_pool=ceph target=http://trial022:9283/metrics content_type="text/html;charset=utf-8" fallback_media_type="" err="received unsupported Content-Type \"text/html;charset=utf-8\" and no fallback_scrape_protocol specified for target" 2026-02-24T07:38:21.528 DEBUG:teuthology.parallel:result is None 2026-02-24T07:38:21.529 DEBUG:teuthology.orchestra.run.trial022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T07:38:21.594 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T07:38:21.594 DEBUG:teuthology.orchestra.run.trial022:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-24T07:38:21.651 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T07:38:21.652 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-24T07:38:21.667 INFO:tasks.cephadm:Teardown begin 2026-02-24T07:38:21.668 DEBUG:teuthology.orchestra.run.trial022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T07:38:21.716 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T07:38:21.745 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-24T07:38:21.746 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:ff63f3d997e38f69382fd23ac0206f07f7b05017 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30400272-1151-11f1-be09-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-24T07:38:21.871 INFO:teuthology.orchestra.run.trial022.stderr:Inferring config /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/mon.a/config 2026-02-24T07:38:21.889 INFO:teuthology.orchestra.run.trial022.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-24T07:38:21.905 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-24T07:38:21.906 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-24T07:38:21.906 DEBUG:teuthology.orchestra.run.trial022:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T07:38:21.923 DEBUG:teuthology.orchestra.run.trial195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-24T07:38:21.940 INFO:tasks.cephadm:Stopping all daemons... 2026-02-24T07:38:21.941 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-24T07:38:21.941 DEBUG:teuthology.orchestra.run.trial022:> sudo systemctl stop ceph-30400272-1151-11f1-be09-d404e6e7d460@mon.a 2026-02-24T07:38:22.069 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:22 trial022 systemd[1]: Stopping Ceph mon.a for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:38:22.069 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:22 trial022 ceph-mon[39108]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2026-02-24T07:38:22.069 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:22 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2359822949' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pool2": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "yes_i_really_really_mean_it": true}]': finished 2026-02-24T07:38:22.069 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:22 trial022 ceph-mon[39108]: osdmap e740: 4 total, 4 up, 4 in 2026-02-24T07:38:22.070 INFO:journalctl@ceph.mon.a.trial022.stdout:Feb 24 07:38:22 trial022 ceph-mon[39108]: from='client.? 10.20.193.22:0/2359822949' entity='client.admin' cmd={"prefix": "osd pool delete", "pool": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "pool2": "b566b70a-bbb5-475c-aa6d-9bb7619ca3eb", "yes_i_really_really_mean_it": true} : dispatch 2026-02-24T07:38:22.161 DEBUG:teuthology.orchestra.run.trial022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@mon.a.service' 2026-02-24T07:38:22.196 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T07:38:22.196 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-24T07:38:22.196 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-24T07:38:22.196 DEBUG:teuthology.orchestra.run.trial022:> sudo systemctl stop ceph-30400272-1151-11f1-be09-d404e6e7d460@mgr.x 2026-02-24T07:38:22.328 INFO:journalctl@ceph.mgr.x.trial022.stdout:Feb 24 07:38:22 trial022 systemd[1]: Stopping Ceph mgr.x for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:38:22.479 DEBUG:teuthology.orchestra.run.trial022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@mgr.x.service' 2026-02-24T07:38:22.516 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T07:38:22.516 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-24T07:38:22.516 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-24T07:38:22.517 DEBUG:teuthology.orchestra.run.trial022:> sudo systemctl stop ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.0 2026-02-24T07:38:22.991 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:22 trial022 systemd[1]: Stopping Ceph osd.0 for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:38:22.991 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:22 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0[55291]: 2026-02-24T07:38:22.641+0000 7fa957aa0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T07:38:22.991 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:22 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0[55291]: 2026-02-24T07:38:22.641+0000 7fa957aa0640 -1 osd.0 740 *** Got signal Terminated *** 2026-02-24T07:38:22.991 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:22 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0[55291]: 2026-02-24T07:38:22.641+0000 7fa957aa0640 -1 osd.0 740 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T07:38:27.991 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:27 trial022 podman[146624]: 2026-02-24 07:38:27.721891056 +0000 UTC m=+5.091142228 container died 14c67a3df4af94e68d0456d3151f6b774cfa482741c535cf461503dafb2144cb (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7) 2026-02-24T07:38:27.992 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:27 trial022 podman[146624]: 2026-02-24 07:38:27.730670157 +0000 UTC m=+5.099921319 container remove 14c67a3df4af94e68d0456d3151f6b774cfa482741c535cf461503dafb2144cb (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0, ceph=True, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default) 2026-02-24T07:38:27.992 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:27 trial022 bash[146624]: ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0 2026-02-24T07:38:27.992 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:27 trial022 podman[146752]: 2026-02-24 07:38:27.855010624 +0000 UTC m=+0.014687856 container create d3697be1d6ec69c5e985ec21ab48b4c52df9cf0c09dc0367c6cad972c6f92aab (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS) 2026-02-24T07:38:27.992 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:27 trial022 podman[146752]: 2026-02-24 07:38:27.888035495 +0000 UTC m=+0.047712737 container init d3697be1d6ec69c5e985ec21ab48b4c52df9cf0c09dc0367c6cad972c6f92aab (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.vendor=CentOS) 2026-02-24T07:38:27.992 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:27 trial022 podman[146752]: 2026-02-24 07:38:27.89043632 +0000 UTC m=+0.050113562 container start d3697be1d6ec69c5e985ec21ab48b4c52df9cf0c09dc0367c6cad972c6f92aab (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.build-date=20260223) 2026-02-24T07:38:27.992 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:27 trial022 podman[146752]: 2026-02-24 07:38:27.891134426 +0000 UTC m=+0.050811668 container attach d3697be1d6ec69c5e985ec21ab48b4c52df9cf0c09dc0367c6cad972c6f92aab (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-0-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.build-date=20260223, io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default) 2026-02-24T07:38:27.992 INFO:journalctl@ceph.osd.0.trial022.stdout:Feb 24 07:38:27 trial022 podman[146752]: 2026-02-24 07:38:27.849096861 +0000 UTC m=+0.008774103 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T07:38:28.055 DEBUG:teuthology.orchestra.run.trial022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.0.service' 2026-02-24T07:38:28.091 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T07:38:28.092 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-24T07:38:28.092 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-24T07:38:28.092 DEBUG:teuthology.orchestra.run.trial022:> sudo systemctl stop ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.1 2026-02-24T07:38:28.491 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:28 trial022 systemd[1]: Stopping Ceph osd.1 for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:38:28.491 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:28 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1[62997]: 2026-02-24T07:38:28.226+0000 7fd97cab8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T07:38:28.491 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:28 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1[62997]: 2026-02-24T07:38:28.226+0000 7fd97cab8640 -1 osd.1 740 *** Got signal Terminated *** 2026-02-24T07:38:28.492 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:28 trial022 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1[62997]: 2026-02-24T07:38:28.226+0000 7fd97cab8640 -1 osd.1 740 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T07:38:33.610 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:33 trial022 podman[146887]: 2026-02-24 07:38:33.316118794 +0000 UTC m=+5.101797681 container died 3a21be25ea4e2ddea8e69548bc69f9337db85635aa0d11f2f7a00f38a50a77b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, ceph=True, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7) 2026-02-24T07:38:33.610 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:33 trial022 podman[146887]: 2026-02-24 07:38:33.324807357 +0000 UTC m=+5.110486244 container remove 3a21be25ea4e2ddea8e69548bc69f9337db85635aa0d11f2f7a00f38a50a77b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, ceph=True, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.license=GPLv2) 2026-02-24T07:38:33.610 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:33 trial022 bash[146887]: ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1 2026-02-24T07:38:33.610 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:33 trial022 podman[147027]: 2026-02-24 07:38:33.448060116 +0000 UTC m=+0.015904865 container create 1d39e0b247a0166cdde0e578eab2c2d6a8457b69dcb2905ace364f2753e2cd61 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223) 2026-02-24T07:38:33.610 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:33 trial022 podman[147027]: 2026-02-24 07:38:33.478764361 +0000 UTC m=+0.046609120 container init 1d39e0b247a0166cdde0e578eab2c2d6a8457b69dcb2905ace364f2753e2cd61 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1-deactivate, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2026-02-24T07:38:33.610 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:33 trial022 podman[147027]: 2026-02-24 07:38:33.481061644 +0000 UTC m=+0.048906413 container start 1d39e0b247a0166cdde0e578eab2c2d6a8457b69dcb2905ace364f2753e2cd61 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1-deactivate, ceph=True, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_REF=wip-shraddhaag-enable-cephadm-tests) 2026-02-24T07:38:33.610 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:33 trial022 podman[147027]: 2026-02-24 07:38:33.48156632 +0000 UTC m=+0.049411079 container attach 1d39e0b247a0166cdde0e578eab2c2d6a8457b69dcb2905ace364f2753e2cd61 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1-deactivate, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260223, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T07:38:33.610 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:33 trial022 podman[147027]: 2026-02-24 07:38:33.441616529 +0000 UTC m=+0.009461298 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T07:38:33.610 INFO:journalctl@ceph.osd.1.trial022.stdout:Feb 24 07:38:33 trial022 podman[147027]: 2026-02-24 07:38:33.609359655 +0000 UTC m=+0.177204414 container died 1d39e0b247a0166cdde0e578eab2c2d6a8457b69dcb2905ace364f2753e2cd61 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-1-deactivate, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-24T07:38:33.639 DEBUG:teuthology.orchestra.run.trial022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.1.service' 2026-02-24T07:38:33.677 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T07:38:33.678 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-24T07:38:33.678 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-24T07:38:33.679 DEBUG:teuthology.orchestra.run.trial195:> sudo systemctl stop ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.2 2026-02-24T07:38:34.127 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:33 trial195 systemd[1]: Stopping Ceph osd.2 for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:38:34.127 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:33 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2[47154]: 2026-02-24T07:38:33.776+0000 7f53c68a2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T07:38:34.127 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:33 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2[47154]: 2026-02-24T07:38:33.776+0000 7f53c68a2640 -1 osd.2 740 *** Got signal Terminated *** 2026-02-24T07:38:34.127 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:33 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2[47154]: 2026-02-24T07:38:33.776+0000 7f53c68a2640 -1 osd.2 740 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T07:38:39.127 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:38 trial195 podman[68980]: 2026-02-24 07:38:38.856699793 +0000 UTC m=+5.090502183 container died 00190146add96660f20ea8d788cf517bd70779e5c11528376e36afc574a1c6c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.build-date=20260223, OSD_FLAVOR=default, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7) 2026-02-24T07:38:39.128 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:38 trial195 podman[68980]: 2026-02-24 07:38:38.865640779 +0000 UTC m=+5.099443169 container remove 00190146add96660f20ea8d788cf517bd70779e5c11528376e36afc574a1c6c0 (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-24T07:38:39.128 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:38 trial195 bash[68980]: ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2 2026-02-24T07:38:39.128 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:38 trial195 podman[69112]: 2026-02-24 07:38:38.989079259 +0000 UTC m=+0.014753402 container create a8ac7d05ad2084197e210e6dc641b4dcbba8d9469b4013f3e61f41de48b546fe (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T07:38:39.128 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:39 trial195 podman[69112]: 2026-02-24 07:38:39.01937671 +0000 UTC m=+0.045050853 container init a8ac7d05ad2084197e210e6dc641b4dcbba8d9469b4013f3e61f41de48b546fe (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, io.buildah.version=1.33.7) 2026-02-24T07:38:39.128 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:39 trial195 podman[69112]: 2026-02-24 07:38:39.022022274 +0000 UTC m=+0.047696417 container start a8ac7d05ad2084197e210e6dc641b4dcbba8d9469b4013f3e61f41de48b546fe (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260223, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.vendor=CentOS) 2026-02-24T07:38:39.129 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:39 trial195 podman[69112]: 2026-02-24 07:38:39.022535447 +0000 UTC m=+0.048209590 container attach a8ac7d05ad2084197e210e6dc641b4dcbba8d9469b4013f3e61f41de48b546fe (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-2-deactivate, org.label-schema.schema-version=1.0, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.license=GPLv2, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.build-date=20260223, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-24T07:38:39.129 INFO:journalctl@ceph.osd.2.trial195.stdout:Feb 24 07:38:39 trial195 podman[69112]: 2026-02-24 07:38:38.983019514 +0000 UTC m=+0.008693657 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T07:38:39.180 DEBUG:teuthology.orchestra.run.trial195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.2.service' 2026-02-24T07:38:39.220 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T07:38:39.220 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-24T07:38:39.221 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-24T07:38:39.221 DEBUG:teuthology.orchestra.run.trial195:> sudo systemctl stop ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.3 2026-02-24T07:38:39.626 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:39 trial195 systemd[1]: Stopping Ceph osd.3 for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:38:39.627 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:39 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3[55260]: 2026-02-24T07:38:39.356+0000 7f2af7174640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-24T07:38:39.627 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:39 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3[55260]: 2026-02-24T07:38:39.356+0000 7f2af7174640 -1 osd.3 740 *** Got signal Terminated *** 2026-02-24T07:38:39.627 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:39 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3[55260]: 2026-02-24T07:38:39.356+0000 7f2af7174640 -1 osd.3 740 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-24T07:38:44.739 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:44 trial195 podman[69246]: 2026-02-24 07:38:44.447086199 +0000 UTC m=+5.101697743 container died 7b235b784b609df17d80dcf574d79e4d7fd33ca2d5c44a40960b5c3f1fe077cd (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.build-date=20260223, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7) 2026-02-24T07:38:44.739 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:44 trial195 podman[69246]: 2026-02-24 07:38:44.456978953 +0000 UTC m=+5.111590497 container remove 7b235b784b609df17d80dcf574d79e4d7fd33ca2d5c44a40960b5c3f1fe077cd (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, OSD_FLAVOR=default, org.label-schema.build-date=20260223, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0) 2026-02-24T07:38:44.739 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:44 trial195 bash[69246]: ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3 2026-02-24T07:38:44.739 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:44 trial195 podman[69375]: 2026-02-24 07:38:44.579426041 +0000 UTC m=+0.015888921 container create a3b533f83ee0a0982dbcb4c219afc2bd6a7b0f0bfe177c1dc42ce2615cae505f (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3-deactivate, ceph=True, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0) 2026-02-24T07:38:44.739 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:44 trial195 podman[69375]: 2026-02-24 07:38:44.61840704 +0000 UTC m=+0.054869900 container init a3b533f83ee0a0982dbcb4c219afc2bd6a7b0f0bfe177c1dc42ce2615cae505f (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.build-date=20260223, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-24T07:38:44.739 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:44 trial195 podman[69375]: 2026-02-24 07:38:44.62095889 +0000 UTC m=+0.057421760 container start a3b533f83ee0a0982dbcb4c219afc2bd6a7b0f0bfe177c1dc42ce2615cae505f (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-24T07:38:44.740 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:44 trial195 podman[69375]: 2026-02-24 07:38:44.621506978 +0000 UTC m=+0.057969848 container attach a3b533f83ee0a0982dbcb4c219afc2bd6a7b0f0bfe177c1dc42ce2615cae505f (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3-deactivate, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260223, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-24T07:38:44.740 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:44 trial195 podman[69375]: 2026-02-24 07:38:44.573075587 +0000 UTC m=+0.009538457 image pull 3992f70354a3fdc3bbd8e07cbd698e424b71669298ffe35e8f0565a46973aa85 quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148 2026-02-24T07:38:44.740 INFO:journalctl@ceph.osd.3.trial195.stdout:Feb 24 07:38:44 trial195 podman[69375]: 2026-02-24 07:38:44.741720438 +0000 UTC m=+0.178183308 container died a3b533f83ee0a0982dbcb4c219afc2bd6a7b0f0bfe177c1dc42ce2615cae505f (image=quay.ceph.io/ceph-ci/ceph@sha256:9a5db51bca6d139691bb8c7054be8834f3ba065d1c0aaaecbafb190e389fb148, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-osd-3-deactivate, CEPH_SHA1=ff63f3d997e38f69382fd23ac0206f07f7b05017, org.label-schema.license=GPLv2, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260223, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-shraddhaag-enable-cephadm-tests, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2026-02-24T07:38:44.772 DEBUG:teuthology.orchestra.run.trial195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@osd.3.service' 2026-02-24T07:38:44.808 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T07:38:44.808 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-24T07:38:44.808 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2026-02-24T07:38:44.808 DEBUG:teuthology.orchestra.run.trial195:> sudo systemctl stop ceph-30400272-1151-11f1-be09-d404e6e7d460@prometheus.a 2026-02-24T07:38:45.014 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 systemd[1]: Stopping Ceph prometheus.a for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:38:45.014 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.945Z level=WARN source=main.go:1076 msg="Received an OS signal, exiting gracefully..." signal=terminated 2026-02-24T07:38:45.014 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=main.go:1101 msg="Stopping scrape discovery manager..." 2026-02-24T07:38:45.014 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=main.go:1115 msg="Stopping notify discovery manager..." 2026-02-24T07:38:45.014 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=manager.go:190 msg="Stopping rule manager..." component="rule manager" 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=main.go:1111 msg="Notify discovery manager stopped" 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=main.go:1097 msg="Scrape discovery manager stopped" 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=manager.go:206 msg="Rule manager stopped" component="rule manager" 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=main.go:1152 msg="Stopping scrape manager..." 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=main.go:1144 msg="Scrape manager stopped" 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=manager.go:543 msg="Stopping notification manager..." component=notifier 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=manager.go:285 msg="Draining any remaining notifications..." component=notifier 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=manager.go:291 msg="Remaining notifications drained" component=notifier 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=manager.go:218 msg="Notification manager stopped" component=notifier 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=main.go:1422 msg="Notifier manager stopped" 2026-02-24T07:38:45.015 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a[66250]: time=2026-02-24T07:38:44.946Z level=INFO source=main.go:1436 msg="See you next time!" 2026-02-24T07:38:45.016 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 podman[69512]: 2026-02-24 07:38:44.956317325 +0000 UTC m=+0.022972427 container died 444edfbf0c0cbd428a197a83c1757c88de69134637a1892c18017c3b5dfcfa74 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T07:38:45.016 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 podman[69512]: 2026-02-24 07:38:44.965634149 +0000 UTC m=+0.032289251 container remove 444edfbf0c0cbd428a197a83c1757c88de69134637a1892c18017c3b5dfcfa74 (image=quay.io/prometheus/prometheus:v3.6.0, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a, maintainer=The Prometheus Authors , org.opencontainers.image.source=https://github.com/prometheus/prometheus) 2026-02-24T07:38:45.016 INFO:journalctl@ceph.prometheus.a.trial195.stdout:Feb 24 07:38:44 trial195 bash[69512]: ceph-30400272-1151-11f1-be09-d404e6e7d460-prometheus-a 2026-02-24T07:38:45.034 DEBUG:teuthology.orchestra.run.trial195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-30400272-1151-11f1-be09-d404e6e7d460@prometheus.a.service' 2026-02-24T07:38:45.069 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-24T07:38:45.069 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2026-02-24T07:38:45.069 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 30400272-1151-11f1-be09-d404e6e7d460 --force --keep-logs 2026-02-24T07:38:45.187 INFO:teuthology.orchestra.run.trial022.stdout:Deleting cluster with fsid: 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:38:45.901 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:38:45 trial022 systemd[1]: Stopping Ceph node-exporter.a for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:38:45.901 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:38:45 trial022 podman[147375]: 2026-02-24 07:38:45.865782645 +0000 UTC m=+0.023223835 container died 5a7748f749f826883e26c106f970422cd3e178bda9497d82fb8c06f5dd8d837b (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-24T07:38:45.901 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:38:45 trial022 podman[147375]: 2026-02-24 07:38:45.873833144 +0000 UTC m=+0.031274324 container remove 5a7748f749f826883e26c106f970422cd3e178bda9497d82fb8c06f5dd8d837b (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a, maintainer=The Prometheus Authors ) 2026-02-24T07:38:45.901 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:38:45 trial022 bash[147375]: ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-a 2026-02-24T07:38:45.901 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:38:45 trial022 systemd[1]: ceph-30400272-1151-11f1-be09-d404e6e7d460@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2026-02-24T07:38:46.199 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:38:45 trial022 systemd[1]: ceph-30400272-1151-11f1-be09-d404e6e7d460@node-exporter.a.service: Failed with result 'exit-code'. 2026-02-24T07:38:46.199 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:38:45 trial022 systemd[1]: Stopped Ceph node-exporter.a for 30400272-1151-11f1-be09-d404e6e7d460. 2026-02-24T07:38:46.199 INFO:journalctl@ceph.node-exporter.a.trial022.stdout:Feb 24 07:38:45 trial022 systemd[1]: ceph-30400272-1151-11f1-be09-d404e6e7d460@node-exporter.a.service: Consumed 3.050s CPU time. 2026-02-24T07:38:46.478 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 30400272-1151-11f1-be09-d404e6e7d460 --force --keep-logs 2026-02-24T07:38:46.597 INFO:teuthology.orchestra.run.trial195.stdout:Deleting cluster with fsid: 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:38:47.377 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:38:47 trial195 systemd[1]: Stopping Ceph node-exporter.b for 30400272-1151-11f1-be09-d404e6e7d460... 2026-02-24T07:38:47.377 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:38:47 trial195 podman[69827]: 2026-02-24 07:38:47.118724721 +0000 UTC m=+0.022142436 container died 5917178f2808cdf33f5580d262b679fabed548aec68bf8143499493c673f7592 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T07:38:47.377 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:38:47 trial195 podman[69827]: 2026-02-24 07:38:47.127215571 +0000 UTC m=+0.030633286 container remove 5917178f2808cdf33f5580d262b679fabed548aec68bf8143499493c673f7592 (image=quay.io/prometheus/node-exporter:v1.9.1, name=ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b, maintainer=The Prometheus Authors ) 2026-02-24T07:38:47.377 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:38:47 trial195 bash[69827]: ceph-30400272-1151-11f1-be09-d404e6e7d460-node-exporter-b 2026-02-24T07:38:47.377 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:38:47 trial195 systemd[1]: ceph-30400272-1151-11f1-be09-d404e6e7d460@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2026-02-24T07:38:47.377 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:38:47 trial195 systemd[1]: ceph-30400272-1151-11f1-be09-d404e6e7d460@node-exporter.b.service: Failed with result 'exit-code'. 2026-02-24T07:38:47.378 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:38:47 trial195 systemd[1]: Stopped Ceph node-exporter.b for 30400272-1151-11f1-be09-d404e6e7d460. 2026-02-24T07:38:47.378 INFO:journalctl@ceph.node-exporter.b.trial195.stdout:Feb 24 07:38:47 trial195 systemd[1]: ceph-30400272-1151-11f1-be09-d404e6e7d460@node-exporter.b.service: Consumed 2.772s CPU time. 2026-02-24T07:38:47.712 DEBUG:teuthology.orchestra.run.trial022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T07:38:47.742 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-24T07:38:47.769 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-24T07:38:47.771 DEBUG:teuthology.misc:Transferring archived files from trial022:/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67570/remote/trial022/crash 2026-02-24T07:38:47.773 DEBUG:teuthology.orchestra.run.trial022:> sudo tar c -f - -C /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/crash -- . 2026-02-24T07:38:47.806 INFO:teuthology.orchestra.run.trial022.stderr:tar: /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T07:38:47.806 INFO:teuthology.orchestra.run.trial022.stderr:tar: Error is not recoverable: exiting now 2026-02-24T07:38:47.809 DEBUG:teuthology.misc:Transferring archived files from trial195:/var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67570/remote/trial195/crash 2026-02-24T07:38:47.810 DEBUG:teuthology.orchestra.run.trial195:> sudo tar c -f - -C /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/crash -- . 2026-02-24T07:38:47.836 INFO:teuthology.orchestra.run.trial195.stderr:tar: /var/lib/ceph/30400272-1151-11f1-be09-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-24T07:38:47.836 INFO:teuthology.orchestra.run.trial195.stderr:tar: Error is not recoverable: exiting now 2026-02-24T07:38:47.837 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-24T07:38:47.838 DEBUG:teuthology.orchestra.run.trial022:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'reached quota' | grep -E -v 'but it is still running' | grep -E -v 'overall HEALTH_' | grep -E -v '\(POOL_FULL\)' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(CACHE_POOL_NO_HIT_SET\)' | grep -E -v '\(CACHE_POOL_NEAR_FULL\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v '\(PG_AVAILABILITY\)' | grep -E -v '\(PG_DEGRADED\)' | head -n 1 2026-02-24T07:38:47.872 INFO:tasks.cephadm:Compressing logs... 2026-02-24T07:38:47.872 DEBUG:teuthology.orchestra.run.trial022:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T07:38:47.915 DEBUG:teuthology.orchestra.run.trial195:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T07:38:47.935 INFO:teuthology.orchestra.run.trial022.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-24T07:38:47.936 INFO:teuthology.orchestra.run.trial022.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-24T07:38:47.936 INFO:teuthology.orchestra.run.trial022.stderr:gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-mon.a.log 2026-02-24T07:38:47.936 INFO:teuthology.orchestra.run.trial022.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.0.log 2026-02-24T07:38:47.936 INFO:teuthology.orchestra.run.trial022.stderr:/var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph.cephadm.log 2026-02-24T07:38:47.937 INFO:teuthology.orchestra.run.trial022.stderr:/var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph.audit.log 2026-02-24T07:38:47.937 INFO:teuthology.orchestra.run.trial022.stderr:/var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-volume.log 2026-02-24T07:38:47.937 INFO:teuthology.orchestra.run.trial022.stderr: 82.0% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph.cephadm.log.gz 2026-02-24T07:38:47.938 INFO:teuthology.orchestra.run.trial022.stderr:gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.1.log 2026-02-24T07:38:47.938 INFO:teuthology.orchestra.run.trial022.stderr:/var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-mgr.x.log 2026-02-24T07:38:47.938 INFO:teuthology.orchestra.run.trial022.stderr:/var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-volume.log: /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph.log 2026-02-24T07:38:47.939 INFO:teuthology.orchestra.run.trial022.stderr:/var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-mgr.x.log: /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph.log: 90.4% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph.audit.log.gz 2026-02-24T07:38:47.939 INFO:teuthology.orchestra.run.trial022.stderr: 92.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T07:38:47.939 INFO:teuthology.orchestra.run.trial195.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-24T07:38:47.940 INFO:teuthology.orchestra.run.trial022.stderr: 93.6% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-volume.log.gz 2026-02-24T07:38:47.940 INFO:teuthology.orchestra.run.trial022.stderr: 87.2% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph.log.gz 2026-02-24T07:38:47.940 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-24T07:38:47.941 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.2.log 2026-02-24T07:38:47.941 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.3.log 2026-02-24T07:38:47.941 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-volume.log 2026-02-24T07:38:47.942 INFO:teuthology.orchestra.run.trial195.stderr:/var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.2.log: /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.3.log: /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-volume.log: 83.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-24T07:38:47.943 INFO:teuthology.orchestra.run.trial195.stderr: 93.5% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-volume.log.gz 2026-02-24T07:38:48.043 INFO:teuthology.orchestra.run.trial022.stderr: 92.1% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-24T07:38:48.636 INFO:teuthology.orchestra.run.trial022.stderr: 92.4% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-mon.a.log.gz 2026-02-24T07:38:53.173 INFO:teuthology.orchestra.run.trial022.stderr: 94.9% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.1.log.gz 2026-02-24T07:38:53.311 INFO:teuthology.orchestra.run.trial195.stderr: 94.9% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.3.log.gz 2026-02-24T07:38:53.510 INFO:teuthology.orchestra.run.trial195.stderr: 94.9% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.2.log.gz 2026-02-24T07:38:53.511 INFO:teuthology.orchestra.run.trial195.stderr: 2026-02-24T07:38:53.511 INFO:teuthology.orchestra.run.trial195.stderr:real 0m5.580s 2026-02-24T07:38:53.511 INFO:teuthology.orchestra.run.trial195.stderr:user 0m10.430s 2026-02-24T07:38:53.511 INFO:teuthology.orchestra.run.trial195.stderr:sys 0m0.508s 2026-02-24T07:38:53.702 INFO:teuthology.orchestra.run.trial022.stderr: 94.9% -- replaced with /var/log/ceph/30400272-1151-11f1-be09-d404e6e7d460/ceph-osd.0.log.gz 2026-02-24T07:38:53.703 INFO:teuthology.orchestra.run.trial022.stderr: 2026-02-24T07:38:53.704 INFO:teuthology.orchestra.run.trial022.stderr:real 0m5.776s 2026-02-24T07:38:53.704 INFO:teuthology.orchestra.run.trial022.stderr:user 0m11.253s 2026-02-24T07:38:53.704 INFO:teuthology.orchestra.run.trial022.stderr:sys 0m0.559s 2026-02-24T07:38:53.705 INFO:tasks.cephadm:Archiving logs... 2026-02-24T07:38:53.705 DEBUG:teuthology.misc:Transferring archived files from trial022:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67570/remote/trial022/log 2026-02-24T07:38:53.707 DEBUG:teuthology.orchestra.run.trial022:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T07:38:54.566 DEBUG:teuthology.misc:Transferring archived files from trial195:/var/log/ceph to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67570/remote/trial195/log 2026-02-24T07:38:54.567 DEBUG:teuthology.orchestra.run.trial195:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T07:38:55.294 INFO:tasks.cephadm:Removing cluster... 2026-02-24T07:38:55.295 DEBUG:teuthology.orchestra.run.trial022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 30400272-1151-11f1-be09-d404e6e7d460 --force 2026-02-24T07:38:55.413 INFO:teuthology.orchestra.run.trial022.stdout:Deleting cluster with fsid: 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:38:55.598 DEBUG:teuthology.orchestra.run.trial195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 30400272-1151-11f1-be09-d404e6e7d460 --force 2026-02-24T07:38:55.717 INFO:teuthology.orchestra.run.trial195.stdout:Deleting cluster with fsid: 30400272-1151-11f1-be09-d404e6e7d460 2026-02-24T07:38:55.894 INFO:tasks.cephadm:Removing cephadm ... 2026-02-24T07:38:55.894 DEBUG:teuthology.orchestra.run.trial022:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T07:38:55.911 DEBUG:teuthology.orchestra.run.trial195:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-24T07:38:55.928 INFO:tasks.cephadm:Teardown complete 2026-02-24T07:38:55.928 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T07:38:55.939 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T07:38:55.940 DEBUG:teuthology.orchestra.run.trial022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T07:38:55.953 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T07:38:56.222 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T07:38:56.233 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T07:38:56.234 DEBUG:teuthology.orchestra.run.trial022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T07:38:56.236 DEBUG:teuthology.orchestra.run.trial195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T07:38:56.250 INFO:teuthology.orchestra.run.trial022.stderr:bash: line 1: ntpq: command not found 2026-02-24T07:38:56.252 INFO:teuthology.orchestra.run.trial195.stderr:bash: line 1: ntpq: command not found 2026-02-24T07:38:56.277 INFO:teuthology.orchestra.run.trial022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T07:38:56.277 INFO:teuthology.orchestra.run.trial022.stdout:=============================================================================== 2026-02-24T07:38:56.277 INFO:teuthology.orchestra.run.trial022.stdout:^- 38.45.64.130 2 7 377 113 -560us[ -635us] +/- 18ms 2026-02-24T07:38:56.277 INFO:teuthology.orchestra.run.trial022.stdout:^- sensei.ruselabs.com 2 6 377 47 -832us[ -872us] +/- 39ms 2026-02-24T07:38:56.277 INFO:teuthology.orchestra.run.trial022.stdout:^- us-central-1.clearnet.pw 2 7 377 46 +4650us[+4610us] +/- 70ms 2026-02-24T07:38:56.277 INFO:teuthology.orchestra.run.trial022.stdout:^* pool-138-89-14-60.mad.ea> 1 6 177 44 -46us[ -87us] +/- 2898us 2026-02-24T07:38:56.279 INFO:teuthology.orchestra.run.trial195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T07:38:56.279 INFO:teuthology.orchestra.run.trial195.stdout:=============================================================================== 2026-02-24T07:38:56.279 INFO:teuthology.orchestra.run.trial195.stdout:^- 172-234-44-141.ip.linode> 2 6 377 44 +17ms[ +17ms] +/- 90ms 2026-02-24T07:38:56.279 INFO:teuthology.orchestra.run.trial195.stdout:^* 99-28-14-242.lightspeed.> 1 7 377 47 +1296us[+1470us] +/- 14ms 2026-02-24T07:38:56.280 INFO:teuthology.orchestra.run.trial195.stdout:^- time-dfw.far.net 2 7 377 45 +3460us[+3460us] +/- 52ms 2026-02-24T07:38:56.280 INFO:teuthology.orchestra.run.trial195.stdout:^+ 136-60-131-14.googlefibe> 1 7 377 108 -1211us[-1049us] +/- 31ms 2026-02-24T07:38:56.280 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T07:38:56.292 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T07:38:56.292 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T07:38:56.304 DEBUG:teuthology.orchestra.run.trial022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T07:38:56.375 DEBUG:teuthology.orchestra.run.trial195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T07:38:56.430 DEBUG:teuthology.orchestra.run.trial022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T07:38:56.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:38:56.458 DEBUG:teuthology.orchestra.run.trial195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T07:38:56.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:38:56.483 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T07:38:56.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T07:38:56.507 INFO:teuthology.task.internal:Duration was 1538.829263 seconds 2026-02-24T07:38:56.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T07:38:56.522 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T07:38:56.523 DEBUG:teuthology.orchestra.run.trial022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T07:38:56.525 DEBUG:teuthology.orchestra.run.trial195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T07:38:56.560 INFO:teuthology.orchestra.run.trial022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T07:38:56.561 INFO:teuthology.orchestra.run.trial195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T07:38:56.903 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T07:38:56.904 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial022.front.sepia.ceph.com 2026-02-24T07:38:56.904 DEBUG:teuthology.orchestra.run.trial022:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T07:38:56.923 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial195.front.sepia.ceph.com 2026-02-24T07:38:56.923 DEBUG:teuthology.orchestra.run.trial195:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T07:38:56.962 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T07:38:56.963 DEBUG:teuthology.orchestra.run.trial022:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T07:38:56.965 DEBUG:teuthology.orchestra.run.trial195:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T07:38:57.109 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T07:38:57.110 DEBUG:teuthology.orchestra.run.trial022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T07:38:57.111 DEBUG:teuthology.orchestra.run.trial195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T07:38:57.132 INFO:teuthology.orchestra.run.trial022.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T07:38:57.132 INFO:teuthology.orchestra.run.trial022.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T07:38:57.133 INFO:teuthology.orchestra.run.trial022.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T07:38:57.133 INFO:teuthology.orchestra.run.trial022.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T07:38:57.133 INFO:teuthology.orchestra.run.trial022.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T07:38:57.134 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T07:38:57.134 INFO:teuthology.orchestra.run.trial195.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T07:38:57.135 INFO:teuthology.orchestra.run.trial195.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T07:38:57.135 INFO:teuthology.orchestra.run.trial195.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T07:38:57.135 INFO:teuthology.orchestra.run.trial195.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T07:38:57.150 INFO:teuthology.orchestra.run.trial195.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 86.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T07:38:57.158 INFO:teuthology.orchestra.run.trial022.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T07:38:57.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T07:38:57.176 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T07:38:57.177 DEBUG:teuthology.orchestra.run.trial022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T07:38:57.225 DEBUG:teuthology.orchestra.run.trial195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T07:38:57.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T07:38:57.266 DEBUG:teuthology.orchestra.run.trial022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T07:38:57.269 DEBUG:teuthology.orchestra.run.trial195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T07:38:57.291 INFO:teuthology.orchestra.run.trial022.stdout:kernel.core_pattern = core 2026-02-24T07:38:57.313 INFO:teuthology.orchestra.run.trial195.stdout:kernel.core_pattern = core 2026-02-24T07:38:57.328 DEBUG:teuthology.orchestra.run.trial022:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T07:38:57.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:38:57.360 DEBUG:teuthology.orchestra.run.trial195:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T07:38:57.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T07:38:57.385 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T07:38:57.415 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T07:38:57.417 DEBUG:teuthology.misc:Transferring archived files from trial022:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67570/remote/trial022 2026-02-24T07:38:57.417 DEBUG:teuthology.orchestra.run.trial022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T07:38:57.461 DEBUG:teuthology.misc:Transferring archived files from trial195:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/shraddhaag-2026-02-24_06:51:01-crimson-rados-main-distro-debug-trial/67570/remote/trial195 2026-02-24T07:38:57.462 DEBUG:teuthology.orchestra.run.trial195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T07:38:57.504 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T07:38:57.504 DEBUG:teuthology.orchestra.run.trial022:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T07:38:57.507 DEBUG:teuthology.orchestra.run.trial195:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T07:38:57.549 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T07:38:57.567 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T07:38:57.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T07:38:57.583 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T07:38:57.583 DEBUG:teuthology.orchestra.run.trial022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T07:38:57.586 DEBUG:teuthology.orchestra.run.trial195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T07:38:57.599 INFO:teuthology.orchestra.run.trial022.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 07:38 /home/ubuntu/cephtest 2026-02-24T07:38:57.605 INFO:teuthology.orchestra.run.trial195.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 07:38 /home/ubuntu/cephtest 2026-02-24T07:38:57.607 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T07:38:57.623 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T07:38:57.650 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{0-crimson_install clusters/crimson-fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/cephadm objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} tasks/rados_api_tests} duration: 1538.8292634487152 flavor: debug owner: scheduled_shraddhaag@soko04.front.sepia.ceph.com success: true 2026-02-24T07:38:57.650 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T07:38:57.900 INFO:teuthology.run:pass