2026-02-19T08:20:14.143 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-19T08:20:14.158 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T08:20:14.241 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-19_08:14:16-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/57864 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '57864' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-19_08:14:16-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 global: mon election default strategy: 3 mds: debug mgrc: 20 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug mgrc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_DEGRADED\) sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 60 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - mon.a - mgr.a - client.0 - - host.b - client.1 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDpsvHLBGvB8wRDBJv3XsVD1ISmy0zmfx0WvqA80W+KMh00+02rbc441rQRBvt1pQiGCawiUBh7ERhSNyx23r24= trial116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEleG5PWj5yDzbuNjjGYs0fjh//dei5RlcvD1d7mz1zDCLZpac+7tPuZJQhN5/HqFPlBhEwW9NJGU2x76wtfGNA= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: null - cephadm: null - ceph: log-ignorelist: - \(OSD_DOWN\) - workunit: clients: client.1: - cephadm/create_iscsi_disks.sh - workunit: clients: client.0: - cephadm/test_dashboard_e2e.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-19_08:14:16 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-19T08:20:14.242 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-19T08:20:14.242 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-19T08:20:14.242 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-19T08:20:14.244 INFO:teuthology.task.internal:Checking packages... 2026-02-19T08:20:14.244 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-19T08:20:14.244 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-19T08:20:14.244 INFO:teuthology.packaging:ref: None 2026-02-19T08:20:14.244 INFO:teuthology.packaging:tag: None 2026-02-19T08:20:14.244 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-19T08:20:14.244 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-19T08:20:14.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-19T08:20:14.363 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705.g04cf6dd4 2026-02-19T08:20:14.365 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-19T08:20:14.376 INFO:teuthology.task.internal:no buildpackages task found 2026-02-19T08:20:14.376 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-19T08:20:14.390 INFO:teuthology.task.internal:Saving configuration 2026-02-19T08:20:14.401 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-19T08:20:14.414 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-19T08:20:14.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial027.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-19_08:14:16-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/57864', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-19 08:15:55.055099', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDpsvHLBGvB8wRDBJv3XsVD1ISmy0zmfx0WvqA80W+KMh00+02rbc441rQRBvt1pQiGCawiUBh7ERhSNyx23r24='} 2026-02-19T08:20:14.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial116.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-19_08:14:16-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/57864', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-19 08:15:55.054510', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEleG5PWj5yDzbuNjjGYs0fjh//dei5RlcvD1d7mz1zDCLZpac+7tPuZJQhN5/HqFPlBhEwW9NJGU2x76wtfGNA='} 2026-02-19T08:20:14.561 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-19T08:20:14.574 INFO:teuthology.task.internal:roles: ubuntu@trial027.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'] 2026-02-19T08:20:14.575 INFO:teuthology.task.internal:roles: ubuntu@trial116.front.sepia.ceph.com - ['host.b', 'client.1'] 2026-02-19T08:20:14.575 INFO:teuthology.run_tasks:Running task console_log... 2026-02-19T08:20:14.709 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x78d80d754400>, signals=[15]) 2026-02-19T08:20:14.709 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-19T08:20:14.720 INFO:teuthology.task.internal:Opening connections... 2026-02-19T08:20:14.720 DEBUG:teuthology.task.internal:connecting to ubuntu@trial027.front.sepia.ceph.com 2026-02-19T08:20:14.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T08:20:14.783 DEBUG:teuthology.task.internal:connecting to ubuntu@trial116.front.sepia.ceph.com 2026-02-19T08:20:14.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T08:20:14.846 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-19T08:20:14.858 DEBUG:teuthology.orchestra.run.trial027:> uname -m 2026-02-19T08:20:14.875 INFO:teuthology.orchestra.run.trial027.stdout:x86_64 2026-02-19T08:20:14.875 DEBUG:teuthology.orchestra.run.trial027:> cat /etc/os-release 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:NAME="CentOS Stream" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:VERSION="9" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:ID="centos" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:ID_LIKE="rhel fedora" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:VERSION_ID="9" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:PLATFORM_ID="platform:el9" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:ANSI_COLOR="0;31" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:LOGO="fedora-logo-icon" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:HOME_URL="https://centos.org/" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-19T08:20:14.933 INFO:teuthology.orchestra.run.trial027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-19T08:20:14.934 INFO:teuthology.lock.ops:Updating trial027.front.sepia.ceph.com on lock server 2026-02-19T08:20:15.000 DEBUG:teuthology.orchestra.run.trial116:> uname -m 2026-02-19T08:20:15.017 INFO:teuthology.orchestra.run.trial116.stdout:x86_64 2026-02-19T08:20:15.017 DEBUG:teuthology.orchestra.run.trial116:> cat /etc/os-release 2026-02-19T08:20:15.072 INFO:teuthology.orchestra.run.trial116.stdout:NAME="CentOS Stream" 2026-02-19T08:20:15.072 INFO:teuthology.orchestra.run.trial116.stdout:VERSION="9" 2026-02-19T08:20:15.072 INFO:teuthology.orchestra.run.trial116.stdout:ID="centos" 2026-02-19T08:20:15.072 INFO:teuthology.orchestra.run.trial116.stdout:ID_LIKE="rhel fedora" 2026-02-19T08:20:15.072 INFO:teuthology.orchestra.run.trial116.stdout:VERSION_ID="9" 2026-02-19T08:20:15.072 INFO:teuthology.orchestra.run.trial116.stdout:PLATFORM_ID="platform:el9" 2026-02-19T08:20:15.072 INFO:teuthology.orchestra.run.trial116.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-19T08:20:15.073 INFO:teuthology.orchestra.run.trial116.stdout:ANSI_COLOR="0;31" 2026-02-19T08:20:15.073 INFO:teuthology.orchestra.run.trial116.stdout:LOGO="fedora-logo-icon" 2026-02-19T08:20:15.073 INFO:teuthology.orchestra.run.trial116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-19T08:20:15.073 INFO:teuthology.orchestra.run.trial116.stdout:HOME_URL="https://centos.org/" 2026-02-19T08:20:15.073 INFO:teuthology.orchestra.run.trial116.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-19T08:20:15.073 INFO:teuthology.orchestra.run.trial116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-19T08:20:15.073 INFO:teuthology.orchestra.run.trial116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-19T08:20:15.073 INFO:teuthology.lock.ops:Updating trial116.front.sepia.ceph.com on lock server 2026-02-19T08:20:15.140 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-19T08:20:15.154 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-19T08:20:15.165 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-19T08:20:15.166 DEBUG:teuthology.orchestra.run.trial027:> test '!' -e /home/ubuntu/cephtest 2026-02-19T08:20:15.168 DEBUG:teuthology.orchestra.run.trial116:> test '!' -e /home/ubuntu/cephtest 2026-02-19T08:20:15.183 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-19T08:20:15.194 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-19T08:20:15.194 DEBUG:teuthology.orchestra.run.trial027:> test -z $(ls -A /var/lib/ceph) 2026-02-19T08:20:15.224 DEBUG:teuthology.orchestra.run.trial116:> test -z $(ls -A /var/lib/ceph) 2026-02-19T08:20:15.241 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-19T08:20:15.398 INFO:teuthology.run_tasks:Running task kernel... 2026-02-19T08:20:15.422 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-19T08:20:15.422 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-19T08:20:15.422 DEBUG:teuthology.orchestra.run.trial027:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-19T08:20:15.423 DEBUG:teuthology.orchestra.run.trial116:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-19T08:20:15.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:20:15.438 DEBUG:teuthology.orchestra.run.trial116:> uname -r 2026-02-19T08:20:15.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:20:15.439 DEBUG:teuthology.orchestra.run.trial027:> uname -r 2026-02-19T08:20:15.493 INFO:teuthology.orchestra.run.trial116.stdout:5.14.0-681.el9.x86_64 2026-02-19T08:20:15.493 INFO:teuthology.task.kernel:Running kernel on trial116: 5.14.0-681.el9.x86_64 2026-02-19T08:20:15.493 DEBUG:teuthology.orchestra.run.trial116:> sudo yum install -y kernel 2026-02-19T08:20:15.494 INFO:teuthology.orchestra.run.trial027.stdout:5.14.0-681.el9.x86_64 2026-02-19T08:20:15.494 INFO:teuthology.task.kernel:Running kernel on trial027: 5.14.0-681.el9.x86_64 2026-02-19T08:20:15.495 DEBUG:teuthology.orchestra.run.trial027:> sudo yum install -y kernel 2026-02-19T08:20:19.489 INFO:teuthology.orchestra.run.trial116.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.9 MB 00:03 2026-02-19T08:20:23.096 INFO:teuthology.orchestra.run.trial027.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.9 MB 00:07 2026-02-19T08:20:26.452 INFO:teuthology.orchestra.run.trial027.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 27 MB 00:02 2026-02-19T08:20:30.357 INFO:teuthology.orchestra.run.trial027.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-19T08:20:30.664 INFO:teuthology.orchestra.run.trial116.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 27 MB 00:10 2026-02-19T08:20:31.279 INFO:teuthology.orchestra.run.trial027.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 20 kB 00:00 2026-02-19T08:20:31.874 INFO:teuthology.orchestra.run.trial027.stdout:Extra Packages for Enterprise Linux 38 MB/s | 20 MB 00:00 2026-02-19T08:20:34.005 INFO:teuthology.orchestra.run.trial116.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 7.8 MB 00:00 2026-02-19T08:20:34.920 INFO:teuthology.orchestra.run.trial116.stdout:CentOS Stream 9 - Extras packages 104 kB/s | 20 kB 00:00 2026-02-19T08:20:35.091 INFO:teuthology.orchestra.run.trial027.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-19T08:20:35.376 INFO:teuthology.orchestra.run.trial116.stdout:Extra Packages for Enterprise Linux 52 MB/s | 20 MB 00:00 2026-02-19T08:20:36.108 INFO:teuthology.orchestra.run.trial027.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-19T08:20:36.108 INFO:teuthology.orchestra.run.trial027.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-19T08:20:36.127 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:20:36.127 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:20:36.128 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:20:36.152 DEBUG:teuthology.orchestra.run.trial027:> echo no | sudo yum reinstall kernel || true 2026-02-19T08:20:36.453 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Feb 2026 08:20:35 AM UTC. 2026-02-19T08:20:36.533 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:20:36.534 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:20:36.535 INFO:teuthology.orchestra.run.trial027.stdout: Package Architecture Version Repository Size 2026-02-19T08:20:36.535 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:20:36.535 INFO:teuthology.orchestra.run.trial027.stdout:Reinstalling: 2026-02-19T08:20:36.535 INFO:teuthology.orchestra.run.trial027.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-19T08:20:36.535 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:20:36.535 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:20:36.535 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:20:36.535 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:20:36.535 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 803 k 2026-02-19T08:20:36.535 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 0 2026-02-19T08:20:36.536 INFO:teuthology.orchestra.run.trial027.stderr:Operation aborted. 2026-02-19T08:20:36.554 INFO:teuthology.orchestra.run.trial027.stdout:Is this ok [y/N]: 2026-02-19T08:20:36.554 DEBUG:teuthology.orchestra.run.trial027:> sudo yum reinstall -y kernel || true 2026-02-19T08:20:36.855 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Feb 2026 08:20:35 AM UTC. 2026-02-19T08:20:36.935 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout: Package Architecture Version Repository Size 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout:Reinstalling: 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 803 k 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 0 2026-02-19T08:20:36.936 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:20:37.222 INFO:teuthology.orchestra.run.trial027.stdout:kernel-5.14.0-681.el9.x86_64.rpm 30 MB/s | 803 kB 00:00 2026-02-19T08:20:37.222 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:20:37.222 INFO:teuthology.orchestra.run.trial027.stdout:Total 2.7 MB/s | 803 kB 00:00 2026-02-19T08:20:37.233 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:20:37.268 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:20:37.268 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:20:37.273 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:20:37.273 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:20:37.296 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:20:37.300 INFO:teuthology.orchestra.run.trial027.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-19T08:20:37.301 INFO:teuthology.orchestra.run.trial027.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-19T08:20:37.414 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-19T08:20:37.415 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-19T08:20:37.471 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-19T08:20:37.471 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:20:37.471 INFO:teuthology.orchestra.run.trial027.stdout:Reinstalled: 2026-02-19T08:20:37.471 INFO:teuthology.orchestra.run.trial027.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-19T08:20:37.471 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:20:37.471 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:20:37.497 DEBUG:teuthology.orchestra.run.trial027:> rpm -q kernel | sort -rV | head -n 1 2026-02-19T08:20:37.520 INFO:teuthology.orchestra.run.trial027.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-19T08:20:37.520 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-19T08:20:37.520 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-19T08:20:37.520 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-19T08:20:37.520 DEBUG:teuthology.orchestra.run.trial027:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-19T08:20:37.584 INFO:teuthology.orchestra.run.trial027.stdout:ttyS1 2026-02-19T08:20:37.604 DEBUG:teuthology.parallel:result is None 2026-02-19T08:20:38.560 INFO:teuthology.orchestra.run.trial116.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-19T08:20:39.573 INFO:teuthology.orchestra.run.trial116.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-19T08:20:39.573 INFO:teuthology.orchestra.run.trial116.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-19T08:20:39.592 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:20:39.593 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:20:39.593 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:20:39.615 DEBUG:teuthology.orchestra.run.trial116:> echo no | sudo yum reinstall kernel || true 2026-02-19T08:20:39.918 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Feb 2026 08:20:38 AM UTC. 2026-02-19T08:20:39.997 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:20:39.997 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:20:39.997 INFO:teuthology.orchestra.run.trial116.stdout: Package Architecture Version Repository Size 2026-02-19T08:20:39.998 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:20:39.998 INFO:teuthology.orchestra.run.trial116.stdout:Reinstalling: 2026-02-19T08:20:39.998 INFO:teuthology.orchestra.run.trial116.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-19T08:20:39.998 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:20:39.998 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:20:39.998 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:20:39.998 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:20:39.998 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 803 k 2026-02-19T08:20:39.998 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 0 2026-02-19T08:20:39.998 INFO:teuthology.orchestra.run.trial116.stderr:Operation aborted. 2026-02-19T08:20:40.018 INFO:teuthology.orchestra.run.trial116.stdout:Is this ok [y/N]: 2026-02-19T08:20:40.018 DEBUG:teuthology.orchestra.run.trial116:> sudo yum reinstall -y kernel || true 2026-02-19T08:20:40.322 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:02 ago on Thu 19 Feb 2026 08:20:38 AM UTC. 2026-02-19T08:20:40.402 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:20:40.402 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:20:40.402 INFO:teuthology.orchestra.run.trial116.stdout: Package Architecture Version Repository Size 2026-02-19T08:20:40.402 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:20:40.402 INFO:teuthology.orchestra.run.trial116.stdout:Reinstalling: 2026-02-19T08:20:40.402 INFO:teuthology.orchestra.run.trial116.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-19T08:20:40.403 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:20:40.403 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:20:40.403 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:20:40.403 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:20:40.403 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 803 k 2026-02-19T08:20:40.403 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 0 2026-02-19T08:20:40.403 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:20:40.488 INFO:teuthology.orchestra.run.trial116.stdout:kernel-5.14.0-681.el9.x86_64.rpm 31 MB/s | 803 kB 00:00 2026-02-19T08:20:40.489 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:20:40.489 INFO:teuthology.orchestra.run.trial116.stdout:Total 9.1 MB/s | 803 kB 00:00 2026-02-19T08:20:40.499 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:20:40.535 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:20:40.535 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:20:40.540 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:20:40.540 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:20:40.564 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:20:40.568 INFO:teuthology.orchestra.run.trial116.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-19T08:20:40.568 INFO:teuthology.orchestra.run.trial116.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-19T08:20:40.675 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-19T08:20:40.675 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-19T08:20:40.731 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-19T08:20:40.731 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:20:40.731 INFO:teuthology.orchestra.run.trial116.stdout:Reinstalled: 2026-02-19T08:20:40.731 INFO:teuthology.orchestra.run.trial116.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-19T08:20:40.731 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:20:40.731 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:20:40.759 DEBUG:teuthology.orchestra.run.trial116:> rpm -q kernel | sort -rV | head -n 1 2026-02-19T08:20:40.785 INFO:teuthology.orchestra.run.trial116.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-19T08:20:40.786 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-19T08:20:40.786 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-19T08:20:40.786 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-19T08:20:40.786 DEBUG:teuthology.orchestra.run.trial116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-19T08:20:40.851 INFO:teuthology.orchestra.run.trial116.stdout:ttyS1 2026-02-19T08:20:40.872 DEBUG:teuthology.parallel:result is None 2026-02-19T08:20:40.872 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-19T08:20:40.882 INFO:teuthology.task.internal:Creating test directory... 2026-02-19T08:20:40.882 DEBUG:teuthology.orchestra.run.trial027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-19T08:20:40.884 DEBUG:teuthology.orchestra.run.trial116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-19T08:20:40.927 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-19T08:20:40.939 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-19T08:20:40.965 INFO:teuthology.task.internal:Creating archive directory... 2026-02-19T08:20:40.968 DEBUG:teuthology.orchestra.run.trial027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-19T08:20:40.970 DEBUG:teuthology.orchestra.run.trial116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-19T08:20:40.989 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-19T08:20:41.000 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-19T08:20:41.000 DEBUG:teuthology.orchestra.run.trial027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-19T08:20:41.029 DEBUG:teuthology.orchestra.run.trial116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-19T08:20:41.052 INFO:teuthology.orchestra.run.trial027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T08:20:41.054 INFO:teuthology.orchestra.run.trial116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T08:20:41.060 INFO:teuthology.orchestra.run.trial027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T08:20:41.063 INFO:teuthology.orchestra.run.trial116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T08:20:41.064 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-19T08:20:41.075 INFO:teuthology.task.internal:Configuring sudo... 2026-02-19T08:20:41.075 DEBUG:teuthology.orchestra.run.trial027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-19T08:20:41.104 DEBUG:teuthology.orchestra.run.trial116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-19T08:20:41.128 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-19T08:20:41.141 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-19T08:20:41.141 DEBUG:teuthology.orchestra.run.trial027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-19T08:20:41.169 DEBUG:teuthology.orchestra.run.trial116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-19T08:20:41.186 DEBUG:teuthology.orchestra.run.trial027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T08:20:41.301 DEBUG:teuthology.orchestra.run.trial027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T08:20:41.327 DEBUG:teuthology.orchestra.run.trial027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T08:20:41.444 DEBUG:teuthology.orchestra.run.trial027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T08:20:41.468 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:20:41.468 DEBUG:teuthology.orchestra.run.trial027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-19T08:20:41.531 DEBUG:teuthology.orchestra.run.trial116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T08:20:41.631 DEBUG:teuthology.orchestra.run.trial116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T08:20:41.657 DEBUG:teuthology.orchestra.run.trial116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T08:20:41.777 DEBUG:teuthology.orchestra.run.trial116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T08:20:41.803 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:20:41.803 DEBUG:teuthology.orchestra.run.trial116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-19T08:20:41.867 DEBUG:teuthology.orchestra.run.trial027:> sudo service rsyslog restart 2026-02-19T08:20:41.869 DEBUG:teuthology.orchestra.run.trial116:> sudo service rsyslog restart 2026-02-19T08:20:41.896 INFO:teuthology.orchestra.run.trial027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-19T08:20:41.936 INFO:teuthology.orchestra.run.trial116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-19T08:20:42.381 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-19T08:20:42.392 INFO:teuthology.task.internal:Starting timer... 2026-02-19T08:20:42.392 INFO:teuthology.run_tasks:Running task pcp... 2026-02-19T08:20:42.411 INFO:teuthology.run_tasks:Running task selinux... 2026-02-19T08:20:42.428 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-19T08:20:42.429 DEBUG:teuthology.orchestra.run.trial027:> sudo service auditd rotate 2026-02-19T08:20:42.457 INFO:teuthology.orchestra.run.trial027.stdout:Rotating logs: 2026-02-19T08:20:42.459 DEBUG:teuthology.orchestra.run.trial116:> sudo service auditd rotate 2026-02-19T08:20:42.489 INFO:teuthology.orchestra.run.trial116.stdout:Rotating logs: 2026-02-19T08:20:42.491 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-19T08:20:42.491 DEBUG:teuthology.orchestra.run.trial027:> /usr/sbin/getenforce 2026-02-19T08:20:42.515 INFO:teuthology.orchestra.run.trial027.stdout:Permissive 2026-02-19T08:20:42.516 DEBUG:teuthology.orchestra.run.trial116:> /usr/sbin/getenforce 2026-02-19T08:20:42.546 INFO:teuthology.orchestra.run.trial116.stdout:Permissive 2026-02-19T08:20:42.546 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial027.front.sepia.ceph.com': 'permissive', 'ubuntu@trial116.front.sepia.ceph.com': 'permissive'} 2026-02-19T08:20:42.546 DEBUG:teuthology.orchestra.run.trial027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-19T08:20:42.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:20:42.579 DEBUG:teuthology.orchestra.run.trial116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-19T08:20:42.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:20:42.611 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-19T08:20:42.611 DEBUG:teuthology.orchestra.run.trial027:> sudo /usr/sbin/setenforce permissive 2026-02-19T08:20:42.642 DEBUG:teuthology.orchestra.run.trial116:> sudo /usr/sbin/setenforce permissive 2026-02-19T08:20:42.674 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-19T08:20:42.688 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-19T08:20:42.690 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-19T08:20:42.832 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-19T08:20:42.838 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-19T08:20:42.839 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial027.front.sepia.ceph.com,trial116.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-19T08:21:50.494 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial027.front.sepia.ceph.com'), Remote(name='ubuntu@trial116.front.sepia.ceph.com')] 2026-02-19T08:21:50.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial027.front.sepia.ceph.com' 2026-02-19T08:21:50.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T08:21:50.560 DEBUG:teuthology.orchestra.run.trial027:> true 2026-02-19T08:21:50.632 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial027.front.sepia.ceph.com' 2026-02-19T08:21:50.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial116.front.sepia.ceph.com' 2026-02-19T08:21:50.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T08:21:50.706 DEBUG:teuthology.orchestra.run.trial116:> true 2026-02-19T08:21:50.783 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial116.front.sepia.ceph.com' 2026-02-19T08:21:50.783 INFO:teuthology.run_tasks:Running task clock... 2026-02-19T08:21:50.796 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-19T08:21:50.797 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-19T08:21:50.797 DEBUG:teuthology.orchestra.run.trial027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T08:21:50.799 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-19T08:21:50.799 DEBUG:teuthology.orchestra.run.trial116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T08:21:50.825 INFO:teuthology.orchestra.run.trial027.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-19T08:21:50.836 INFO:teuthology.orchestra.run.trial027.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-19T08:21:50.850 INFO:teuthology.orchestra.run.trial116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-19T08:21:50.856 INFO:teuthology.orchestra.run.trial027.stderr:sudo: ntpd: command not found 2026-02-19T08:21:50.863 INFO:teuthology.orchestra.run.trial116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-19T08:21:50.866 INFO:teuthology.orchestra.run.trial027.stdout:506 Cannot talk to daemon 2026-02-19T08:21:50.877 INFO:teuthology.orchestra.run.trial027.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-19T08:21:50.884 INFO:teuthology.orchestra.run.trial116.stderr:sudo: ntpd: command not found 2026-02-19T08:21:50.889 INFO:teuthology.orchestra.run.trial027.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-19T08:21:50.894 INFO:teuthology.orchestra.run.trial116.stdout:506 Cannot talk to daemon 2026-02-19T08:21:50.906 INFO:teuthology.orchestra.run.trial116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-19T08:21:50.918 INFO:teuthology.orchestra.run.trial116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-19T08:21:50.934 INFO:teuthology.orchestra.run.trial027.stderr:bash: line 1: ntpq: command not found 2026-02-19T08:21:50.949 INFO:teuthology.orchestra.run.trial027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-19T08:21:50.949 INFO:teuthology.orchestra.run.trial027.stdout:=============================================================================== 2026-02-19T08:21:50.949 INFO:teuthology.orchestra.run.trial027.stdout:^? 45-79-189-79.ip.linodeus> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T08:21:50.949 INFO:teuthology.orchestra.run.trial027.stdout:^? ntp1.wiktel.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T08:21:50.949 INFO:teuthology.orchestra.run.trial027.stdout:^? wsip-24-249-17-252.dc.dc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T08:21:50.949 INFO:teuthology.orchestra.run.trial027.stdout:^? dug.arpnet.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T08:21:50.962 INFO:teuthology.orchestra.run.trial116.stderr:bash: line 1: ntpq: command not found 2026-02-19T08:21:50.977 INFO:teuthology.orchestra.run.trial116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-19T08:21:50.977 INFO:teuthology.orchestra.run.trial116.stdout:=============================================================================== 2026-02-19T08:21:50.977 INFO:teuthology.orchestra.run.trial116.stdout:^? time.lmtlabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T08:21:50.977 INFO:teuthology.orchestra.run.trial116.stdout:^? time2.trtnw.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T08:21:50.977 INFO:teuthology.orchestra.run.trial116.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T08:21:50.977 INFO:teuthology.orchestra.run.trial116.stdout:^? 144.202.66.214.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T08:21:50.978 INFO:teuthology.run_tasks:Running task pexec... 2026-02-19T08:21:50.991 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-19T08:21:50.991 DEBUG:teuthology.orchestra.run.trial027:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-19T08:21:50.991 DEBUG:teuthology.orchestra.run.trial116:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-19T08:21:50.994 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial027.front.sepia.ceph.com 2026-02-19T08:21:50.994 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-19T08:21:50.994 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-19T08:21:51.021 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial116.front.sepia.ceph.com 2026-02-19T08:21:51.021 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-19T08:21:51.021 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-19T08:21:51.162 INFO:teuthology.orchestra.run.trial027.stdout:No match for argument: nvme-cli 2026-02-19T08:21:51.162 INFO:teuthology.orchestra.run.trial027.stderr:No packages marked for removal. 2026-02-19T08:21:51.164 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:21:51.165 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:21:51.165 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:21:51.195 INFO:teuthology.orchestra.run.trial116.stdout:No match for argument: nvme-cli 2026-02-19T08:21:51.196 INFO:teuthology.orchestra.run.trial116.stderr:No packages marked for removal. 2026-02-19T08:21:51.197 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:21:51.198 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:21:51.198 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:21:51.462 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:27 ago on Thu 19 Feb 2026 08:21:24 AM UTC. 2026-02-19T08:21:51.499 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:27 ago on Thu 19 Feb 2026 08:21:24 AM UTC. 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout: Package Architecture Version Repository Size 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout:Installing dependencies: 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:21:51.543 INFO:teuthology.orchestra.run.trial027.stdout:Install 6 Packages 2026-02-19T08:21:51.544 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:21:51.544 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 2.3 M 2026-02-19T08:21:51.544 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 11 M 2026-02-19T08:21:51.544 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:21:51.580 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:21:51.581 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:21:51.581 INFO:teuthology.orchestra.run.trial116.stdout: Package Architecture Version Repository Size 2026-02-19T08:21:51.581 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:21:51.581 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout:Installing dependencies: 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:21:51.582 INFO:teuthology.orchestra.run.trial116.stdout:Install 6 Packages 2026-02-19T08:21:51.583 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:21:51.583 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 2.3 M 2026-02-19T08:21:51.583 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 11 M 2026-02-19T08:21:51.583 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:21:51.916 INFO:teuthology.orchestra.run.trial027.stdout:(1/6): nvmetcli-0.8-3.el9.noarch.rpm 141 kB/s | 44 kB 00:00 2026-02-19T08:21:51.960 INFO:teuthology.orchestra.run.trial027.stdout:(2/6): python3-configshell-1.1.30-1.el9.noarch. 202 kB/s | 72 kB 00:00 2026-02-19T08:21:52.095 INFO:teuthology.orchestra.run.trial027.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 468 kB/s | 84 kB 00:00 2026-02-19T08:21:52.168 INFO:teuthology.orchestra.run.trial027.stdout:(4/6): python3-pyparsing-2.4.7-9.el9.noarch.rpm 723 kB/s | 150 kB 00:00 2026-02-19T08:21:52.274 INFO:teuthology.orchestra.run.trial027.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2026-02-19T08:21:52.292 INFO:teuthology.orchestra.run.trial116.stdout:(1/6): python3-configshell-1.1.30-1.el9.noarch. 111 kB/s | 72 kB 00:00 2026-02-19T08:21:52.303 INFO:teuthology.orchestra.run.trial116.stdout:(2/6): nvmetcli-0.8-3.el9.noarch.rpm 66 kB/s | 44 kB 00:00 2026-02-19T08:21:52.423 INFO:teuthology.orchestra.run.trial027.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 2.5 MB/s | 837 kB 00:00 2026-02-19T08:21:52.423 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:21:52.423 INFO:teuthology.orchestra.run.trial027.stdout:Total 2.6 MB/s | 2.3 MB 00:00 2026-02-19T08:21:52.475 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:21:52.482 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:21:52.483 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:21:52.530 INFO:teuthology.orchestra.run.trial116.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 353 kB/s | 84 kB 00:00 2026-02-19T08:21:52.547 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:21:52.547 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:21:52.616 INFO:teuthology.orchestra.run.trial116.stdout:(4/6): python3-pyparsing-2.4.7-9.el9.noarch.rpm 481 kB/s | 150 kB 00:00 2026-02-19T08:21:52.677 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:21:52.685 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2026-02-19T08:21:52.694 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/6 2026-02-19T08:21:52.699 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-02-19T08:21:52.705 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/6 2026-02-19T08:21:52.706 INFO:teuthology.orchestra.run.trial027.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/6 2026-02-19T08:21:52.839 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/6 2026-02-19T08:21:52.842 INFO:teuthology.orchestra.run.trial027.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/6 2026-02-19T08:21:53.120 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/6 2026-02-19T08:21:53.120 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-19T08:21:53.120 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:21:53.372 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/6 2026-02-19T08:21:53.372 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/6 2026-02-19T08:21:53.372 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-02-19T08:21:53.372 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/6 2026-02-19T08:21:53.372 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/6 2026-02-19T08:21:53.425 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2026-02-19T08:21:53.425 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:21:53.425 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:21:53.425 INFO:teuthology.orchestra.run.trial027.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-19T08:21:53.425 INFO:teuthology.orchestra.run.trial027.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-19T08:21:53.425 INFO:teuthology.orchestra.run.trial027.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-19T08:21:53.425 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:21:53.425 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:21:53.455 DEBUG:teuthology.parallel:result is None 2026-02-19T08:21:53.640 INFO:teuthology.orchestra.run.trial116.stdout:(5/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 755 kB/s | 837 kB 00:01 2026-02-19T08:21:54.531 INFO:teuthology.orchestra.run.trial116.stdout:(6/6): nvme-cli-2.16-1.el9.x86_64.rpm 408 kB/s | 1.2 MB 00:02 2026-02-19T08:21:54.533 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:21:54.533 INFO:teuthology.orchestra.run.trial116.stdout:Total 802 kB/s | 2.3 MB 00:02 2026-02-19T08:21:54.589 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:21:54.597 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:21:54.597 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:21:54.662 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:21:54.662 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:21:54.794 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:21:54.802 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/6 2026-02-19T08:21:54.811 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 2/6 2026-02-19T08:21:54.817 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-02-19T08:21:54.823 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/6 2026-02-19T08:21:54.824 INFO:teuthology.orchestra.run.trial116.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/6 2026-02-19T08:21:54.957 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/6 2026-02-19T08:21:54.960 INFO:teuthology.orchestra.run.trial116.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/6 2026-02-19T08:21:55.232 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/6 2026-02-19T08:21:55.232 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-19T08:21:55.232 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:21:55.479 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/6 2026-02-19T08:21:55.479 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/6 2026-02-19T08:21:55.479 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/6 2026-02-19T08:21:55.479 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/6 2026-02-19T08:21:55.479 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/6 2026-02-19T08:21:55.532 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/6 2026-02-19T08:21:55.532 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:21:55.532 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:21:55.532 INFO:teuthology.orchestra.run.trial116.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-19T08:21:55.532 INFO:teuthology.orchestra.run.trial116.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-19T08:21:55.532 INFO:teuthology.orchestra.run.trial116.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-19T08:21:55.533 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:21:55.533 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:21:55.564 DEBUG:teuthology.parallel:result is None 2026-02-19T08:21:55.564 INFO:teuthology.run_tasks:Running task install... 2026-02-19T08:21:55.578 DEBUG:teuthology.task.install:project ceph 2026-02-19T08:21:55.578 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-19T08:21:55.578 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-19T08:21:55.578 INFO:teuthology.task.install:Using flavor: default 2026-02-19T08:21:55.580 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-19T08:21:55.580 INFO:teuthology.task.install:extra packages: [] 2026-02-19T08:21:55.580 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-19T08:21:55.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-19T08:21:55.582 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-19T08:21:55.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-19T08:21:55.733 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-19T08:21:55.733 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-19T08:21:55.744 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-19T08:21:55.744 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-19T08:21:55.872 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-19T08:21:55.873 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:21:55.873 DEBUG:teuthology.orchestra.run.trial027:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-19T08:21:55.887 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-19T08:21:55.887 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:21:55.887 DEBUG:teuthology.orchestra.run.trial116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-19T08:21:55.901 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-19T08:21:55.901 DEBUG:teuthology.orchestra.run.trial027:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-19T08:21:55.913 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-19T08:21:55.913 DEBUG:teuthology.orchestra.run.trial116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-19T08:21:55.966 DEBUG:teuthology.orchestra.run.trial027:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-19T08:21:55.981 DEBUG:teuthology.orchestra.run.trial116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-19T08:21:56.040 DEBUG:teuthology.orchestra.run.trial027:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-19T08:21:56.054 DEBUG:teuthology.orchestra.run.trial116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-19T08:21:56.103 INFO:teuthology.orchestra.run.trial027.stdout:check_obsoletes = 1 2026-02-19T08:21:56.105 DEBUG:teuthology.orchestra.run.trial027:> sudo yum clean all 2026-02-19T08:21:56.118 INFO:teuthology.orchestra.run.trial116.stdout:check_obsoletes = 1 2026-02-19T08:21:56.119 DEBUG:teuthology.orchestra.run.trial116:> sudo yum clean all 2026-02-19T08:21:56.261 INFO:teuthology.orchestra.run.trial027.stdout:41 files removed 2026-02-19T08:21:56.275 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-radosgw 2026-02-19T08:21:56.279 INFO:teuthology.orchestra.run.trial116.stdout:41 files removed 2026-02-19T08:21:56.293 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-radosgw 2026-02-19T08:21:56.694 INFO:teuthology.orchestra.run.trial027.stdout:ceph packages for x86_64 308 kB/s | 86 kB 00:00 2026-02-19T08:21:56.757 INFO:teuthology.orchestra.run.trial116.stdout:ceph packages for x86_64 269 kB/s | 86 kB 00:00 2026-02-19T08:21:57.092 INFO:teuthology.orchestra.run.trial027.stdout:ceph noarch packages 32 kB/s | 12 kB 00:00 2026-02-19T08:21:57.115 INFO:teuthology.orchestra.run.trial116.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2026-02-19T08:21:57.219 INFO:teuthology.orchestra.run.trial027.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-19T08:21:57.243 INFO:teuthology.orchestra.run.trial116.stdout:ceph source packages 17 kB/s | 1.9 kB 00:00 2026-02-19T08:21:57.969 INFO:teuthology.orchestra.run.trial027.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-19T08:22:01.180 INFO:teuthology.orchestra.run.trial116.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.9 MB 00:03 2026-02-19T08:22:01.701 INFO:teuthology.orchestra.run.trial027.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 27 MB 00:03 2026-02-19T08:22:04.531 INFO:teuthology.orchestra.run.trial116.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 27 MB 00:02 2026-02-19T08:22:07.157 INFO:teuthology.orchestra.run.trial116.stdout:CentOS Stream 9 - CRB 31 MB/s | 7.8 MB 00:00 2026-02-19T08:22:07.853 INFO:teuthology.orchestra.run.trial027.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 7.8 MB 00:03 2026-02-19T08:22:08.953 INFO:teuthology.orchestra.run.trial027.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 20 kB 00:00 2026-02-19T08:22:08.980 INFO:teuthology.orchestra.run.trial116.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-19T08:22:09.526 INFO:teuthology.orchestra.run.trial027.stdout:Extra Packages for Enterprise Linux 40 MB/s | 20 MB 00:00 2026-02-19T08:22:09.716 INFO:teuthology.orchestra.run.trial116.stdout:Extra Packages for Enterprise Linux 30 MB/s | 20 MB 00:00 2026-02-19T08:22:12.695 INFO:teuthology.orchestra.run.trial027.stdout:lab-extras 1.4 MB/s | 50 kB 00:00 2026-02-19T08:22:12.956 INFO:teuthology.orchestra.run.trial116.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-19T08:22:13.884 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:13.886 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:13.886 INFO:teuthology.orchestra.run.trial027.stdout: Package Arch Version Repository Size 2026-02-19T08:22:13.886 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:13.886 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:22:13.886 INFO:teuthology.orchestra.run.trial027.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-19T08:22:13.886 INFO:teuthology.orchestra.run.trial027.stdout:Upgrading: 2026-02-19T08:22:13.886 INFO:teuthology.orchestra.run.trial027.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-19T08:22:13.886 INFO:teuthology.orchestra.run.trial027.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-19T08:22:13.886 INFO:teuthology.orchestra.run.trial027.stdout:Installing dependencies: 2026-02-19T08:22:13.886 INFO:teuthology.orchestra.run.trial027.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-19T08:22:13.887 INFO:teuthology.orchestra.run.trial027.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-19T08:22:13.888 INFO:teuthology.orchestra.run.trial027.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout:Installing weak dependencies: 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout:Install 32 Packages 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout:Upgrade 2 Packages 2026-02-19T08:22:13.889 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:13.890 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 62 M 2026-02-19T08:22:13.890 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:22:14.165 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:22:14.166 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:22:14.166 INFO:teuthology.orchestra.run.trial116.stdout: Package Arch Version Repository Size 2026-02-19T08:22:14.166 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:22:14.166 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout:Upgrading: 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout:Installing dependencies: 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout:Installing weak dependencies: 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout:Install 32 Packages 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout:Upgrade 2 Packages 2026-02-19T08:22:14.167 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:14.168 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 62 M 2026-02-19T08:22:14.168 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:22:14.781 INFO:teuthology.orchestra.run.trial027.stdout:(1/34): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-19T08:22:14.821 INFO:teuthology.orchestra.run.trial027.stdout:(2/34): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 624 kB/s | 25 kB 00:00 2026-02-19T08:22:14.882 INFO:teuthology.orchestra.run.trial027.stdout:(3/34): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 16 MB/s | 1.0 MB 00:00 2026-02-19T08:22:14.937 INFO:teuthology.orchestra.run.trial027.stdout:(4/34): libradosstriper1-19.2.3-705.g04cf6dd4.e 8.9 MB/s | 503 kB 00:00 2026-02-19T08:22:15.177 INFO:teuthology.orchestra.run.trial027.stdout:(5/34): ceph-radosgw-19.2.3-705.g04cf6dd4.el9.x 15 MB/s | 11 MB 00:00 2026-02-19T08:22:15.220 INFO:teuthology.orchestra.run.trial027.stdout:(6/34): python3-ceph-argparse-19.2.3-705.g04cf6 1.0 MB/s | 45 kB 00:00 2026-02-19T08:22:15.239 INFO:teuthology.orchestra.run.trial027.stdout:(7/34): librgw2-19.2.3-705.g04cf6dd4.el9.x86_64 18 MB/s | 5.4 MB 00:00 2026-02-19T08:22:15.258 INFO:teuthology.orchestra.run.trial027.stdout:(8/34): python3-ceph-common-19.2.3-705.g04cf6dd 3.9 MB/s | 154 kB 00:00 2026-02-19T08:22:15.271 INFO:teuthology.orchestra.run.trial027.stdout:(9/34): python3-cephfs-19.2.3-705.g04cf6dd4.el9 5.0 MB/s | 165 kB 00:00 2026-02-19T08:22:15.294 INFO:teuthology.orchestra.run.trial027.stdout:(10/34): python3-rados-19.2.3-705.g04cf6dd4.el9 9.0 MB/s | 323 kB 00:00 2026-02-19T08:22:15.313 INFO:teuthology.orchestra.run.trial027.stdout:(11/34): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 7.1 MB/s | 303 kB 00:00 2026-02-19T08:22:15.328 INFO:teuthology.orchestra.run.trial027.stdout:(12/34): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 2.8 MB/s | 100 kB 00:00 2026-02-19T08:22:15.370 INFO:teuthology.orchestra.run.trial027.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 585 kB/s | 33 kB 00:00 2026-02-19T08:22:15.400 INFO:teuthology.orchestra.run.trial027.stdout:(14/34): ceph-common-19.2.3-705.g04cf6dd4.el9.x 23 MB/s | 22 MB 00:00 2026-02-19T08:22:15.420 INFO:teuthology.orchestra.run.trial027.stdout:(15/34): pciutils-3.7.0-7.el9.x86_64.rpm 1.0 MB/s | 93 kB 00:00 2026-02-19T08:22:15.965 INFO:teuthology.orchestra.run.trial027.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 175 kB/s | 104 kB 00:00 2026-02-19T08:22:15.967 INFO:teuthology.orchestra.run.trial027.stdout:(17/34): libnbd-1.20.3-4.el9.x86_64.rpm 289 kB/s | 164 kB 00:00 2026-02-19T08:22:15.987 INFO:teuthology.orchestra.run.trial027.stdout:(18/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 282 kB/s | 160 kB 00:00 2026-02-19T08:22:16.048 INFO:teuthology.orchestra.run.trial027.stdout:(19/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 543 kB/s | 45 kB 00:00 2026-02-19T08:22:16.150 INFO:teuthology.orchestra.run.trial027.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2026-02-19T08:22:16.208 INFO:teuthology.orchestra.run.trial027.stdout:(21/34): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2026-02-19T08:22:16.210 INFO:teuthology.orchestra.run.trial027.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 1.4 MB/s | 240 kB 00:00 2026-02-19T08:22:16.234 INFO:teuthology.orchestra.run.trial027.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 444 kB/s | 37 kB 00:00 2026-02-19T08:22:16.246 INFO:teuthology.orchestra.run.trial027.stdout:(24/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 8.5 MB/s | 308 kB 00:00 2026-02-19T08:22:16.254 INFO:teuthology.orchestra.run.trial027.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 3.0 MB/s | 25 kB 00:00 2026-02-19T08:22:16.261 INFO:teuthology.orchestra.run.trial027.stdout:(26/34): libarrow-9.0.0-15.el9.x86_64.rpm 163 MB/s | 4.4 MB 00:00 2026-02-19T08:22:16.262 INFO:teuthology.orchestra.run.trial027.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 7.8 MB/s | 49 kB 00:00 2026-02-19T08:22:16.265 INFO:teuthology.orchestra.run.trial027.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 18 MB/s | 67 kB 00:00 2026-02-19T08:22:16.267 INFO:teuthology.orchestra.run.trial027.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 152 MB/s | 838 kB 00:00 2026-02-19T08:22:16.270 INFO:teuthology.orchestra.run.trial027.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 50 MB/s | 191 kB 00:00 2026-02-19T08:22:16.274 INFO:teuthology.orchestra.run.trial027.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 223 MB/s | 1.6 MB 00:00 2026-02-19T08:22:16.292 INFO:teuthology.orchestra.run.trial027.stdout:(32/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 795 kB/s | 66 kB 00:00 2026-02-19T08:22:16.755 INFO:teuthology.orchestra.run.trial027.stdout:(33/34): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 6.6 MB/s | 3.2 MB 00:00 2026-02-19T08:22:16.784 INFO:teuthology.orchestra.run.trial027.stdout:(34/34): librados2-19.2.3-705.g04cf6dd4.el9.x86 6.7 MB/s | 3.4 MB 00:00 2026-02-19T08:22:16.788 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:16.788 INFO:teuthology.orchestra.run.trial027.stdout:Total 21 MB/s | 62 MB 00:02 2026-02-19T08:22:16.879 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:22:16.896 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:22:16.896 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:22:17.127 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:22:17.127 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:22:17.413 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:22:17.422 INFO:teuthology.orchestra.run.trial027.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-19T08:22:17.424 INFO:teuthology.orchestra.run.trial027.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-19T08:22:17.436 INFO:teuthology.orchestra.run.trial027.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-19T08:22:17.587 INFO:teuthology.orchestra.run.trial027.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-19T08:22:17.591 INFO:teuthology.orchestra.run.trial027.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-19T08:22:17.619 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-19T08:22:17.661 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/36 2026-02-19T08:22:17.662 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-19T08:22:17.674 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-19T08:22:17.678 INFO:teuthology.orchestra.run.trial027.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-19T08:22:17.687 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/36 2026-02-19T08:22:17.709 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/36 2026-02-19T08:22:17.710 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-19T08:22:17.721 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-19T08:22:17.752 INFO:teuthology.orchestra.run.trial027.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-19T08:22:17.757 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-19T08:22:17.763 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-19T08:22:17.766 INFO:teuthology.orchestra.run.trial027.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-19T08:22:17.769 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-19T08:22:17.773 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-19T08:22:17.916 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-19T08:22:17.917 INFO:teuthology.orchestra.run.trial027.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/36 2026-02-19T08:22:17.943 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/36 2026-02-19T08:22:17.946 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/36 2026-02-19T08:22:17.952 INFO:teuthology.orchestra.run.trial027.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-19T08:22:18.179 INFO:teuthology.orchestra.run.trial027.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-19T08:22:18.180 INFO:teuthology.orchestra.run.trial027.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/36 2026-02-19T08:22:18.195 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/36 2026-02-19T08:22:18.199 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/36 2026-02-19T08:22:18.204 INFO:teuthology.orchestra.run.trial027.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-19T08:22:18.206 INFO:teuthology.orchestra.run.trial027.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-19T08:22:18.207 INFO:teuthology.orchestra.run.trial027.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-19T08:22:18.224 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-19T08:22:18.228 INFO:teuthology.orchestra.run.trial027.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-19T08:22:18.257 INFO:teuthology.orchestra.run.trial027.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-19T08:22:18.259 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 30/36 2026-02-19T08:22:19.241 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-19T08:22:19.243 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-19T08:22:19.528 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-19T08:22:19.531 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/36 2026-02-19T08:22:19.572 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/36 2026-02-19T08:22:19.572 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-19T08:22:19.572 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-19T08:22:19.572 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:19.575 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-19T08:22:22.288 INFO:teuthology.orchestra.run.trial116.stdout:(1/34): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 734 kB/s | 5.5 MB 00:07 2026-02-19T08:22:22.338 INFO:teuthology.orchestra.run.trial116.stdout:(2/34): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 496 kB/s | 25 kB 00:00 2026-02-19T08:22:22.529 INFO:teuthology.orchestra.run.trial116.stdout:(3/34): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 5.1 MB/s | 1.0 MB 00:00 2026-02-19T08:22:22.577 INFO:teuthology.orchestra.run.trial116.stdout:(4/34): libradosstriper1-19.2.3-705.g04cf6dd4.e 10 MB/s | 503 kB 00:00 2026-02-19T08:22:23.127 INFO:teuthology.orchestra.run.trial116.stdout:(5/34): librgw2-19.2.3-705.g04cf6dd4.el9.x86_64 9.8 MB/s | 5.4 MB 00:00 2026-02-19T08:22:23.161 INFO:teuthology.orchestra.run.trial116.stdout:(6/34): python3-ceph-argparse-19.2.3-705.g04cf6 1.3 MB/s | 45 kB 00:00 2026-02-19T08:22:23.198 INFO:teuthology.orchestra.run.trial116.stdout:(7/34): python3-ceph-common-19.2.3-705.g04cf6dd 4.1 MB/s | 154 kB 00:00 2026-02-19T08:22:23.237 INFO:teuthology.orchestra.run.trial116.stdout:(8/34): python3-cephfs-19.2.3-705.g04cf6dd4.el9 4.1 MB/s | 165 kB 00:00 2026-02-19T08:22:23.282 INFO:teuthology.orchestra.run.trial116.stdout:(9/34): python3-rados-19.2.3-705.g04cf6dd4.el9. 7.0 MB/s | 323 kB 00:00 2026-02-19T08:22:23.328 INFO:teuthology.orchestra.run.trial116.stdout:(10/34): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 6.5 MB/s | 303 kB 00:00 2026-02-19T08:22:23.370 INFO:teuthology.orchestra.run.trial116.stdout:(11/34): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 2.3 MB/s | 100 kB 00:00 2026-02-19T08:22:23.444 INFO:teuthology.orchestra.run.trial116.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 453 kB/s | 33 kB 00:00 2026-02-19T08:22:23.487 INFO:teuthology.orchestra.run.trial116.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 2.1 MB/s | 93 kB 00:00 2026-02-19T08:22:23.607 INFO:teuthology.orchestra.run.trial116.stdout:(14/34): ceph-common-19.2.3-705.g04cf6dd4.el9.x 2.4 MB/s | 22 MB 00:08 2026-02-19T08:22:23.608 INFO:teuthology.orchestra.run.trial116.stdout:(15/34): boost-program-options-1.75.0-13.el9.x8 862 kB/s | 104 kB 00:00 2026-02-19T08:22:23.646 INFO:teuthology.orchestra.run.trial116.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.1 MB/s | 160 kB 00:00 2026-02-19T08:22:23.665 INFO:teuthology.orchestra.run.trial116.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.4 MB/s | 45 kB 00:00 2026-02-19T08:22:23.704 INFO:teuthology.orchestra.run.trial116.stdout:(18/34): libnbd-1.20.3-4.el9.x86_64.rpm 1.7 MB/s | 164 kB 00:00 2026-02-19T08:22:23.715 INFO:teuthology.orchestra.run.trial116.stdout:(19/34): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2026-02-19T08:22:23.735 INFO:teuthology.orchestra.run.trial116.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 11 MB/s | 240 kB 00:00 2026-02-19T08:22:23.745 INFO:teuthology.orchestra.run.trial116.stdout:(21/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.9 MB/s | 292 kB 00:00 2026-02-19T08:22:23.753 INFO:teuthology.orchestra.run.trial116.stdout:(22/34): qatlib-service-25.08.0-2.el9.x86_64.rp 2.0 MB/s | 37 kB 00:00 2026-02-19T08:22:23.764 INFO:teuthology.orchestra.run.trial116.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.5 MB/s | 66 kB 00:00 2026-02-19T08:22:24.056 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-19T08:22:24.056 INFO:teuthology.orchestra.run.trial027.stdout:skipping the directory /sys 2026-02-19T08:22:24.056 INFO:teuthology.orchestra.run.trial027.stdout:skipping the directory /proc 2026-02-19T08:22:24.057 INFO:teuthology.orchestra.run.trial027.stdout:skipping the directory /mnt 2026-02-19T08:22:24.057 INFO:teuthology.orchestra.run.trial027.stdout:skipping the directory /var/tmp 2026-02-19T08:22:24.057 INFO:teuthology.orchestra.run.trial027.stdout:skipping the directory /home 2026-02-19T08:22:24.057 INFO:teuthology.orchestra.run.trial027.stdout:skipping the directory /root 2026-02-19T08:22:24.057 INFO:teuthology.orchestra.run.trial027.stdout:skipping the directory /tmp 2026-02-19T08:22:24.057 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:24.300 INFO:teuthology.orchestra.run.trial116.stdout:(24/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 563 kB/s | 308 kB 00:00 2026-02-19T08:22:24.370 INFO:teuthology.orchestra.run.trial116.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 353 kB/s | 25 kB 00:00 2026-02-19T08:22:24.444 INFO:teuthology.orchestra.run.trial116.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 659 kB/s | 49 kB 00:00 2026-02-19T08:22:24.512 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/36 2026-02-19T08:22:24.522 INFO:teuthology.orchestra.run.trial116.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 865 kB/s | 67 kB 00:00 2026-02-19T08:22:24.535 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/36 2026-02-19T08:22:24.536 INFO:teuthology.orchestra.run.trial027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:24.536 INFO:teuthology.orchestra.run.trial027.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-19T08:22:24.536 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-19T08:22:24.536 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-19T08:22:24.536 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:24.538 INFO:teuthology.orchestra.run.trial027.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-19T08:22:24.551 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-19T08:22:24.551 INFO:teuthology.orchestra.run.trial027.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-19T08:22:24.605 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-19T08:22:24.605 INFO:teuthology.orchestra.run.trial027.stdout:Creating group 'qat' with GID 992. 2026-02-19T08:22:24.606 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:24.612 INFO:teuthology.orchestra.run.trial116.stdout:(28/34): libarrow-9.0.0-15.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2026-02-19T08:22:24.683 INFO:teuthology.orchestra.run.trial116.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 2.7 MB/s | 191 kB 00:00 2026-02-19T08:22:24.734 INFO:teuthology.orchestra.run.trial116.stdout:(30/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2026-02-19T08:22:24.782 INFO:teuthology.orchestra.run.trial116.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2026-02-19T08:22:24.887 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/36 2026-02-19T08:22:24.887 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/36 2026-02-19T08:22:24.887 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/36 2026-02-19T08:22:24.887 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-19T08:22:24.888 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-19T08:22:24.889 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-19T08:22:24.890 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-19T08:22:24.890 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-19T08:22:24.890 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-19T08:22:24.890 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-19T08:22:24.890 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-19T08:22:24.890 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/36 2026-02-19T08:22:24.946 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-19T08:22:24.946 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:24.947 INFO:teuthology.orchestra.run.trial027.stdout:Upgraded: 2026-02-19T08:22:24.947 INFO:teuthology.orchestra.run.trial027.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.947 INFO:teuthology.orchestra.run.trial027.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.947 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:22:24.947 INFO:teuthology.orchestra.run.trial027.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-19T08:22:24.947 INFO:teuthology.orchestra.run.trial027.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.947 INFO:teuthology.orchestra.run.trial027.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.947 INFO:teuthology.orchestra.run.trial027.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.947 INFO:teuthology.orchestra.run.trial027.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.947 INFO:teuthology.orchestra.run.trial027.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-19T08:22:24.948 INFO:teuthology.orchestra.run.trial027.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-19T08:22:24.949 INFO:teuthology.orchestra.run.trial027.stdout: re2-1:20211101-20.el9.x86_64 2026-02-19T08:22:24.950 INFO:teuthology.orchestra.run.trial027.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-19T08:22:24.950 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:24.950 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:24.988 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-test 2026-02-19T08:22:25.297 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:13 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:25.349 INFO:teuthology.orchestra.run.trial116.stdout:(32/34): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 5.6 MB/s | 3.2 MB 00:00 2026-02-19T08:22:25.378 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:25.378 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:25.379 INFO:teuthology.orchestra.run.trial027.stdout: Package Arch Version Repository Size 2026-02-19T08:22:25.379 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:25.379 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:22:25.379 INFO:teuthology.orchestra.run.trial027.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-19T08:22:25.379 INFO:teuthology.orchestra.run.trial027.stdout:Installing dependencies: 2026-02-19T08:22:25.379 INFO:teuthology.orchestra.run.trial027.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-19T08:22:25.379 INFO:teuthology.orchestra.run.trial027.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-19T08:22:25.379 INFO:teuthology.orchestra.run.trial027.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-19T08:22:25.379 INFO:teuthology.orchestra.run.trial027.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-19T08:22:25.379 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:25.380 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:22:25.380 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:25.380 INFO:teuthology.orchestra.run.trial027.stdout:Install 5 Packages 2026-02-19T08:22:25.380 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:25.380 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 50 M 2026-02-19T08:22:25.381 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 212 M 2026-02-19T08:22:25.381 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:22:25.550 INFO:teuthology.orchestra.run.trial027.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 2.1 MB/s | 233 kB 00:00 2026-02-19T08:22:25.587 INFO:teuthology.orchestra.run.trial027.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 8.0 MB/s | 303 kB 00:00 2026-02-19T08:22:25.604 INFO:teuthology.orchestra.run.trial027.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 3.6 MB/s | 64 kB 00:00 2026-02-19T08:22:25.713 INFO:teuthology.orchestra.run.trial116.stdout:(33/34): librados2-19.2.3-705.g04cf6dd4.el9.x86 3.5 MB/s | 3.4 MB 00:00 2026-02-19T08:22:25.817 INFO:teuthology.orchestra.run.trial027.stdout:(4/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 435 kB/s | 163 kB 00:00 2026-02-19T08:22:27.936 INFO:teuthology.orchestra.run.trial116.stdout:(34/34): ceph-radosgw-19.2.3-705.g04cf6dd4.el9. 825 kB/s | 11 MB 00:13 2026-02-19T08:22:27.939 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:27.939 INFO:teuthology.orchestra.run.trial116.stdout:Total 4.5 MB/s | 62 MB 00:13 2026-02-19T08:22:28.026 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:22:28.043 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:22:28.043 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:22:28.273 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:22:28.274 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:22:28.562 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:22:28.571 INFO:teuthology.orchestra.run.trial116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-19T08:22:28.573 INFO:teuthology.orchestra.run.trial116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-19T08:22:28.585 INFO:teuthology.orchestra.run.trial116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-19T08:22:28.733 INFO:teuthology.orchestra.run.trial116.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-19T08:22:28.738 INFO:teuthology.orchestra.run.trial116.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-19T08:22:28.768 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-19T08:22:28.812 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/36 2026-02-19T08:22:28.813 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-19T08:22:28.814 INFO:teuthology.orchestra.run.trial027.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 15 MB/s | 50 MB 00:03 2026-02-19T08:22:28.815 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:28.815 INFO:teuthology.orchestra.run.trial027.stdout:Total 15 MB/s | 50 MB 00:03 2026-02-19T08:22:28.825 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-19T08:22:28.829 INFO:teuthology.orchestra.run.trial116.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-19T08:22:28.838 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/36 2026-02-19T08:22:28.841 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:22:28.850 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:22:28.850 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:22:28.860 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/36 2026-02-19T08:22:28.861 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-19T08:22:28.875 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-19T08:22:28.909 INFO:teuthology.orchestra.run.trial116.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-19T08:22:28.912 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-19T08:22:28.920 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-19T08:22:28.922 INFO:teuthology.orchestra.run.trial116.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-19T08:22:28.925 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-19T08:22:28.930 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-19T08:22:29.039 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:22:29.039 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:22:29.069 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-19T08:22:29.070 INFO:teuthology.orchestra.run.trial116.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/36 2026-02-19T08:22:29.096 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/36 2026-02-19T08:22:29.101 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/36 2026-02-19T08:22:29.107 INFO:teuthology.orchestra.run.trial116.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-19T08:22:29.251 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:22:29.257 INFO:teuthology.orchestra.run.trial027.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-19T08:22:29.261 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-19T08:22:29.269 INFO:teuthology.orchestra.run.trial027.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-19T08:22:29.269 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-19T08:22:29.332 INFO:teuthology.orchestra.run.trial116.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-19T08:22:29.333 INFO:teuthology.orchestra.run.trial116.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/36 2026-02-19T08:22:29.349 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/36 2026-02-19T08:22:29.353 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/36 2026-02-19T08:22:29.358 INFO:teuthology.orchestra.run.trial116.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-19T08:22:29.360 INFO:teuthology.orchestra.run.trial116.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-19T08:22:29.361 INFO:teuthology.orchestra.run.trial116.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-19T08:22:29.379 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-19T08:22:29.382 INFO:teuthology.orchestra.run.trial116.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-19T08:22:29.411 INFO:teuthology.orchestra.run.trial116.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-19T08:22:29.413 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 30/36 2026-02-19T08:22:30.399 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-19T08:22:30.401 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-19T08:22:30.684 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-19T08:22:30.687 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/36 2026-02-19T08:22:30.730 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/36 2026-02-19T08:22:30.730 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-19T08:22:30.731 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-19T08:22:30.731 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:30.734 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-19T08:22:31.526 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-19T08:22:31.544 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-19T08:22:31.781 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-19T08:22:31.781 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-19T08:22:31.782 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-19T08:22:31.782 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-19T08:22:31.782 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-19T08:22:31.834 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-19T08:22:31.834 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:31.834 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:22:31.834 INFO:teuthology.orchestra.run.trial027.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:31.834 INFO:teuthology.orchestra.run.trial027.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:31.834 INFO:teuthology.orchestra.run.trial027.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-19T08:22:31.835 INFO:teuthology.orchestra.run.trial027.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-19T08:22:31.835 INFO:teuthology.orchestra.run.trial027.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-19T08:22:31.835 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:31.835 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:31.867 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph 2026-02-19T08:22:32.169 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:20 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:32.255 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:32.258 INFO:teuthology.orchestra.run.trial027.stdout:====================================================================================== 2026-02-19T08:22:32.258 INFO:teuthology.orchestra.run.trial027.stdout: Package Arch Version Repository Size 2026-02-19T08:22:32.258 INFO:teuthology.orchestra.run.trial027.stdout:====================================================================================== 2026-02-19T08:22:32.258 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:22:32.258 INFO:teuthology.orchestra.run.trial027.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-19T08:22:32.258 INFO:teuthology.orchestra.run.trial027.stdout:Installing dependencies: 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-19T08:22:32.259 INFO:teuthology.orchestra.run.trial027.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-19T08:22:32.260 INFO:teuthology.orchestra.run.trial027.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-19T08:22:32.261 INFO:teuthology.orchestra.run.trial027.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-19T08:22:32.262 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-19T08:22:32.263 INFO:teuthology.orchestra.run.trial027.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-19T08:22:32.264 INFO:teuthology.orchestra.run.trial027.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-19T08:22:32.265 INFO:teuthology.orchestra.run.trial027.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout:Installing weak dependencies: 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-19T08:22:32.266 INFO:teuthology.orchestra.run.trial027.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-19T08:22:32.267 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:32.267 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:22:32.267 INFO:teuthology.orchestra.run.trial027.stdout:====================================================================================== 2026-02-19T08:22:32.267 INFO:teuthology.orchestra.run.trial027.stdout:Install 98 Packages 2026-02-19T08:22:32.267 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:32.268 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 95 M 2026-02-19T08:22:32.268 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 519 M 2026-02-19T08:22:32.268 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:22:32.795 INFO:teuthology.orchestra.run.trial027.stdout:(1/98): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 126 kB/s | 6.5 kB 00:00 2026-02-19T08:22:32.887 INFO:teuthology.orchestra.run.trial027.stdout:(2/98): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 7.5 MB/s | 1.1 MB 00:00 2026-02-19T08:22:32.914 INFO:teuthology.orchestra.run.trial027.stdout:(3/98): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-19T08:22:32.946 INFO:teuthology.orchestra.run.trial027.stdout:(4/98): ceph-grafana-dashboards-19.2.3-705.g04c 988 kB/s | 31 kB 00:00 2026-02-19T08:22:32.980 INFO:teuthology.orchestra.run.trial027.stdout:(5/98): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 4.3 MB/s | 150 kB 00:00 2026-02-19T08:22:33.060 INFO:teuthology.orchestra.run.trial027.stdout:(6/98): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 18 MB/s | 4.7 MB 00:00 2026-02-19T08:22:33.149 INFO:teuthology.orchestra.run.trial027.stdout:(7/98): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 23 MB/s | 3.8 MB 00:00 2026-02-19T08:22:33.195 INFO:teuthology.orchestra.run.trial027.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 480 kB/s | 22 kB 00:00 2026-02-19T08:22:33.248 INFO:teuthology.orchestra.run.trial027.stdout:(9/98): ceph-mgr-modules-core-19.2.3-705.g04cf6 4.7 MB/s | 253 kB 00:00 2026-02-19T08:22:33.300 INFO:teuthology.orchestra.run.trial027.stdout:(10/98): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 960 kB/s | 49 kB 00:00 2026-02-19T08:22:33.352 INFO:teuthology.orchestra.run.trial027.stdout:(11/98): ceph-prometheus-alerts-19.2.3-705.g04c 320 kB/s | 17 kB 00:00 2026-02-19T08:22:33.412 INFO:teuthology.orchestra.run.trial027.stdout:(12/98): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 4.8 MB/s | 299 kB 00:00 2026-02-19T08:22:33.447 INFO:teuthology.orchestra.run.trial027.stdout:(13/98): ceph-mgr-diskprediction-local-19.2.3-7 19 MB/s | 7.4 MB 00:00 2026-02-19T08:22:33.467 INFO:teuthology.orchestra.run.trial027.stdout:(14/98): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 14 MB/s | 769 kB 00:00 2026-02-19T08:22:33.594 INFO:teuthology.orchestra.run.trial027.stdout:(15/98): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 24 MB/s | 17 MB 00:00 2026-02-19T08:22:33.914 INFO:teuthology.orchestra.run.trial027.stdout:(16/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 90 kB/s | 40 kB 00:00 2026-02-19T08:22:34.103 INFO:teuthology.orchestra.run.trial027.stdout:(17/98): libconfig-1.7.2-9.el9.x86_64.rpm 142 kB/s | 72 kB 00:00 2026-02-19T08:22:34.362 INFO:teuthology.orchestra.run.trial027.stdout:(18/98): libquadmath-11.5.0-14.el9.x86_64.rpm 712 kB/s | 184 kB 00:00 2026-02-19T08:22:34.702 INFO:teuthology.orchestra.run.trial027.stdout:(19/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 745 kB/s | 253 kB 00:00 2026-02-19T08:22:34.912 INFO:teuthology.orchestra.run.trial027.stdout:(20/98): cryptsetup-2.8.1-3.el9.x86_64.rpm 240 kB/s | 351 kB 00:01 2026-02-19T08:22:34.914 INFO:teuthology.orchestra.run.trial027.stdout:(21/98): libgfortran-11.5.0-14.el9.x86_64.rpm 795 kB/s | 794 kB 00:00 2026-02-19T08:22:35.091 INFO:teuthology.orchestra.run.trial027.stdout:(22/98): python3-pycparser-2.20-6.el9.noarch.rp 762 kB/s | 135 kB 00:00 2026-02-19T08:22:35.233 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-19T08:22:35.233 INFO:teuthology.orchestra.run.trial116.stdout:skipping the directory /sys 2026-02-19T08:22:35.233 INFO:teuthology.orchestra.run.trial116.stdout:skipping the directory /proc 2026-02-19T08:22:35.233 INFO:teuthology.orchestra.run.trial116.stdout:skipping the directory /mnt 2026-02-19T08:22:35.233 INFO:teuthology.orchestra.run.trial116.stdout:skipping the directory /var/tmp 2026-02-19T08:22:35.233 INFO:teuthology.orchestra.run.trial116.stdout:skipping the directory /home 2026-02-19T08:22:35.234 INFO:teuthology.orchestra.run.trial116.stdout:skipping the directory /root 2026-02-19T08:22:35.234 INFO:teuthology.orchestra.run.trial116.stdout:skipping the directory /tmp 2026-02-19T08:22:35.234 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:35.248 INFO:teuthology.orchestra.run.trial027.stdout:(23/98): python3-ply-3.11-14.el9.noarch.rpm 317 kB/s | 106 kB 00:00 2026-02-19T08:22:35.269 INFO:teuthology.orchestra.run.trial027.stdout:(24/98): python3-requests-2.25.1-10.el9.noarch. 711 kB/s | 126 kB 00:00 2026-02-19T08:22:35.524 INFO:teuthology.orchestra.run.trial027.stdout:(25/98): unzip-6.0-59.el9.x86_64.rpm 714 kB/s | 182 kB 00:00 2026-02-19T08:22:35.690 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/36 2026-02-19T08:22:35.714 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/36 2026-02-19T08:22:35.714 INFO:teuthology.orchestra.run.trial116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:35.714 INFO:teuthology.orchestra.run.trial116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-19T08:22:35.714 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-19T08:22:35.714 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-19T08:22:35.714 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:35.716 INFO:teuthology.orchestra.run.trial116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-19T08:22:35.729 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-19T08:22:35.729 INFO:teuthology.orchestra.run.trial116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-19T08:22:35.741 INFO:teuthology.orchestra.run.trial027.stdout:(26/98): python3-urllib3-1.26.5-7.el9.noarch.rp 442 kB/s | 218 kB 00:00 2026-02-19T08:22:35.766 INFO:teuthology.orchestra.run.trial027.stdout:(27/98): flexiblas-3.0.4-9.el9.x86_64.rpm 1.1 MB/s | 30 kB 00:00 2026-02-19T08:22:35.785 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-19T08:22:35.785 INFO:teuthology.orchestra.run.trial116.stdout:Creating group 'qat' with GID 992. 2026-02-19T08:22:35.785 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:35.823 INFO:teuthology.orchestra.run.trial027.stdout:(28/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 53 MB/s | 3.0 MB 00:00 2026-02-19T08:22:35.831 INFO:teuthology.orchestra.run.trial027.stdout:(29/98): flexiblas-openblas-openmp-3.0.4-9.el9. 1.8 MB/s | 15 kB 00:00 2026-02-19T08:22:35.841 INFO:teuthology.orchestra.run.trial027.stdout:(30/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 24 MB/s | 246 kB 00:00 2026-02-19T08:22:35.852 INFO:teuthology.orchestra.run.trial027.stdout:(31/98): lua-5.4.4-4.el9.x86_64.rpm 18 MB/s | 188 kB 00:00 2026-02-19T08:22:35.856 INFO:teuthology.orchestra.run.trial027.stdout:(32/98): zip-3.0-35.el9.x86_64.rpm 798 kB/s | 266 kB 00:00 2026-02-19T08:22:35.860 INFO:teuthology.orchestra.run.trial027.stdout:(33/98): openblas-0.3.29-1.el9.x86_64.rpm 4.9 MB/s | 42 kB 00:00 2026-02-19T08:22:35.872 INFO:teuthology.orchestra.run.trial027.stdout:(34/98): protobuf-3.14.0-17.el9.x86_64.rpm 86 MB/s | 1.0 MB 00:00 2026-02-19T08:22:35.902 INFO:teuthology.orchestra.run.trial027.stdout:(35/98): python3-babel-2.9.1-2.el9.noarch.rpm 199 MB/s | 6.0 MB 00:00 2026-02-19T08:22:35.914 INFO:teuthology.orchestra.run.trial027.stdout:(36/98): python3-devel-3.9.25-3.el9.x86_64.rpm 21 MB/s | 244 kB 00:00 2026-02-19T08:22:35.925 INFO:teuthology.orchestra.run.trial027.stdout:(37/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 22 MB/s | 249 kB 00:00 2026-02-19T08:22:35.936 INFO:teuthology.orchestra.run.trial027.stdout:(38/98): python3-libstoragemgmt-1.10.1-1.el9.x8 16 MB/s | 177 kB 00:00 2026-02-19T08:22:35.944 INFO:teuthology.orchestra.run.trial027.stdout:(39/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 61 MB/s | 5.3 MB 00:00 2026-02-19T08:22:35.950 INFO:teuthology.orchestra.run.trial027.stdout:(40/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 87 MB/s | 1.2 MB 00:00 2026-02-19T08:22:35.955 INFO:teuthology.orchestra.run.trial027.stdout:(41/98): python3-mako-1.1.4-6.el9.noarch.rpm 15 MB/s | 172 kB 00:00 2026-02-19T08:22:35.959 INFO:teuthology.orchestra.run.trial027.stdout:(42/98): python3-markupsafe-1.1.1-12.el9.x86_64 3.6 MB/s | 35 kB 00:00 2026-02-19T08:22:35.971 INFO:teuthology.orchestra.run.trial027.stdout:(43/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 36 MB/s | 442 kB 00:00 2026-02-19T08:22:35.981 INFO:teuthology.orchestra.run.trial027.stdout:(44/98): python3-packaging-20.9-5.el9.noarch.rp 7.7 MB/s | 77 kB 00:00 2026-02-19T08:22:35.988 INFO:teuthology.orchestra.run.trial027.stdout:(45/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 186 MB/s | 6.1 MB 00:00 2026-02-19T08:22:35.991 INFO:teuthology.orchestra.run.trial027.stdout:(46/98): python3-protobuf-3.14.0-17.el9.noarch. 26 MB/s | 267 kB 00:00 2026-02-19T08:22:35.999 INFO:teuthology.orchestra.run.trial027.stdout:(47/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 14 MB/s | 159 kB 00:00 2026-02-19T08:22:36.003 INFO:teuthology.orchestra.run.trial027.stdout:(48/98): python3-pyasn1-modules-0.4.8-6.el9.noa 24 MB/s | 279 kB 00:00 2026-02-19T08:22:36.009 INFO:teuthology.orchestra.run.trial027.stdout:(49/98): python3-requests-oauthlib-1.3.0-12.el9 5.4 MB/s | 54 kB 00:00 2026-02-19T08:22:36.018 INFO:teuthology.orchestra.run.trial027.stdout:(50/98): python3-toml-0.10.2-6.el9.noarch.rpm 4.5 MB/s | 42 kB 00:00 2026-02-19T08:22:36.028 INFO:teuthology.orchestra.run.trial027.stdout:(51/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 19 MB/s | 189 kB 00:00 2026-02-19T08:22:36.038 INFO:teuthology.orchestra.run.trial027.stdout:(52/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 9.4 MB/s | 90 kB 00:00 2026-02-19T08:22:36.055 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/36 2026-02-19T08:22:36.055 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/36 2026-02-19T08:22:36.055 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/36 2026-02-19T08:22:36.055 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/36 2026-02-19T08:22:36.055 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-19T08:22:36.055 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/36 2026-02-19T08:22:36.055 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-19T08:22:36.056 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-19T08:22:36.057 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-19T08:22:36.058 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-19T08:22:36.058 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-19T08:22:36.058 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/36 2026-02-19T08:22:36.095 INFO:teuthology.orchestra.run.trial027.stdout:(53/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 208 MB/s | 19 MB 00:00 2026-02-19T08:22:36.116 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-19T08:22:36.116 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:36.116 INFO:teuthology.orchestra.run.trial116.stdout:Upgraded: 2026-02-19T08:22:36.116 INFO:teuthology.orchestra.run.trial116.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.116 INFO:teuthology.orchestra.run.trial116.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.116 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:22:36.116 INFO:teuthology.orchestra.run.trial116.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-19T08:22:36.116 INFO:teuthology.orchestra.run.trial116.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.116 INFO:teuthology.orchestra.run.trial116.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-19T08:22:36.117 INFO:teuthology.orchestra.run.trial116.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-19T08:22:36.118 INFO:teuthology.orchestra.run.trial116.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-19T08:22:36.119 INFO:teuthology.orchestra.run.trial116.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-19T08:22:36.119 INFO:teuthology.orchestra.run.trial116.stdout: re2-1:20211101-20.el9.x86_64 2026-02-19T08:22:36.119 INFO:teuthology.orchestra.run.trial116.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-19T08:22:36.119 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:36.119 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:22:36.125 INFO:teuthology.orchestra.run.trial027.stdout:(54/98): lua-devel-5.4.4-4.el9.x86_64.rpm 254 kB/s | 22 kB 00:00 2026-02-19T08:22:36.159 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-test 2026-02-19T08:22:36.164 INFO:teuthology.orchestra.run.trial027.stdout:(55/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 14 MB/s | 551 kB 00:00 2026-02-19T08:22:36.168 INFO:teuthology.orchestra.run.trial027.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 5.5 MB/s | 19 kB 00:00 2026-02-19T08:22:36.183 INFO:teuthology.orchestra.run.trial027.stdout:(57/98): luarocks-3.9.2-5.el9.noarch.rpm 9.7 MB/s | 151 kB 00:00 2026-02-19T08:22:36.191 INFO:teuthology.orchestra.run.trial027.stdout:(58/98): python3-asyncssh-2.13.2-5.el9.noarch.r 71 MB/s | 548 kB 00:00 2026-02-19T08:22:36.212 INFO:teuthology.orchestra.run.trial027.stdout:(59/98): python3-autocommand-2.2.2-8.el9.noarch 1.4 MB/s | 29 kB 00:00 2026-02-19T08:22:36.228 INFO:teuthology.orchestra.run.trial027.stdout:(60/98): python3-backports-tarfile-1.2.0-1.el9. 3.8 MB/s | 60 kB 00:00 2026-02-19T08:22:36.231 INFO:teuthology.orchestra.run.trial027.stdout:(61/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 12 MB/s | 43 kB 00:00 2026-02-19T08:22:36.234 INFO:teuthology.orchestra.run.trial027.stdout:(62/98): python3-cryptography-36.0.1-5.el9.x86_ 833 kB/s | 1.2 MB 00:01 2026-02-19T08:22:36.235 INFO:teuthology.orchestra.run.trial027.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 9.5 MB/s | 32 kB 00:00 2026-02-19T08:22:36.237 INFO:teuthology.orchestra.run.trial027.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 4.1 MB/s | 14 kB 00:00 2026-02-19T08:22:36.255 INFO:teuthology.orchestra.run.trial027.stdout:(65/98): python3-cheroot-10.0.1-4.el9.noarch.rp 8.5 MB/s | 173 kB 00:00 2026-02-19T08:22:36.294 INFO:teuthology.orchestra.run.trial027.stdout:(66/98): python3-cherrypy-18.6.1-2.el9.noarch.r 6.2 MB/s | 358 kB 00:00 2026-02-19T08:22:36.294 INFO:teuthology.orchestra.run.trial027.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 6.2 MB/s | 254 kB 00:00 2026-02-19T08:22:36.306 INFO:teuthology.orchestra.run.trial027.stdout:(68/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 173 MB/s | 2.0 MB 00:00 2026-02-19T08:22:36.306 INFO:teuthology.orchestra.run.trial027.stdout:(69/98): python3-grpcio-tools-1.46.7-10.el9.x86 12 MB/s | 144 kB 00:00 2026-02-19T08:22:36.310 INFO:teuthology.orchestra.run.trial027.stdout:(70/98): python3-influxdb-5.3.1-1.el9.noarch.rp 36 MB/s | 139 kB 00:00 2026-02-19T08:22:36.311 INFO:teuthology.orchestra.run.trial027.stdout:(71/98): python3-isodate-0.6.1-3.el9.noarch.rpm 13 MB/s | 56 kB 00:00 2026-02-19T08:22:36.318 INFO:teuthology.orchestra.run.trial027.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 1.3 MB/s | 11 kB 00:00 2026-02-19T08:22:36.319 INFO:teuthology.orchestra.run.trial027.stdout:(73/98): python3-jaraco-classes-3.2.1-5.el9.noa 2.1 MB/s | 18 kB 00:00 2026-02-19T08:22:36.322 INFO:teuthology.orchestra.run.trial027.stdout:(74/98): python3-jaraco-collections-3.0.0-8.el9 6.3 MB/s | 23 kB 00:00 2026-02-19T08:22:36.336 INFO:teuthology.orchestra.run.trial027.stdout:(75/98): python3-jaraco-context-6.0.1-3.el9.noa 1.1 MB/s | 20 kB 00:00 2026-02-19T08:22:36.351 INFO:teuthology.orchestra.run.trial027.stdout:(76/98): python3-jaraco-functools-3.5.0-2.el9.n 679 kB/s | 19 kB 00:00 2026-02-19T08:22:36.411 INFO:teuthology.orchestra.run.trial027.stdout:(77/98): python3-jaraco-text-4.0.0-2.el9.noarch 353 kB/s | 26 kB 00:00 2026-02-19T08:22:36.414 INFO:teuthology.orchestra.run.trial027.stdout:(78/98): python3-kubernetes-26.1.0-3.el9.noarch 16 MB/s | 1.0 MB 00:00 2026-02-19T08:22:36.434 INFO:teuthology.orchestra.run.trial027.stdout:(79/98): python3-logutils-0.3.5-21.el9.noarch.r 2.1 MB/s | 46 kB 00:00 2026-02-19T08:22:36.454 INFO:teuthology.orchestra.run.trial027.stdout:(80/98): python3-more-itertools-8.12.0-2.el9.no 1.9 MB/s | 79 kB 00:00 2026-02-19T08:22:36.456 INFO:teuthology.orchestra.run.trial027.stdout:(81/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.8 MB/s | 86 kB 00:00 2026-02-19T08:22:36.457 INFO:teuthology.orchestra.run.trial027.stdout:(82/98): python3-natsort-7.1.1-5.el9.noarch.rpm 17 MB/s | 58 kB 00:00 2026-02-19T08:22:36.460 INFO:teuthology.orchestra.run.trial027.stdout:(83/98): python3-pecan-1.4.2-3.el9.noarch.rpm 66 MB/s | 272 kB 00:00 2026-02-19T08:22:36.466 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:24 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:36.484 INFO:teuthology.orchestra.run.trial027.stdout:(84/98): python3-portend-3.1.0-2.el9.noarch.rpm 612 kB/s | 16 kB 00:00 2026-02-19T08:22:36.485 INFO:teuthology.orchestra.run.trial027.stdout:(85/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2026-02-19T08:22:36.488 INFO:teuthology.orchestra.run.trial027.stdout:(86/98): python3-repoze-lru-0.7-16.el9.noarch.r 9.1 MB/s | 31 kB 00:00 2026-02-19T08:22:36.489 INFO:teuthology.orchestra.run.trial027.stdout:(87/98): python3-routes-2.5.1-5.el9.noarch.rpm 49 MB/s | 188 kB 00:00 2026-02-19T08:22:36.491 INFO:teuthology.orchestra.run.trial027.stdout:(88/98): python3-rsa-4.9-2.el9.noarch.rpm 17 MB/s | 59 kB 00:00 2026-02-19T08:22:36.493 INFO:teuthology.orchestra.run.trial027.stdout:(89/98): python3-saml-1.16.0-1.el9.noarch.rpm 34 MB/s | 125 kB 00:00 2026-02-19T08:22:36.509 INFO:teuthology.orchestra.run.trial027.stdout:(90/98): python3-tempora-5.0.0-2.el9.noarch.rpm 1.9 MB/s | 36 kB 00:00 2026-02-19T08:22:36.510 INFO:teuthology.orchestra.run.trial027.stdout:(91/98): python3-typing-extensions-4.15.0-1.el9 5.0 MB/s | 86 kB 00:00 2026-02-19T08:22:36.514 INFO:teuthology.orchestra.run.trial027.stdout:(92/98): python3-webob-1.8.8-2.el9.noarch.rpm 55 MB/s | 230 kB 00:00 2026-02-19T08:22:36.514 INFO:teuthology.orchestra.run.trial027.stdout:(93/98): python3-websocket-client-1.2.3-2.el9.n 20 MB/s | 90 kB 00:00 2026-02-19T08:22:36.519 INFO:teuthology.orchestra.run.trial027.stdout:(94/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 89 MB/s | 427 kB 00:00 2026-02-19T08:22:36.519 INFO:teuthology.orchestra.run.trial027.stdout:(95/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 9.7 MB/s | 48 kB 00:00 2026-02-19T08:22:36.523 INFO:teuthology.orchestra.run.trial027.stdout:(96/98): python3-xmltodict-0.12.0-15.el9.noarch 6.5 MB/s | 22 kB 00:00 2026-02-19T08:22:36.532 INFO:teuthology.orchestra.run.trial027.stdout:(97/98): python3-zc-lockfile-2.0-10.el9.noarch. 1.6 MB/s | 20 kB 00:00 2026-02-19T08:22:36.548 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout: Package Arch Version Repository Size 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout:Installing dependencies: 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-19T08:22:36.549 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:36.550 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:22:36.550 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:22:36.550 INFO:teuthology.orchestra.run.trial116.stdout:Install 5 Packages 2026-02-19T08:22:36.550 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:36.550 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 50 M 2026-02-19T08:22:36.551 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 212 M 2026-02-19T08:22:36.551 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:22:36.686 INFO:teuthology.orchestra.run.trial116.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.7 MB/s | 233 kB 00:00 2026-02-19T08:22:36.709 INFO:teuthology.orchestra.run.trial116.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 13 MB/s | 303 kB 00:00 2026-02-19T08:22:36.732 INFO:teuthology.orchestra.run.trial116.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.7 MB/s | 64 kB 00:00 2026-02-19T08:22:36.860 INFO:teuthology.orchestra.run.trial116.stdout:(4/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 729 kB/s | 163 kB 00:00 2026-02-19T08:22:37.118 INFO:teuthology.orchestra.run.trial027.stdout:(98/98): protobuf-compiler-3.14.0-17.el9.x86_64 842 kB/s | 862 kB 00:01 2026-02-19T08:22:37.123 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:37.123 INFO:teuthology.orchestra.run.trial027.stdout:Total 20 MB/s | 95 MB 00:04 2026-02-19T08:22:37.532 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:22:37.571 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:22:37.571 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:22:37.985 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:22:37.985 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:22:38.442 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:22:38.444 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-19T08:22:38.475 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-19T08:22:38.480 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-19T08:22:38.502 INFO:teuthology.orchestra.run.trial027.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-19T08:22:38.512 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-19T08:22:38.518 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-19T08:22:38.551 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-19T08:22:38.560 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-19T08:22:38.566 INFO:teuthology.orchestra.run.trial027.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-19T08:22:38.568 INFO:teuthology.orchestra.run.trial027.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-19T08:22:38.572 INFO:teuthology.orchestra.run.trial027.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-19T08:22:38.596 INFO:teuthology.orchestra.run.trial027.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-19T08:22:38.608 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-19T08:22:38.612 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-19T08:22:38.618 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-19T08:22:38.619 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-19T08:22:38.630 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-19T08:22:38.637 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-19T08:22:38.661 INFO:teuthology.orchestra.run.trial027.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-19T08:22:38.664 INFO:teuthology.orchestra.run.trial027.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-19T08:22:38.671 INFO:teuthology.orchestra.run.trial027.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-19T08:22:38.696 INFO:teuthology.orchestra.run.trial027.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-19T08:22:38.747 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-19T08:22:38.760 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-19T08:22:38.762 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-19T08:22:38.767 INFO:teuthology.orchestra.run.trial027.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-19T08:22:38.772 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-19T08:22:38.777 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-19T08:22:38.780 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-19T08:22:38.794 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-19T08:22:38.815 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-19T08:22:38.820 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-19T08:22:38.825 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-19T08:22:38.836 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-19T08:22:38.845 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-19T08:22:38.851 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-19T08:22:38.871 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-19T08:22:38.880 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-19T08:22:38.935 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-19T08:22:38.947 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-19T08:22:38.963 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-19T08:22:38.967 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-19T08:22:38.975 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-19T08:22:39.015 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-19T08:22:39.340 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-19T08:22:39.350 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-19T08:22:39.354 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-19T08:22:39.360 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-19T08:22:39.362 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-19T08:22:39.390 INFO:teuthology.orchestra.run.trial027.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-19T08:22:39.433 INFO:teuthology.orchestra.run.trial027.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-19T08:22:39.440 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-19T08:22:39.443 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-19T08:22:39.449 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-19T08:22:39.453 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-19T08:22:39.460 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-19T08:22:39.463 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-19T08:22:39.491 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-19T08:22:39.501 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-19T08:22:39.536 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-19T08:22:39.760 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 61/98 2026-02-19T08:22:39.784 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-19T08:22:39.788 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-19T08:22:39.847 INFO:teuthology.orchestra.run.trial027.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-19T08:22:39.849 INFO:teuthology.orchestra.run.trial027.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-19T08:22:39.870 INFO:teuthology.orchestra.run.trial027.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-19T08:22:40.196 INFO:teuthology.orchestra.run.trial027.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-19T08:22:40.269 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-19T08:22:40.940 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-19T08:22:40.959 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-19T08:22:40.973 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-19T08:22:40.988 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-19T08:22:41.064 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-19T08:22:41.073 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-19T08:22:41.096 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-19T08:22:41.126 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-19T08:22:41.177 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-19T08:22:41.183 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-19T08:22:41.186 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-19T08:22:41.187 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-19T08:22:41.206 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-19T08:22:41.206 INFO:teuthology.orchestra.run.trial027.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-19T08:22:41.206 INFO:teuthology.orchestra.run.trial027.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-19T08:22:41.206 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:41.213 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-19T08:22:41.239 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-19T08:22:41.239 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-19T08:22:41.240 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:41.274 INFO:teuthology.orchestra.run.trial027.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-19T08:22:41.277 INFO:teuthology.orchestra.run.trial116.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 11 MB/s | 50 MB 00:04 2026-02-19T08:22:41.279 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:41.280 INFO:teuthology.orchestra.run.trial116.stdout:Total 11 MB/s | 50 MB 00:04 2026-02-19T08:22:41.306 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:22:41.317 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:22:41.317 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:22:41.338 INFO:teuthology.orchestra.run.trial027.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 83/98 2026-02-19T08:22:41.340 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 84/98 2026-02-19T08:22:41.354 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 84/98 2026-02-19T08:22:41.354 INFO:teuthology.orchestra.run.trial027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:41.354 INFO:teuthology.orchestra.run.trial027.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-19T08:22:41.354 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:41.503 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:22:41.503 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:22:41.715 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:22:41.721 INFO:teuthology.orchestra.run.trial116.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-19T08:22:41.725 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-19T08:22:41.733 INFO:teuthology.orchestra.run.trial116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-19T08:22:41.733 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-19T08:22:42.049 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 85/98 2026-02-19T08:22:42.074 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 85/98 2026-02-19T08:22:42.074 INFO:teuthology.orchestra.run.trial027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:42.074 INFO:teuthology.orchestra.run.trial027.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-19T08:22:42.074 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-19T08:22:42.075 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-19T08:22:42.075 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:42.131 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 86/98 2026-02-19T08:22:42.133 INFO:teuthology.orchestra.run.trial027.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 86/98 2026-02-19T08:22:42.137 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 87/98 2026-02-19T08:22:42.157 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 88/98 2026-02-19T08:22:42.158 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 89/98 2026-02-19T08:22:42.651 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 89/98 2026-02-19T08:22:42.654 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 90/98 2026-02-19T08:22:43.111 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 90/98 2026-02-19T08:22:43.112 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 91/98 2026-02-19T08:22:43.125 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 91/98 2026-02-19T08:22:43.125 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 92/98 2026-02-19T08:22:43.179 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 92/98 2026-02-19T08:22:43.228 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 93/98 2026-02-19T08:22:43.229 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 94/98 2026-02-19T08:22:43.251 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 94/98 2026-02-19T08:22:43.251 INFO:teuthology.orchestra.run.trial027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:43.251 INFO:teuthology.orchestra.run.trial027.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-19T08:22:43.251 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-19T08:22:43.251 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-19T08:22:43.251 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:43.263 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 95/98 2026-02-19T08:22:43.477 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 95/98 2026-02-19T08:22:43.479 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 96/98 2026-02-19T08:22:43.500 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 96/98 2026-02-19T08:22:43.500 INFO:teuthology.orchestra.run.trial027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:43.500 INFO:teuthology.orchestra.run.trial027.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-19T08:22:43.501 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-19T08:22:43.501 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-19T08:22:43.501 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:43.603 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/98 2026-02-19T08:22:43.625 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/98 2026-02-19T08:22:43.625 INFO:teuthology.orchestra.run.trial027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:43.625 INFO:teuthology.orchestra.run.trial027.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-19T08:22:43.625 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-19T08:22:43.625 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-19T08:22:43.625 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:43.643 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/98 2026-02-19T08:22:44.083 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-19T08:22:44.101 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-19T08:22:44.289 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/98 2026-02-19T08:22:44.289 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/98 2026-02-19T08:22:44.289 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/98 2026-02-19T08:22:44.289 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/98 2026-02-19T08:22:44.289 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/98 2026-02-19T08:22:44.289 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/98 2026-02-19T08:22:44.289 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/98 2026-02-19T08:22:44.289 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/98 2026-02-19T08:22:44.289 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/98 2026-02-19T08:22:44.289 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-19T08:22:44.290 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-19T08:22:44.291 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 38/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-19T08:22:44.292 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-19T08:22:44.293 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-19T08:22:44.294 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-19T08:22:44.295 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-19T08:22:44.296 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-19T08:22:44.297 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-19T08:22:44.297 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-19T08:22:44.320 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-19T08:22:44.320 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-19T08:22:44.320 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-19T08:22:44.320 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-19T08:22:44.320 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-19T08:22:44.354 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-19T08:22:44.354 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:44.354 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:44.355 INFO:teuthology.orchestra.run.trial027.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-19T08:22:44.356 INFO:teuthology.orchestra.run.trial027.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: lua-5.4.4-4.el9.x86_64 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-19T08:22:44.357 INFO:teuthology.orchestra.run.trial027.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-19T08:22:44.358 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-19T08:22:44.359 INFO:teuthology.orchestra.run.trial027.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-ply-3.11-14.el9.noarch 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-19T08:22:44.360 INFO:teuthology.orchestra.run.trial027.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-19T08:22:44.361 INFO:teuthology.orchestra.run.trial027.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-19T08:22:44.362 INFO:teuthology.orchestra.run.trial027.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-19T08:22:44.362 INFO:teuthology.orchestra.run.trial027.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-19T08:22:44.362 INFO:teuthology.orchestra.run.trial027.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-19T08:22:44.362 INFO:teuthology.orchestra.run.trial027.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-19T08:22:44.362 INFO:teuthology.orchestra.run.trial027.stdout: unzip-6.0-59.el9.x86_64 2026-02-19T08:22:44.362 INFO:teuthology.orchestra.run.trial027.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-19T08:22:44.362 INFO:teuthology.orchestra.run.trial027.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-19T08:22:44.362 INFO:teuthology.orchestra.run.trial027.stdout: zip-3.0-35.el9.x86_64 2026-02-19T08:22:44.362 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:44.362 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:44.372 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-19T08:22:44.373 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:44.373 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:22:44.373 INFO:teuthology.orchestra.run.trial116.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:44.373 INFO:teuthology.orchestra.run.trial116.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:44.373 INFO:teuthology.orchestra.run.trial116.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-19T08:22:44.373 INFO:teuthology.orchestra.run.trial116.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-19T08:22:44.373 INFO:teuthology.orchestra.run.trial116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-19T08:22:44.373 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:44.373 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:22:44.407 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-base 2026-02-19T08:22:44.409 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph 2026-02-19T08:22:44.717 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:32 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:44.717 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:32 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:44.782 INFO:teuthology.orchestra.run.trial027.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:44.800 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:44.801 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:44.801 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:44.804 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:22:44.806 INFO:teuthology.orchestra.run.trial116.stdout:====================================================================================== 2026-02-19T08:22:44.806 INFO:teuthology.orchestra.run.trial116.stdout: Package Arch Version Repository Size 2026-02-19T08:22:44.806 INFO:teuthology.orchestra.run.trial116.stdout:====================================================================================== 2026-02-19T08:22:44.806 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout:Installing dependencies: 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-19T08:22:44.807 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout:Installing weak dependencies: 2026-02-19T08:22:44.808 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout:====================================================================================== 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout:Install 98 Packages 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 95 M 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 519 M 2026-02-19T08:22:44.809 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:22:44.822 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install cephadm 2026-02-19T08:22:45.134 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:33 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:45.199 INFO:teuthology.orchestra.run.trial027.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:22:45.217 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:45.218 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:45.218 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:45.240 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-immutable-object-cache 2026-02-19T08:22:45.547 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:33 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout: Package Arch Version Repo Size 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout:Install 1 Package 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 145 k 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 431 k 2026-02-19T08:22:45.631 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:22:45.697 INFO:teuthology.orchestra.run.trial116.stdout:(1/98): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 45 kB/s | 6.5 kB 00:00 2026-02-19T08:22:45.893 INFO:teuthology.orchestra.run.trial027.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 556 kB/s | 145 kB 00:00 2026-02-19T08:22:45.893 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:45.894 INFO:teuthology.orchestra.run.trial027.stdout:Total 554 kB/s | 145 kB 00:00 2026-02-19T08:22:45.894 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:22:45.898 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:22:45.898 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:22:45.930 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:22:45.930 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:22:45.982 INFO:teuthology.orchestra.run.trial116.stdout:(2/98): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 2.5 MB/s | 1.1 MB 00:00 2026-02-19T08:22:45.988 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:22:45.989 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-19T08:22:46.011 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-19T08:22:46.012 INFO:teuthology.orchestra.run.trial027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:46.012 INFO:teuthology.orchestra.run.trial027.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-19T08:22:46.012 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:46.178 INFO:teuthology.orchestra.run.trial116.stdout:(3/98): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 3.9 MB/s | 2.4 MB 00:00 2026-02-19T08:22:46.227 INFO:teuthology.orchestra.run.trial116.stdout:(4/98): ceph-grafana-dashboards-19.2.3-705.g04c 639 kB/s | 31 kB 00:00 2026-02-19T08:22:46.279 INFO:teuthology.orchestra.run.trial116.stdout:(5/98): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 2.8 MB/s | 150 kB 00:00 2026-02-19T08:22:46.305 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-19T08:22:46.305 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:46.305 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:22:46.305 INFO:teuthology.orchestra.run.trial027.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:46.305 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:46.305 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:46.333 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-mgr 2026-02-19T08:22:46.639 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:34 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:46.705 INFO:teuthology.orchestra.run.trial027.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:46.723 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:46.724 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:46.724 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:46.745 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-mgr-dashboard 2026-02-19T08:22:46.833 INFO:teuthology.orchestra.run.trial116.stdout:(6/98): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 6.9 MB/s | 3.8 MB 00:00 2026-02-19T08:22:46.977 INFO:teuthology.orchestra.run.trial116.stdout:(7/98): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 3.7 MB/s | 4.7 MB 00:01 2026-02-19T08:22:47.046 INFO:teuthology.orchestra.run.trial116.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 321 kB/s | 22 kB 00:00 2026-02-19T08:22:47.049 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:35 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:47.114 INFO:teuthology.orchestra.run.trial027.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:22:47.132 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:47.133 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:47.133 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:47.154 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-19T08:22:47.461 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:35 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:47.526 INFO:teuthology.orchestra.run.trial027.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:22:47.544 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:47.545 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:47.545 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:47.557 INFO:teuthology.orchestra.run.trial116.stdout:(9/98): ceph-mgr-modules-core-19.2.3-705.g04cf6 494 kB/s | 253 kB 00:00 2026-02-19T08:22:47.566 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-mgr-rook 2026-02-19T08:22:47.621 INFO:teuthology.orchestra.run.trial116.stdout:(10/98): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 776 kB/s | 49 kB 00:00 2026-02-19T08:22:47.687 INFO:teuthology.orchestra.run.trial116.stdout:(11/98): ceph-prometheus-alerts-19.2.3-705.g04c 255 kB/s | 17 kB 00:00 2026-02-19T08:22:47.724 INFO:teuthology.orchestra.run.trial116.stdout:(12/98): ceph-mgr-diskprediction-local-19.2.3-7 8.3 MB/s | 7.4 MB 00:00 2026-02-19T08:22:47.876 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:35 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:47.888 INFO:teuthology.orchestra.run.trial116.stdout:(13/98): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 1.4 MB/s | 299 kB 00:00 2026-02-19T08:22:47.910 INFO:teuthology.orchestra.run.trial116.stdout:(14/98): cryptsetup-2.8.1-3.el9.x86_64.rpm 16 MB/s | 351 kB 00:00 2026-02-19T08:22:47.915 INFO:teuthology.orchestra.run.trial116.stdout:(15/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 9.1 MB/s | 40 kB 00:00 2026-02-19T08:22:47.920 INFO:teuthology.orchestra.run.trial116.stdout:(16/98): libconfig-1.7.2-9.el9.x86_64.rpm 15 MB/s | 72 kB 00:00 2026-02-19T08:22:47.929 INFO:teuthology.orchestra.run.trial116.stdout:(17/98): libgfortran-11.5.0-14.el9.x86_64.rpm 84 MB/s | 794 kB 00:00 2026-02-19T08:22:47.936 INFO:teuthology.orchestra.run.trial116.stdout:(18/98): libquadmath-11.5.0-14.el9.x86_64.rpm 25 MB/s | 184 kB 00:00 2026-02-19T08:22:47.940 INFO:teuthology.orchestra.run.trial027.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:22:47.943 INFO:teuthology.orchestra.run.trial116.stdout:(19/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 36 MB/s | 253 kB 00:00 2026-02-19T08:22:47.959 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:47.959 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:47.960 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:47.973 INFO:teuthology.orchestra.run.trial116.stdout:(20/98): python3-cryptography-36.0.1-5.el9.x86_ 43 MB/s | 1.2 MB 00:00 2026-02-19T08:22:47.980 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-mgr-cephadm 2026-02-19T08:22:47.995 INFO:teuthology.orchestra.run.trial116.stdout:(21/98): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 8.5 MB/s | 17 MB 00:02 2026-02-19T08:22:47.996 INFO:teuthology.orchestra.run.trial116.stdout:(22/98): python3-ply-3.11-14.el9.noarch.rpm 4.5 MB/s | 106 kB 00:00 2026-02-19T08:22:48.002 INFO:teuthology.orchestra.run.trial116.stdout:(23/98): python3-requests-2.25.1-10.el9.noarch. 21 MB/s | 126 kB 00:00 2026-02-19T08:22:48.009 INFO:teuthology.orchestra.run.trial116.stdout:(24/98): python3-urllib3-1.26.5-7.el9.noarch.rp 31 MB/s | 218 kB 00:00 2026-02-19T08:22:48.014 INFO:teuthology.orchestra.run.trial116.stdout:(25/98): python3-pycparser-2.20-6.el9.noarch.rp 7.2 MB/s | 135 kB 00:00 2026-02-19T08:22:48.016 INFO:teuthology.orchestra.run.trial116.stdout:(26/98): unzip-6.0-59.el9.x86_64.rpm 25 MB/s | 182 kB 00:00 2026-02-19T08:22:48.023 INFO:teuthology.orchestra.run.trial116.stdout:(27/98): zip-3.0-35.el9.x86_64.rpm 28 MB/s | 266 kB 00:00 2026-02-19T08:22:48.051 INFO:teuthology.orchestra.run.trial116.stdout:(28/98): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 2.3 MB/s | 769 kB 00:00 2026-02-19T08:22:48.077 INFO:teuthology.orchestra.run.trial116.stdout:(29/98): flexiblas-3.0.4-9.el9.x86_64.rpm 486 kB/s | 30 kB 00:00 2026-02-19T08:22:48.098 INFO:teuthology.orchestra.run.trial116.stdout:(30/98): flexiblas-openblas-openmp-3.0.4-9.el9. 315 kB/s | 15 kB 00:00 2026-02-19T08:22:48.142 INFO:teuthology.orchestra.run.trial116.stdout:(31/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.7 MB/s | 246 kB 00:00 2026-02-19T08:22:48.159 INFO:teuthology.orchestra.run.trial116.stdout:(32/98): openblas-0.3.29-1.el9.x86_64.rpm 2.5 MB/s | 42 kB 00:00 2026-02-19T08:22:48.165 INFO:teuthology.orchestra.run.trial116.stdout:(33/98): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2026-02-19T08:22:48.198 INFO:teuthology.orchestra.run.trial116.stdout:(34/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 17 MB/s | 3.0 MB 00:00 2026-02-19T08:22:48.229 INFO:teuthology.orchestra.run.trial116.stdout:(35/98): protobuf-3.14.0-17.el9.x86_64.rpm 16 MB/s | 1.0 MB 00:00 2026-02-19T08:22:48.252 INFO:teuthology.orchestra.run.trial116.stdout:(36/98): python3-babel-2.9.1-2.el9.noarch.rpm 111 MB/s | 6.0 MB 00:00 2026-02-19T08:22:48.253 INFO:teuthology.orchestra.run.trial116.stdout:(37/98): python3-devel-3.9.25-3.el9.x86_64.rpm 9.9 MB/s | 244 kB 00:00 2026-02-19T08:22:48.272 INFO:teuthology.orchestra.run.trial116.stdout:(38/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 12 MB/s | 249 kB 00:00 2026-02-19T08:22:48.273 INFO:teuthology.orchestra.run.trial116.stdout:(39/98): python3-libstoragemgmt-1.10.1-1.el9.x8 8.4 MB/s | 177 kB 00:00 2026-02-19T08:22:48.286 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:36 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:48.293 INFO:teuthology.orchestra.run.trial116.stdout:(40/98): python3-mako-1.1.4-6.el9.noarch.rpm 8.5 MB/s | 172 kB 00:00 2026-02-19T08:22:48.296 INFO:teuthology.orchestra.run.trial116.stdout:(41/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 51 MB/s | 1.2 MB 00:00 2026-02-19T08:22:48.303 INFO:teuthology.orchestra.run.trial116.stdout:(42/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 37 MB/s | 5.3 MB 00:00 2026-02-19T08:22:48.311 INFO:teuthology.orchestra.run.trial116.stdout:(43/98): python3-markupsafe-1.1.1-12.el9.x86_64 1.9 MB/s | 35 kB 00:00 2026-02-19T08:22:48.323 INFO:teuthology.orchestra.run.trial116.stdout:(44/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 22 MB/s | 442 kB 00:00 2026-02-19T08:22:48.329 INFO:teuthology.orchestra.run.trial116.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 4.2 MB/s | 77 kB 00:00 2026-02-19T08:22:48.346 INFO:teuthology.orchestra.run.trial116.stdout:(46/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 123 MB/s | 6.1 MB 00:00 2026-02-19T08:22:48.347 INFO:teuthology.orchestra.run.trial116.stdout:(47/98): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-19T08:22:48.348 INFO:teuthology.orchestra.run.trial116.stdout:(48/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 8.1 MB/s | 159 kB 00:00 2026-02-19T08:22:48.351 INFO:teuthology.orchestra.run.trial027.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:22:48.365 INFO:teuthology.orchestra.run.trial116.stdout:(49/98): python3-requests-oauthlib-1.3.0-12.el9 3.0 MB/s | 54 kB 00:00 2026-02-19T08:22:48.366 INFO:teuthology.orchestra.run.trial116.stdout:(50/98): python3-pyasn1-modules-0.4.8-6.el9.noa 13 MB/s | 279 kB 00:00 2026-02-19T08:22:48.370 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:48.370 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:48.371 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:48.382 INFO:teuthology.orchestra.run.trial116.stdout:(51/98): python3-toml-0.10.2-6.el9.noarch.rpm 2.3 MB/s | 42 kB 00:00 2026-02-19T08:22:48.386 INFO:teuthology.orchestra.run.trial116.stdout:(52/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 9.5 MB/s | 189 kB 00:00 2026-02-19T08:22:48.392 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-fuse 2026-02-19T08:22:48.403 INFO:teuthology.orchestra.run.trial116.stdout:(53/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 4.3 MB/s | 90 kB 00:00 2026-02-19T08:22:48.438 INFO:teuthology.orchestra.run.trial116.stdout:(54/98): lua-devel-5.4.4-4.el9.x86_64.rpm 430 kB/s | 22 kB 00:00 2026-02-19T08:22:48.474 INFO:teuthology.orchestra.run.trial116.stdout:(55/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 15 MB/s | 551 kB 00:00 2026-02-19T08:22:48.477 INFO:teuthology.orchestra.run.trial116.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 5.9 MB/s | 19 kB 00:00 2026-02-19T08:22:48.479 INFO:teuthology.orchestra.run.trial116.stdout:(57/98): protobuf-compiler-3.14.0-17.el9.x86_64 11 MB/s | 862 kB 00:00 2026-02-19T08:22:48.481 INFO:teuthology.orchestra.run.trial116.stdout:(58/98): luarocks-3.9.2-5.el9.noarch.rpm 42 MB/s | 151 kB 00:00 2026-02-19T08:22:48.485 INFO:teuthology.orchestra.run.trial116.stdout:(59/98): python3-asyncssh-2.13.2-5.el9.noarch.r 100 MB/s | 548 kB 00:00 2026-02-19T08:22:48.485 INFO:teuthology.orchestra.run.trial116.stdout:(60/98): python3-autocommand-2.2.2-8.el9.noarch 7.6 MB/s | 29 kB 00:00 2026-02-19T08:22:48.488 INFO:teuthology.orchestra.run.trial116.stdout:(61/98): python3-backports-tarfile-1.2.0-1.el9. 17 MB/s | 60 kB 00:00 2026-02-19T08:22:48.491 INFO:teuthology.orchestra.run.trial116.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 7.1 MB/s | 43 kB 00:00 2026-02-19T08:22:48.492 INFO:teuthology.orchestra.run.trial116.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 9.8 MB/s | 32 kB 00:00 2026-02-19T08:22:48.495 INFO:teuthology.orchestra.run.trial116.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 4.2 MB/s | 14 kB 00:00 2026-02-19T08:22:48.495 INFO:teuthology.orchestra.run.trial116.stdout:(65/98): python3-cheroot-10.0.1-4.el9.noarch.rp 47 MB/s | 173 kB 00:00 2026-02-19T08:22:48.499 INFO:teuthology.orchestra.run.trial116.stdout:(66/98): python3-cherrypy-18.6.1-2.el9.noarch.r 78 MB/s | 358 kB 00:00 2026-02-19T08:22:48.500 INFO:teuthology.orchestra.run.trial116.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 55 MB/s | 254 kB 00:00 2026-02-19T08:22:48.512 INFO:teuthology.orchestra.run.trial116.stdout:(68/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 160 MB/s | 2.0 MB 00:00 2026-02-19T08:22:48.513 INFO:teuthology.orchestra.run.trial116.stdout:(69/98): python3-grpcio-tools-1.46.7-10.el9.x86 11 MB/s | 144 kB 00:00 2026-02-19T08:22:48.516 INFO:teuthology.orchestra.run.trial116.stdout:(70/98): python3-influxdb-5.3.1-1.el9.noarch.rp 37 MB/s | 139 kB 00:00 2026-02-19T08:22:48.517 INFO:teuthology.orchestra.run.trial116.stdout:(71/98): python3-isodate-0.6.1-3.el9.noarch.rpm 13 MB/s | 56 kB 00:00 2026-02-19T08:22:48.520 INFO:teuthology.orchestra.run.trial116.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 3.3 MB/s | 11 kB 00:00 2026-02-19T08:22:48.520 INFO:teuthology.orchestra.run.trial116.stdout:(73/98): python3-jaraco-classes-3.2.1-5.el9.noa 5.2 MB/s | 18 kB 00:00 2026-02-19T08:22:48.523 INFO:teuthology.orchestra.run.trial116.stdout:(74/98): python3-jaraco-collections-3.0.0-8.el9 6.8 MB/s | 23 kB 00:00 2026-02-19T08:22:48.526 INFO:teuthology.orchestra.run.trial116.stdout:(75/98): python3-jaraco-context-6.0.1-3.el9.noa 3.4 MB/s | 20 kB 00:00 2026-02-19T08:22:48.527 INFO:teuthology.orchestra.run.trial116.stdout:(76/98): python3-jaraco-functools-3.5.0-2.el9.n 6.0 MB/s | 19 kB 00:00 2026-02-19T08:22:48.529 INFO:teuthology.orchestra.run.trial116.stdout:(77/98): python3-jaraco-text-4.0.0-2.el9.noarch 8.0 MB/s | 26 kB 00:00 2026-02-19T08:22:48.534 INFO:teuthology.orchestra.run.trial116.stdout:(78/98): python3-kubernetes-26.1.0-3.el9.noarch 135 MB/s | 1.0 MB 00:00 2026-02-19T08:22:48.535 INFO:teuthology.orchestra.run.trial116.stdout:(79/98): python3-logutils-0.3.5-21.el9.noarch.r 9.2 MB/s | 46 kB 00:00 2026-02-19T08:22:48.538 INFO:teuthology.orchestra.run.trial116.stdout:(80/98): python3-more-itertools-8.12.0-2.el9.no 22 MB/s | 79 kB 00:00 2026-02-19T08:22:48.539 INFO:teuthology.orchestra.run.trial116.stdout:(81/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 21 MB/s | 86 kB 00:00 2026-02-19T08:22:48.542 INFO:teuthology.orchestra.run.trial116.stdout:(82/98): python3-natsort-7.1.1-5.el9.noarch.rpm 17 MB/s | 58 kB 00:00 2026-02-19T08:22:48.543 INFO:teuthology.orchestra.run.trial116.stdout:(83/98): python3-pecan-1.4.2-3.el9.noarch.rpm 66 MB/s | 272 kB 00:00 2026-02-19T08:22:48.545 INFO:teuthology.orchestra.run.trial116.stdout:(84/98): python3-portend-3.1.0-2.el9.noarch.rpm 4.9 MB/s | 16 kB 00:00 2026-02-19T08:22:48.546 INFO:teuthology.orchestra.run.trial116.stdout:(85/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 25 MB/s | 90 kB 00:00 2026-02-19T08:22:48.549 INFO:teuthology.orchestra.run.trial116.stdout:(86/98): python3-repoze-lru-0.7-16.el9.noarch.r 9.0 MB/s | 31 kB 00:00 2026-02-19T08:22:48.551 INFO:teuthology.orchestra.run.trial116.stdout:(87/98): python3-routes-2.5.1-5.el9.noarch.rpm 45 MB/s | 188 kB 00:00 2026-02-19T08:22:48.552 INFO:teuthology.orchestra.run.trial116.stdout:(88/98): python3-rsa-4.9-2.el9.noarch.rpm 17 MB/s | 59 kB 00:00 2026-02-19T08:22:48.554 INFO:teuthology.orchestra.run.trial116.stdout:(89/98): python3-saml-1.16.0-1.el9.noarch.rpm 34 MB/s | 125 kB 00:00 2026-02-19T08:22:48.556 INFO:teuthology.orchestra.run.trial116.stdout:(90/98): python3-tempora-5.0.0-2.el9.noarch.rpm 10 MB/s | 36 kB 00:00 2026-02-19T08:22:48.558 INFO:teuthology.orchestra.run.trial116.stdout:(91/98): python3-typing-extensions-4.15.0-1.el9 25 MB/s | 86 kB 00:00 2026-02-19T08:22:48.560 INFO:teuthology.orchestra.run.trial116.stdout:(92/98): python3-webob-1.8.8-2.el9.noarch.rpm 60 MB/s | 230 kB 00:00 2026-02-19T08:22:48.561 INFO:teuthology.orchestra.run.trial116.stdout:(93/98): python3-websocket-client-1.2.3-2.el9.n 25 MB/s | 90 kB 00:00 2026-02-19T08:22:48.564 INFO:teuthology.orchestra.run.trial116.stdout:(94/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 95 MB/s | 427 kB 00:00 2026-02-19T08:22:48.565 INFO:teuthology.orchestra.run.trial116.stdout:(95/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 14 MB/s | 48 kB 00:00 2026-02-19T08:22:48.568 INFO:teuthology.orchestra.run.trial116.stdout:(96/98): python3-xmltodict-0.12.0-15.el9.noarch 6.4 MB/s | 22 kB 00:00 2026-02-19T08:22:48.569 INFO:teuthology.orchestra.run.trial116.stdout:(97/98): python3-zc-lockfile-2.0-10.el9.noarch. 5.1 MB/s | 20 kB 00:00 2026-02-19T08:22:48.703 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:36 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:48.765 INFO:teuthology.orchestra.run.trial116.stdout:(98/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 46 MB/s | 19 MB 00:00 2026-02-19T08:22:48.769 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:48.769 INFO:teuthology.orchestra.run.trial116.stdout:Total 24 MB/s | 95 MB 00:03 2026-02-19T08:22:48.787 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:48.787 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:48.788 INFO:teuthology.orchestra.run.trial027.stdout: Package Architecture Version Repository Size 2026-02-19T08:22:48.788 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:48.788 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:22:48.788 INFO:teuthology.orchestra.run.trial027.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-19T08:22:48.788 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:48.788 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:22:48.788 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:48.788 INFO:teuthology.orchestra.run.trial027.stdout:Install 1 Package 2026-02-19T08:22:48.788 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:48.788 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 1.2 M 2026-02-19T08:22:48.789 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 3.6 M 2026-02-19T08:22:48.789 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:22:49.198 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:22:49.236 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:22:49.236 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:22:49.308 INFO:teuthology.orchestra.run.trial027.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 2.2 MB/s | 1.2 MB 00:00 2026-02-19T08:22:49.309 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:49.309 INFO:teuthology.orchestra.run.trial027.stdout:Total 2.2 MB/s | 1.2 MB 00:00 2026-02-19T08:22:49.309 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:22:49.312 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:22:49.312 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:22:49.347 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:22:49.347 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:22:49.447 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:22:49.464 INFO:teuthology.orchestra.run.trial027.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:49.652 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:22:49.653 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:22:49.680 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:49.736 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:49.737 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:49.737 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:22:49.737 INFO:teuthology.orchestra.run.trial027.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:49.737 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:49.737 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:49.765 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install ceph-volume 2026-02-19T08:22:50.065 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:38 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:50.107 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:22:50.110 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-19T08:22:50.130 INFO:teuthology.orchestra.run.trial027.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:22:50.140 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-19T08:22:50.145 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-19T08:22:50.149 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:50.149 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:50.149 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:50.166 INFO:teuthology.orchestra.run.trial116.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-19T08:22:50.171 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install librados-devel 2026-02-19T08:22:50.177 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-19T08:22:50.182 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-19T08:22:50.216 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-19T08:22:50.226 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-19T08:22:50.231 INFO:teuthology.orchestra.run.trial116.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-19T08:22:50.233 INFO:teuthology.orchestra.run.trial116.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-19T08:22:50.237 INFO:teuthology.orchestra.run.trial116.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-19T08:22:50.260 INFO:teuthology.orchestra.run.trial116.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-19T08:22:50.273 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-19T08:22:50.276 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-19T08:22:50.282 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-19T08:22:50.284 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-19T08:22:50.295 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-19T08:22:50.301 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-19T08:22:50.324 INFO:teuthology.orchestra.run.trial116.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-19T08:22:50.328 INFO:teuthology.orchestra.run.trial116.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-19T08:22:50.334 INFO:teuthology.orchestra.run.trial116.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-19T08:22:50.359 INFO:teuthology.orchestra.run.trial116.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-19T08:22:50.409 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-19T08:22:50.422 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-19T08:22:50.424 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-19T08:22:50.429 INFO:teuthology.orchestra.run.trial116.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-19T08:22:50.434 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-19T08:22:50.438 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-19T08:22:50.443 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-19T08:22:50.457 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-19T08:22:50.478 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:38 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:50.479 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-19T08:22:50.483 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-19T08:22:50.488 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-19T08:22:50.500 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-19T08:22:50.509 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-19T08:22:50.515 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-19T08:22:50.535 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-19T08:22:50.544 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-19T08:22:50.561 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:50.562 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:50.562 INFO:teuthology.orchestra.run.trial027.stdout: Package Arch Version Repo Size 2026-02-19T08:22:50.562 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:50.562 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:22:50.562 INFO:teuthology.orchestra.run.trial027.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-19T08:22:50.562 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:50.562 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:22:50.562 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:50.563 INFO:teuthology.orchestra.run.trial027.stdout:Install 1 Package 2026-02-19T08:22:50.563 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:50.563 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 126 k 2026-02-19T08:22:50.563 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 456 k 2026-02-19T08:22:50.563 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:22:50.599 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-19T08:22:50.611 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-19T08:22:50.627 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-19T08:22:50.631 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-19T08:22:50.639 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-19T08:22:50.679 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-19T08:22:51.006 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-19T08:22:51.016 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-19T08:22:51.020 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-19T08:22:51.023 INFO:teuthology.orchestra.run.trial027.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 274 kB/s | 126 kB 00:00 2026-02-19T08:22:51.024 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:51.024 INFO:teuthology.orchestra.run.trial027.stdout:Total 274 kB/s | 126 kB 00:00 2026-02-19T08:22:51.024 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:22:51.025 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-19T08:22:51.027 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:22:51.027 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:22:51.027 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-19T08:22:51.055 INFO:teuthology.orchestra.run.trial116.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-19T08:22:51.059 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:22:51.059 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:22:51.097 INFO:teuthology.orchestra.run.trial116.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-19T08:22:51.104 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-19T08:22:51.108 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-19T08:22:51.113 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-19T08:22:51.114 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:22:51.117 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-19T08:22:51.124 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-19T08:22:51.127 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-19T08:22:51.131 INFO:teuthology.orchestra.run.trial027.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:51.155 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-19T08:22:51.165 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-19T08:22:51.199 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-19T08:22:51.214 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:51.271 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:51.272 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:51.272 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:22:51.272 INFO:teuthology.orchestra.run.trial027.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:51.272 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:51.272 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:51.300 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install libcephfs2 2026-02-19T08:22:51.421 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 61/98 2026-02-19T08:22:51.445 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-19T08:22:51.449 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-19T08:22:51.506 INFO:teuthology.orchestra.run.trial116.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-19T08:22:51.508 INFO:teuthology.orchestra.run.trial116.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-19T08:22:51.529 INFO:teuthology.orchestra.run.trial116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-19T08:22:51.613 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:39 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:51.678 INFO:teuthology.orchestra.run.trial027.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:51.697 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:51.697 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:51.697 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:51.718 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install libcephfs-devel 2026-02-19T08:22:51.851 INFO:teuthology.orchestra.run.trial116.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-19T08:22:51.924 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-19T08:22:52.031 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:40 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:52.115 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:52.116 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:52.116 INFO:teuthology.orchestra.run.trial027.stdout: Package Arch Version Repo Size 2026-02-19T08:22:52.116 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:52.116 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:22:52.116 INFO:teuthology.orchestra.run.trial027.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-19T08:22:52.116 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:52.116 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:22:52.116 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:52.117 INFO:teuthology.orchestra.run.trial027.stdout:Install 1 Package 2026-02-19T08:22:52.117 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:52.117 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 34 k 2026-02-19T08:22:52.117 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 153 k 2026-02-19T08:22:52.117 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:22:52.347 INFO:teuthology.orchestra.run.trial027.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 145 kB/s | 34 kB 00:00 2026-02-19T08:22:52.348 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:52.348 INFO:teuthology.orchestra.run.trial027.stdout:Total 144 kB/s | 34 kB 00:00 2026-02-19T08:22:52.348 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:22:52.350 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:22:52.350 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:22:52.353 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:22:52.353 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:22:52.373 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:22:52.390 INFO:teuthology.orchestra.run.trial027.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:52.445 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:52.502 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:52.502 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:52.502 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:22:52.502 INFO:teuthology.orchestra.run.trial027.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:52.503 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:52.503 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:52.530 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install librados2 2026-02-19T08:22:52.587 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-19T08:22:52.605 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-19T08:22:52.618 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-19T08:22:52.634 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-19T08:22:52.708 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-19T08:22:52.717 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-19T08:22:52.740 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-19T08:22:52.769 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-19T08:22:52.819 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-19T08:22:52.825 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-19T08:22:52.829 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-19T08:22:52.830 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-19T08:22:52.838 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:40 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:52.848 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-19T08:22:52.848 INFO:teuthology.orchestra.run.trial116.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-19T08:22:52.848 INFO:teuthology.orchestra.run.trial116.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-19T08:22:52.848 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:52.855 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-19T08:22:52.881 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-19T08:22:52.881 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-19T08:22:52.881 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:52.903 INFO:teuthology.orchestra.run.trial027.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:52.918 INFO:teuthology.orchestra.run.trial116.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-19T08:22:52.922 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:52.922 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:52.922 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:52.944 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install librbd1 2026-02-19T08:22:52.982 INFO:teuthology.orchestra.run.trial116.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 83/98 2026-02-19T08:22:52.984 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 84/98 2026-02-19T08:22:52.998 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 84/98 2026-02-19T08:22:52.998 INFO:teuthology.orchestra.run.trial116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:52.998 INFO:teuthology.orchestra.run.trial116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-19T08:22:52.998 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:53.251 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:41 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:53.316 INFO:teuthology.orchestra.run.trial027.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:53.335 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:53.335 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:53.336 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:53.357 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install python3-rados 2026-02-19T08:22:53.663 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:41 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:53.699 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 85/98 2026-02-19T08:22:53.724 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 85/98 2026-02-19T08:22:53.724 INFO:teuthology.orchestra.run.trial116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:53.724 INFO:teuthology.orchestra.run.trial116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-19T08:22:53.724 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-19T08:22:53.725 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-19T08:22:53.725 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:53.728 INFO:teuthology.orchestra.run.trial027.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:53.746 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:53.747 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:53.747 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:53.769 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install python3-rgw 2026-02-19T08:22:53.782 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 86/98 2026-02-19T08:22:53.784 INFO:teuthology.orchestra.run.trial116.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 86/98 2026-02-19T08:22:53.789 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 87/98 2026-02-19T08:22:53.808 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 88/98 2026-02-19T08:22:53.810 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 89/98 2026-02-19T08:22:54.078 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:42 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:54.143 INFO:teuthology.orchestra.run.trial027.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:54.162 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:54.162 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:54.162 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:54.184 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install python3-cephfs 2026-02-19T08:22:54.304 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 89/98 2026-02-19T08:22:54.307 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 90/98 2026-02-19T08:22:54.489 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:42 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:54.553 INFO:teuthology.orchestra.run.trial027.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:54.572 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:54.572 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:54.572 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:54.593 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install python3-rbd 2026-02-19T08:22:54.760 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 90/98 2026-02-19T08:22:54.761 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 91/98 2026-02-19T08:22:54.774 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 91/98 2026-02-19T08:22:54.774 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 92/98 2026-02-19T08:22:54.831 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 92/98 2026-02-19T08:22:54.880 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 93/98 2026-02-19T08:22:54.881 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 94/98 2026-02-19T08:22:54.903 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 94/98 2026-02-19T08:22:54.903 INFO:teuthology.orchestra.run.trial116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:54.903 INFO:teuthology.orchestra.run.trial116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-19T08:22:54.904 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-19T08:22:54.904 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-19T08:22:54.904 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:54.904 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:42 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:54.915 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 95/98 2026-02-19T08:22:54.969 INFO:teuthology.orchestra.run.trial027.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:54.987 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:54.988 INFO:teuthology.orchestra.run.trial027.stdout:Nothing to do. 2026-02-19T08:22:54.988 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:55.009 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install rbd-fuse 2026-02-19T08:22:55.136 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 95/98 2026-02-19T08:22:55.137 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 96/98 2026-02-19T08:22:55.160 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 96/98 2026-02-19T08:22:55.160 INFO:teuthology.orchestra.run.trial116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:55.160 INFO:teuthology.orchestra.run.trial116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-19T08:22:55.160 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-19T08:22:55.160 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-19T08:22:55.160 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:55.262 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/98 2026-02-19T08:22:55.282 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/98 2026-02-19T08:22:55.282 INFO:teuthology.orchestra.run.trial116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:55.282 INFO:teuthology.orchestra.run.trial116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-19T08:22:55.282 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-19T08:22:55.282 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-19T08:22:55.283 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:55.301 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/98 2026-02-19T08:22:55.320 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:43 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:55.404 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:55.404 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:55.404 INFO:teuthology.orchestra.run.trial027.stdout: Package Architecture Version Repository Size 2026-02-19T08:22:55.405 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:55.405 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:22:55.405 INFO:teuthology.orchestra.run.trial027.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-19T08:22:55.405 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:55.405 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:22:55.405 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:55.405 INFO:teuthology.orchestra.run.trial027.stdout:Install 1 Package 2026-02-19T08:22:55.405 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:55.405 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 85 k 2026-02-19T08:22:55.405 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 227 k 2026-02-19T08:22:55.406 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:22:55.631 INFO:teuthology.orchestra.run.trial027.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 376 kB/s | 85 kB 00:00 2026-02-19T08:22:55.631 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:55.631 INFO:teuthology.orchestra.run.trial027.stdout:Total 374 kB/s | 85 kB 00:00 2026-02-19T08:22:55.631 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:22:55.635 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:22:55.635 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:22:55.666 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:22:55.666 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:22:55.718 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:22:55.734 INFO:teuthology.orchestra.run.trial027.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:55.816 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:55.873 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:55.874 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:55.874 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:22:55.874 INFO:teuthology.orchestra.run.trial027.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:55.874 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:55.874 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:55.901 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install rbd-mirror 2026-02-19T08:22:55.986 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/98 2026-02-19T08:22:55.986 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/98 2026-02-19T08:22:55.987 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-19T08:22:55.988 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-19T08:22:55.989 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 38/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-19T08:22:55.990 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-19T08:22:55.991 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-19T08:22:55.992 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-19T08:22:55.993 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-19T08:22:55.994 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-19T08:22:55.994 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-19T08:22:55.994 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-19T08:22:55.994 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-19T08:22:55.994 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-19T08:22:55.994 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-19T08:22:55.994 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-19T08:22:55.994 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-19T08:22:55.994 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:56.051 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-19T08:22:56.052 INFO:teuthology.orchestra.run.trial116.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: lua-5.4.4-4.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-19T08:22:56.053 INFO:teuthology.orchestra.run.trial116.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-19T08:22:56.054 INFO:teuthology.orchestra.run.trial116.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-19T08:22:56.055 INFO:teuthology.orchestra.run.trial116.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-19T08:22:56.056 INFO:teuthology.orchestra.run.trial116.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-ply-3.11-14.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-19T08:22:56.057 INFO:teuthology.orchestra.run.trial116.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: unzip-6.0-59.el9.x86_64 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-19T08:22:56.058 INFO:teuthology.orchestra.run.trial116.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-19T08:22:56.059 INFO:teuthology.orchestra.run.trial116.stdout: zip-3.0-35.el9.x86_64 2026-02-19T08:22:56.059 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:56.059 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:22:56.106 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-base 2026-02-19T08:22:56.206 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:44 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:56.289 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:56.289 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:56.290 INFO:teuthology.orchestra.run.trial027.stdout: Package Arch Version Repo Size 2026-02-19T08:22:56.290 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:56.290 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:22:56.290 INFO:teuthology.orchestra.run.trial027.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-19T08:22:56.290 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:56.290 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:22:56.290 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:56.290 INFO:teuthology.orchestra.run.trial027.stdout:Install 1 Package 2026-02-19T08:22:56.290 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:56.291 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 3.1 M 2026-02-19T08:22:56.291 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 13 M 2026-02-19T08:22:56.291 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:22:56.421 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:44 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:56.486 INFO:teuthology.orchestra.run.trial116.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:56.505 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:22:56.505 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:22:56.505 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:22:56.526 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install cephadm 2026-02-19T08:22:56.836 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:44 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:56.901 INFO:teuthology.orchestra.run.trial116.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:22:56.919 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:22:56.920 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:22:56.920 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:22:56.942 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-immutable-object-cache 2026-02-19T08:22:56.972 INFO:teuthology.orchestra.run.trial027.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 4.6 MB/s | 3.1 MB 00:00 2026-02-19T08:22:56.974 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:56.974 INFO:teuthology.orchestra.run.trial027.stdout:Total 4.6 MB/s | 3.1 MB 00:00 2026-02-19T08:22:56.974 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:22:56.979 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:22:56.979 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:22:57.021 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:22:57.021 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:22:57.215 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:22:57.217 INFO:teuthology.orchestra.run.trial027.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:57.239 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:57.239 INFO:teuthology.orchestra.run.trial027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:57.239 INFO:teuthology.orchestra.run.trial027.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-19T08:22:57.239 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-19T08:22:57.239 INFO:teuthology.orchestra.run.trial027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-19T08:22:57.240 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:57.247 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:45 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:57.331 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:22:57.331 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:22:57.331 INFO:teuthology.orchestra.run.trial116.stdout: Package Arch Version Repo Size 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout:Install 1 Package 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 145 k 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 431 k 2026-02-19T08:22:57.332 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:22:57.532 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:57.532 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:57.532 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:22:57.532 INFO:teuthology.orchestra.run.trial027.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:57.532 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:57.533 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:57.561 DEBUG:teuthology.orchestra.run.trial027:> sudo yum -y install rbd-nbd 2026-02-19T08:22:57.760 INFO:teuthology.orchestra.run.trial116.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 340 kB/s | 145 kB 00:00 2026-02-19T08:22:57.761 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:57.761 INFO:teuthology.orchestra.run.trial116.stdout:Total 339 kB/s | 145 kB 00:00 2026-02-19T08:22:57.761 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:22:57.765 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:22:57.765 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:22:57.797 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:22:57.797 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:22:57.853 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:22:57.855 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-19T08:22:57.870 INFO:teuthology.orchestra.run.trial027.stdout:Last metadata expiration check: 0:00:45 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:57.877 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-19T08:22:57.877 INFO:teuthology.orchestra.run.trial116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:22:57.877 INFO:teuthology.orchestra.run.trial116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-19T08:22:57.877 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:57.954 INFO:teuthology.orchestra.run.trial027.stdout:Dependencies resolved. 2026-02-19T08:22:57.955 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:57.955 INFO:teuthology.orchestra.run.trial027.stdout: Package Architecture Version Repository Size 2026-02-19T08:22:57.955 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:57.955 INFO:teuthology.orchestra.run.trial027.stdout:Installing: 2026-02-19T08:22:57.955 INFO:teuthology.orchestra.run.trial027.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-19T08:22:57.955 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:57.955 INFO:teuthology.orchestra.run.trial027.stdout:Transaction Summary 2026-02-19T08:22:57.956 INFO:teuthology.orchestra.run.trial027.stdout:================================================================================ 2026-02-19T08:22:57.956 INFO:teuthology.orchestra.run.trial027.stdout:Install 1 Package 2026-02-19T08:22:57.956 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:57.956 INFO:teuthology.orchestra.run.trial027.stdout:Total download size: 171 k 2026-02-19T08:22:57.956 INFO:teuthology.orchestra.run.trial027.stdout:Installed size: 490 k 2026-02-19T08:22:57.956 INFO:teuthology.orchestra.run.trial027.stdout:Downloading Packages: 2026-02-19T08:22:58.185 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-19T08:22:58.185 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:58.185 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:22:58.185 INFO:teuthology.orchestra.run.trial116.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:58.186 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:22:58.186 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:22:58.214 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-mgr 2026-02-19T08:22:58.522 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:46 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:58.588 INFO:teuthology.orchestra.run.trial116.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:22:58.606 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:22:58.606 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:22:58.607 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:22:58.628 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-mgr-dashboard 2026-02-19T08:22:58.878 INFO:teuthology.orchestra.run.trial027.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 185 kB/s | 171 kB 00:00 2026-02-19T08:22:58.878 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:22:58.878 INFO:teuthology.orchestra.run.trial027.stdout:Total 185 kB/s | 171 kB 00:00 2026-02-19T08:22:58.878 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction check 2026-02-19T08:22:58.882 INFO:teuthology.orchestra.run.trial027.stdout:Transaction check succeeded. 2026-02-19T08:22:58.882 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction test 2026-02-19T08:22:58.913 INFO:teuthology.orchestra.run.trial027.stdout:Transaction test succeeded. 2026-02-19T08:22:58.914 INFO:teuthology.orchestra.run.trial027.stdout:Running transaction 2026-02-19T08:22:58.946 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:46 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:58.970 INFO:teuthology.orchestra.run.trial027.stdout: Preparing : 1/1 2026-02-19T08:22:58.986 INFO:teuthology.orchestra.run.trial027.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:59.011 INFO:teuthology.orchestra.run.trial116.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:22:59.029 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:22:59.030 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:22:59.030 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:22:59.053 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-19T08:22:59.066 INFO:teuthology.orchestra.run.trial027.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:59.124 INFO:teuthology.orchestra.run.trial027.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:22:59.124 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:59.124 INFO:teuthology.orchestra.run.trial027.stdout:Installed: 2026-02-19T08:22:59.125 INFO:teuthology.orchestra.run.trial027.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:22:59.125 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:22:59.125 INFO:teuthology.orchestra.run.trial027.stdout:Complete! 2026-02-19T08:22:59.155 DEBUG:teuthology.parallel:result is None 2026-02-19T08:22:59.362 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:47 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:59.427 INFO:teuthology.orchestra.run.trial116.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:22:59.445 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:22:59.445 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:22:59.446 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:22:59.467 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-mgr-rook 2026-02-19T08:22:59.778 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:47 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:22:59.843 INFO:teuthology.orchestra.run.trial116.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:22:59.862 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:22:59.862 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:22:59.863 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:22:59.884 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-mgr-cephadm 2026-02-19T08:23:00.188 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:48 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:00.252 INFO:teuthology.orchestra.run.trial116.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:23:00.270 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:00.271 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:23:00.271 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:00.292 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-fuse 2026-02-19T08:23:00.606 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:48 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:00.691 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:00.692 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:00.692 INFO:teuthology.orchestra.run.trial116.stdout: Package Architecture Version Repository Size 2026-02-19T08:23:00.692 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:00.692 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:23:00.692 INFO:teuthology.orchestra.run.trial116.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-19T08:23:00.692 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:00.692 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:23:00.692 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:00.692 INFO:teuthology.orchestra.run.trial116.stdout:Install 1 Package 2026-02-19T08:23:00.693 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:00.693 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 1.2 M 2026-02-19T08:23:00.693 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 3.6 M 2026-02-19T08:23:00.693 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:23:01.290 INFO:teuthology.orchestra.run.trial116.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 1.9 MB/s | 1.2 MB 00:00 2026-02-19T08:23:01.291 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:23:01.291 INFO:teuthology.orchestra.run.trial116.stdout:Total 1.9 MB/s | 1.2 MB 00:00 2026-02-19T08:23:01.291 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:23:01.295 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:23:01.295 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:23:01.329 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:23:01.329 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:23:01.430 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:23:01.447 INFO:teuthology.orchestra.run.trial116.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:01.652 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:01.709 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:01.709 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:01.709 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:23:01.709 INFO:teuthology.orchestra.run.trial116.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:23:01.709 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:01.709 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:01.737 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install ceph-volume 2026-02-19T08:23:02.051 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:50 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:02.117 INFO:teuthology.orchestra.run.trial116.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-19T08:23:02.135 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:02.136 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:23:02.136 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:02.158 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install librados-devel 2026-02-19T08:23:02.471 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:50 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:02.555 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:02.556 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:02.556 INFO:teuthology.orchestra.run.trial116.stdout: Package Arch Version Repo Size 2026-02-19T08:23:02.556 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:02.556 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:23:02.556 INFO:teuthology.orchestra.run.trial116.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-19T08:23:02.556 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:02.556 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:23:02.556 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:02.556 INFO:teuthology.orchestra.run.trial116.stdout:Install 1 Package 2026-02-19T08:23:02.556 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:02.557 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 126 k 2026-02-19T08:23:02.557 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 456 k 2026-02-19T08:23:02.557 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:23:02.822 INFO:teuthology.orchestra.run.trial116.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 475 kB/s | 126 kB 00:00 2026-02-19T08:23:02.823 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:23:02.823 INFO:teuthology.orchestra.run.trial116.stdout:Total 473 kB/s | 126 kB 00:00 2026-02-19T08:23:02.823 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:23:02.826 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:23:02.826 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:23:02.858 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:23:02.858 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:23:02.913 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:23:02.929 INFO:teuthology.orchestra.run.trial116.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:03.012 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:03.070 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:03.071 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:03.071 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:23:03.071 INFO:teuthology.orchestra.run.trial116.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:23:03.071 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:03.071 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:03.099 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install libcephfs2 2026-02-19T08:23:03.409 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:51 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:03.474 INFO:teuthology.orchestra.run.trial116.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:23:03.492 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:03.493 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:23:03.493 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:03.515 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install libcephfs-devel 2026-02-19T08:23:03.823 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:51 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:03.908 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:03.908 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout: Package Arch Version Repo Size 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout:Install 1 Package 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 34 k 2026-02-19T08:23:03.909 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 153 k 2026-02-19T08:23:03.910 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:23:04.082 INFO:teuthology.orchestra.run.trial116.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 193 kB/s | 34 kB 00:00 2026-02-19T08:23:04.083 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:23:04.083 INFO:teuthology.orchestra.run.trial116.stdout:Total 192 kB/s | 34 kB 00:00 2026-02-19T08:23:04.083 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:23:04.085 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:23:04.085 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:23:04.088 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:23:04.088 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:23:04.108 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:23:04.125 INFO:teuthology.orchestra.run.trial116.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:04.179 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:04.237 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:04.237 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:04.237 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:23:04.238 INFO:teuthology.orchestra.run.trial116.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:23:04.238 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:04.238 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:04.267 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install librados2 2026-02-19T08:23:04.580 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:52 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:04.646 INFO:teuthology.orchestra.run.trial116.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:23:04.664 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:04.665 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:23:04.665 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:04.686 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install librbd1 2026-02-19T08:23:05.000 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:52 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:05.065 INFO:teuthology.orchestra.run.trial116.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:23:05.083 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:05.084 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:23:05.084 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:05.105 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install python3-rados 2026-02-19T08:23:05.415 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:53 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:05.481 INFO:teuthology.orchestra.run.trial116.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:23:05.500 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:05.500 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:23:05.500 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:05.522 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install python3-rgw 2026-02-19T08:23:05.834 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:53 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:05.900 INFO:teuthology.orchestra.run.trial116.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:23:05.919 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:05.919 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:23:05.919 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:05.941 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install python3-cephfs 2026-02-19T08:23:06.248 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:54 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:06.312 INFO:teuthology.orchestra.run.trial116.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:23:06.330 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:06.331 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:23:06.331 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:06.352 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install python3-rbd 2026-02-19T08:23:06.660 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:54 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:06.725 INFO:teuthology.orchestra.run.trial116.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-19T08:23:06.744 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:06.744 INFO:teuthology.orchestra.run.trial116.stdout:Nothing to do. 2026-02-19T08:23:06.744 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:06.766 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install rbd-fuse 2026-02-19T08:23:07.077 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:55 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:07.160 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:07.161 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:07.161 INFO:teuthology.orchestra.run.trial116.stdout: Package Architecture Version Repository Size 2026-02-19T08:23:07.161 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:07.161 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:23:07.161 INFO:teuthology.orchestra.run.trial116.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-19T08:23:07.161 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:07.161 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:23:07.162 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:07.162 INFO:teuthology.orchestra.run.trial116.stdout:Install 1 Package 2026-02-19T08:23:07.162 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:07.162 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 85 k 2026-02-19T08:23:07.162 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 227 k 2026-02-19T08:23:07.162 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:23:07.484 INFO:teuthology.orchestra.run.trial116.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 263 kB/s | 85 kB 00:00 2026-02-19T08:23:07.485 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:23:07.485 INFO:teuthology.orchestra.run.trial116.stdout:Total 262 kB/s | 85 kB 00:00 2026-02-19T08:23:07.485 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:23:07.489 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:23:07.489 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:23:07.520 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:23:07.520 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:23:07.571 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:23:07.588 INFO:teuthology.orchestra.run.trial116.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:07.672 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:07.730 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:07.730 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:07.730 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:23:07.730 INFO:teuthology.orchestra.run.trial116.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:23:07.730 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:07.731 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:07.759 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install rbd-mirror 2026-02-19T08:23:08.070 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:56 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:08.153 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:08.154 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:08.154 INFO:teuthology.orchestra.run.trial116.stdout: Package Arch Version Repo Size 2026-02-19T08:23:08.154 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:08.154 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:23:08.154 INFO:teuthology.orchestra.run.trial116.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-19T08:23:08.155 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:08.155 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:23:08.155 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:08.155 INFO:teuthology.orchestra.run.trial116.stdout:Install 1 Package 2026-02-19T08:23:08.155 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:08.155 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 3.1 M 2026-02-19T08:23:08.155 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 13 M 2026-02-19T08:23:08.155 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:23:09.379 INFO:teuthology.orchestra.run.trial116.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 2.5 MB/s | 3.1 MB 00:01 2026-02-19T08:23:09.379 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:23:09.380 INFO:teuthology.orchestra.run.trial116.stdout:Total 2.5 MB/s | 3.1 MB 00:01 2026-02-19T08:23:09.380 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:23:09.383 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:23:09.383 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:23:09.426 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:23:09.426 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:23:09.628 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:23:09.630 INFO:teuthology.orchestra.run.trial116.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:09.653 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:09.653 INFO:teuthology.orchestra.run.trial116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-19T08:23:09.653 INFO:teuthology.orchestra.run.trial116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-19T08:23:09.653 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-19T08:23:09.653 INFO:teuthology.orchestra.run.trial116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-19T08:23:09.653 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:09.963 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:09.963 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:09.963 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:23:09.964 INFO:teuthology.orchestra.run.trial116.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:23:09.964 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:09.964 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:09.991 DEBUG:teuthology.orchestra.run.trial116:> sudo yum -y install rbd-nbd 2026-02-19T08:23:10.304 INFO:teuthology.orchestra.run.trial116.stdout:Last metadata expiration check: 0:00:58 ago on Thu 19 Feb 2026 08:22:12 AM UTC. 2026-02-19T08:23:10.389 INFO:teuthology.orchestra.run.trial116.stdout:Dependencies resolved. 2026-02-19T08:23:10.389 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:10.389 INFO:teuthology.orchestra.run.trial116.stdout: Package Architecture Version Repository Size 2026-02-19T08:23:10.390 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:10.390 INFO:teuthology.orchestra.run.trial116.stdout:Installing: 2026-02-19T08:23:10.390 INFO:teuthology.orchestra.run.trial116.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-19T08:23:10.390 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:10.390 INFO:teuthology.orchestra.run.trial116.stdout:Transaction Summary 2026-02-19T08:23:10.390 INFO:teuthology.orchestra.run.trial116.stdout:================================================================================ 2026-02-19T08:23:10.390 INFO:teuthology.orchestra.run.trial116.stdout:Install 1 Package 2026-02-19T08:23:10.390 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:10.390 INFO:teuthology.orchestra.run.trial116.stdout:Total download size: 171 k 2026-02-19T08:23:10.390 INFO:teuthology.orchestra.run.trial116.stdout:Installed size: 490 k 2026-02-19T08:23:10.391 INFO:teuthology.orchestra.run.trial116.stdout:Downloading Packages: 2026-02-19T08:23:10.842 INFO:teuthology.orchestra.run.trial116.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 378 kB/s | 171 kB 00:00 2026-02-19T08:23:10.843 INFO:teuthology.orchestra.run.trial116.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:23:10.843 INFO:teuthology.orchestra.run.trial116.stdout:Total 377 kB/s | 171 kB 00:00 2026-02-19T08:23:10.843 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction check 2026-02-19T08:23:10.847 INFO:teuthology.orchestra.run.trial116.stdout:Transaction check succeeded. 2026-02-19T08:23:10.847 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction test 2026-02-19T08:23:10.878 INFO:teuthology.orchestra.run.trial116.stdout:Transaction test succeeded. 2026-02-19T08:23:10.878 INFO:teuthology.orchestra.run.trial116.stdout:Running transaction 2026-02-19T08:23:10.934 INFO:teuthology.orchestra.run.trial116.stdout: Preparing : 1/1 2026-02-19T08:23:10.951 INFO:teuthology.orchestra.run.trial116.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:11.038 INFO:teuthology.orchestra.run.trial116.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:11.096 INFO:teuthology.orchestra.run.trial116.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-19T08:23:11.096 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:11.096 INFO:teuthology.orchestra.run.trial116.stdout:Installed: 2026-02-19T08:23:11.096 INFO:teuthology.orchestra.run.trial116.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-19T08:23:11.096 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:11.097 INFO:teuthology.orchestra.run.trial116.stdout:Complete! 2026-02-19T08:23:11.128 DEBUG:teuthology.parallel:result is None 2026-02-19T08:23:11.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-19T08:23:11.247 DEBUG:teuthology.orchestra.run.trial027:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-19T08:23:11.268 INFO:teuthology.orchestra.run.trial027.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-19T08:23:11.268 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-19T08:23:11.269 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-19T08:23:11.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-19T08:23:11.411 DEBUG:teuthology.orchestra.run.trial116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-19T08:23:11.432 INFO:teuthology.orchestra.run.trial116.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-19T08:23:11.432 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-19T08:23:11.432 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-19T08:23:11.434 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-19T08:23:11.434 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:11.434 DEBUG:teuthology.orchestra.run.trial027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-19T08:23:11.461 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:23:11.461 DEBUG:teuthology.orchestra.run.trial116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-19T08:23:11.496 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-19T08:23:11.496 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:11.496 DEBUG:teuthology.orchestra.run.trial027:> sudo dd of=/usr/bin/daemon-helper 2026-02-19T08:23:11.524 DEBUG:teuthology.orchestra.run.trial027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-19T08:23:11.587 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:23:11.587 DEBUG:teuthology.orchestra.run.trial116:> sudo dd of=/usr/bin/daemon-helper 2026-02-19T08:23:11.612 DEBUG:teuthology.orchestra.run.trial116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-19T08:23:11.677 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-19T08:23:11.677 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:11.677 DEBUG:teuthology.orchestra.run.trial027:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-19T08:23:11.701 DEBUG:teuthology.orchestra.run.trial027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-19T08:23:11.764 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:23:11.764 DEBUG:teuthology.orchestra.run.trial116:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-19T08:23:11.789 DEBUG:teuthology.orchestra.run.trial116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-19T08:23:11.851 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-19T08:23:11.851 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:11.851 DEBUG:teuthology.orchestra.run.trial027:> sudo dd of=/usr/bin/stdin-killer 2026-02-19T08:23:11.877 DEBUG:teuthology.orchestra.run.trial027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-19T08:23:11.943 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:23:11.943 DEBUG:teuthology.orchestra.run.trial116:> sudo dd of=/usr/bin/stdin-killer 2026-02-19T08:23:11.969 DEBUG:teuthology.orchestra.run.trial116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-19T08:23:12.033 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-19T08:23:12.121 INFO:tasks.cephadm:Config: {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-19T08:23:12.121 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-19T08:23:12.125 INFO:tasks.cephadm:Cluster fsid is 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:12.125 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-19T08:23:12.125 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.27'} 2026-02-19T08:23:12.125 INFO:tasks.cephadm:First mon is mon.a on trial027 2026-02-19T08:23:12.125 INFO:tasks.cephadm:First mgr is a 2026-02-19T08:23:12.125 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-19T08:23:12.125 DEBUG:teuthology.orchestra.run.trial027:> sudo hostname $(hostname -s) 2026-02-19T08:23:12.150 DEBUG:teuthology.orchestra.run.trial116:> sudo hostname $(hostname -s) 2026-02-19T08:23:12.175 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-19T08:23:12.175 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-19T08:23:12.291 INFO:tasks.cephadm:builder_project result: [{'url': 'https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/', 'ref': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-13 10:53:47.064288', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '19.2.3-705-g04cf6dd4', 'package_manager_version': '19.2.3-705.g04cf6dd4', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2966/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-19T08:23:12.421 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-bharath19-testing-2026-02-13-0903-squid, sha1 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-19T08:23:12.422 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/x86_64/flavors/default/cephadm 2026-02-19T08:23:12.422 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/x86_64/flavors/default/cephadm 2026-02-19T08:23:12.422 DEBUG:teuthology.orchestra.run.trial027:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-19T08:23:13.323 INFO:teuthology.orchestra.run.trial027.stdout:-rw-r--r--. 1 ubuntu ubuntu 788257 Feb 19 08:23 /home/ubuntu/cephtest/cephadm 2026-02-19T08:23:13.324 DEBUG:teuthology.orchestra.run.trial116:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-19T08:23:13.917 INFO:teuthology.orchestra.run.trial116.stdout:-rw-r--r--. 1 ubuntu ubuntu 788257 Feb 19 08:23 /home/ubuntu/cephtest/cephadm 2026-02-19T08:23:13.917 DEBUG:teuthology.orchestra.run.trial027:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-19T08:23:13.936 DEBUG:teuthology.orchestra.run.trial116:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-19T08:23:13.968 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e on all hosts... 2026-02-19T08:23:13.968 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e pull 2026-02-19T08:23:13.979 DEBUG:teuthology.orchestra.run.trial116:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e pull 2026-02-19T08:23:14.217 INFO:teuthology.orchestra.run.trial027.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e... 2026-02-19T08:23:14.236 INFO:teuthology.orchestra.run.trial116.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e... 2026-02-19T08:23:22.847 INFO:teuthology.orchestra.run.trial027.stdout:{ 2026-02-19T08:23:22.847 INFO:teuthology.orchestra.run.trial027.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-19T08:23:22.848 INFO:teuthology.orchestra.run.trial027.stdout: "image_id": "c14711ab021379ae69df099a7c56897872be92f7e323d46f96413a3a8067c281", 2026-02-19T08:23:22.848 INFO:teuthology.orchestra.run.trial027.stdout: "repo_digests": [ 2026-02-19T08:23:22.848 INFO:teuthology.orchestra.run.trial027.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:3573b5a0b07ea146a54b8706cbab3eb32397c9c5cf8be33835084322dcf44ee1" 2026-02-19T08:23:22.848 INFO:teuthology.orchestra.run.trial027.stdout: ] 2026-02-19T08:23:22.848 INFO:teuthology.orchestra.run.trial027.stdout:} 2026-02-19T08:23:26.146 INFO:teuthology.orchestra.run.trial116.stdout:{ 2026-02-19T08:23:26.146 INFO:teuthology.orchestra.run.trial116.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-19T08:23:26.146 INFO:teuthology.orchestra.run.trial116.stdout: "image_id": "c14711ab021379ae69df099a7c56897872be92f7e323d46f96413a3a8067c281", 2026-02-19T08:23:26.146 INFO:teuthology.orchestra.run.trial116.stdout: "repo_digests": [ 2026-02-19T08:23:26.146 INFO:teuthology.orchestra.run.trial116.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:3573b5a0b07ea146a54b8706cbab3eb32397c9c5cf8be33835084322dcf44ee1" 2026-02-19T08:23:26.146 INFO:teuthology.orchestra.run.trial116.stdout: ] 2026-02-19T08:23:26.146 INFO:teuthology.orchestra.run.trial116.stdout:} 2026-02-19T08:23:26.164 DEBUG:teuthology.orchestra.run.trial027:> sudo mkdir -p /etc/ceph 2026-02-19T08:23:26.192 DEBUG:teuthology.orchestra.run.trial116:> sudo mkdir -p /etc/ceph 2026-02-19T08:23:26.238 DEBUG:teuthology.orchestra.run.trial027:> sudo chmod 777 /etc/ceph 2026-02-19T08:23:26.262 DEBUG:teuthology.orchestra.run.trial116:> sudo chmod 777 /etc/ceph 2026-02-19T08:23:26.287 INFO:tasks.cephadm:Writing seed config... 2026-02-19T08:23:26.288 INFO:tasks.cephadm: override: [client] debug client = 20 2026-02-19T08:23:26.289 INFO:tasks.cephadm: override: [client] debug mgrc = 20 2026-02-19T08:23:26.289 INFO:tasks.cephadm: override: [client] debug ms = 1 2026-02-19T08:23:26.289 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2026-02-19T08:23:26.289 INFO:tasks.cephadm: override: [mds] debug mgrc = 20 2026-02-19T08:23:26.289 INFO:tasks.cephadm: override: [mgr] debug client = 20 2026-02-19T08:23:26.289 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-19T08:23:26.289 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-19T08:23:26.289 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-19T08:23:26.289 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] bluestore allocator = stupid 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] debug mgrc = 20 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2026-02-19T08:23:26.290 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-19T08:23:26.291 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-19T08:23:26.291 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-19T08:23:26.291 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-19T08:23:26.291 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-19T08:23:26.292 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:26.292 DEBUG:teuthology.orchestra.run.trial027:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-19T08:23:26.319 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = stupid bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug mgrc = 20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug client = 20 debug mgrc = 20 debug ms = 1 [mds] debug mgrc = 20 2026-02-19T08:23:26.319 DEBUG:teuthology.orchestra.run.trial027:mon.a> sudo journalctl -f -n 0 -u ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mon.a.service 2026-02-19T08:23:26.361 DEBUG:teuthology.orchestra.run.trial027:mgr.a> sudo journalctl -f -n 0 -u ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mgr.a.service 2026-02-19T08:23:26.404 INFO:tasks.cephadm:Bootstrapping... 2026-02-19T08:23:26.404 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e -v bootstrap --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.27 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-19T08:23:26.538 INFO:teuthology.orchestra.run.trial027.stdout:-------------------------------------------------------------------------------- 2026-02-19T08:23:26.538 INFO:teuthology.orchestra.run.trial027.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', '-v', 'bootstrap', '--fsid', '3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.27', '--skip-admin-label'] 2026-02-19T08:23:26.539 INFO:teuthology.orchestra.run.trial027.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-19T08:23:26.539 INFO:teuthology.orchestra.run.trial027.stdout:Verifying podman|docker is present... 2026-02-19T08:23:26.556 INFO:teuthology.orchestra.run.trial027.stdout:/bin/podman: stdout 5.6.0 2026-02-19T08:23:26.556 INFO:teuthology.orchestra.run.trial027.stdout:Verifying lvm2 is present... 2026-02-19T08:23:26.556 INFO:teuthology.orchestra.run.trial027.stdout:Verifying time synchronization is in place... 2026-02-19T08:23:26.562 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-19T08:23:26.562 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-19T08:23:26.568 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-19T08:23:26.568 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout inactive 2026-02-19T08:23:26.573 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout enabled 2026-02-19T08:23:26.579 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout active 2026-02-19T08:23:26.579 INFO:teuthology.orchestra.run.trial027.stdout:Unit chronyd.service is enabled and running 2026-02-19T08:23:26.579 INFO:teuthology.orchestra.run.trial027.stdout:Repeating the final host check... 2026-02-19T08:23:26.594 INFO:teuthology.orchestra.run.trial027.stdout:/bin/podman: stdout 5.6.0 2026-02-19T08:23:26.594 INFO:teuthology.orchestra.run.trial027.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-19T08:23:26.594 INFO:teuthology.orchestra.run.trial027.stdout:systemctl is present 2026-02-19T08:23:26.594 INFO:teuthology.orchestra.run.trial027.stdout:lvcreate is present 2026-02-19T08:23:26.599 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-19T08:23:26.599 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-19T08:23:26.605 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-19T08:23:26.605 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout inactive 2026-02-19T08:23:26.611 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout enabled 2026-02-19T08:23:26.617 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout active 2026-02-19T08:23:26.618 INFO:teuthology.orchestra.run.trial027.stdout:Unit chronyd.service is enabled and running 2026-02-19T08:23:26.618 INFO:teuthology.orchestra.run.trial027.stdout:Host looks OK 2026-02-19T08:23:26.618 INFO:teuthology.orchestra.run.trial027.stdout:Cluster fsid: 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:26.618 INFO:teuthology.orchestra.run.trial027.stdout:Acquiring lock 140288138271520 on /run/cephadm/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460.lock 2026-02-19T08:23:26.618 INFO:teuthology.orchestra.run.trial027.stdout:Lock 140288138271520 acquired on /run/cephadm/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460.lock 2026-02-19T08:23:26.618 INFO:teuthology.orchestra.run.trial027.stdout:Verifying IP 10.20.193.27 port 3300 ... 2026-02-19T08:23:26.619 INFO:teuthology.orchestra.run.trial027.stdout:Verifying IP 10.20.193.27 port 6789 ... 2026-02-19T08:23:26.619 INFO:teuthology.orchestra.run.trial027.stdout:Base mon IP(s) is [10.20.193.27:3300, 10.20.193.27:6789], mon addrv is [v2:10.20.193.27:3300,v1:10.20.193.27:6789] 2026-02-19T08:23:26.622 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.27 metric 102 2026-02-19T08:23:26.622 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.27 metric 102 2026-02-19T08:23:26.622 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-19T08:23:26.624 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-19T08:23:26.625 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-19T08:23:26.625 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-19T08:23:26.628 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-19T08:23:26.628 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-19T08:23:26.628 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-19T08:23:26.628 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-19T08:23:26.628 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout inet6 fe80::926d:9dbf:dae0:2c69/64 scope link noprefixroute 2026-02-19T08:23:26.628 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-19T08:23:26.628 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-19T08:23:26.628 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:6260/64 scope link 2026-02-19T08:23:26.628 INFO:teuthology.orchestra.run.trial027.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-19T08:23:26.629 INFO:teuthology.orchestra.run.trial027.stdout:Mon IP `10.20.193.27` is in CIDR network `10.20.192.0/20` 2026-02-19T08:23:26.629 INFO:teuthology.orchestra.run.trial027.stdout:Mon IP `10.20.193.27` is in CIDR network `10.20.192.0/20` 2026-02-19T08:23:26.629 INFO:teuthology.orchestra.run.trial027.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-19T08:23:26.629 INFO:teuthology.orchestra.run.trial027.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-19T08:23:26.629 INFO:teuthology.orchestra.run.trial027.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e... 2026-02-19T08:23:26.864 INFO:teuthology.orchestra.run.trial027.stdout:/bin/podman: stdout c14711ab021379ae69df099a7c56897872be92f7e323d46f96413a3a8067c281 2026-02-19T08:23:26.864 INFO:teuthology.orchestra.run.trial027.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e... 2026-02-19T08:23:26.864 INFO:teuthology.orchestra.run.trial027.stdout:/bin/podman: stderr Getting image source signatures 2026-02-19T08:23:26.864 INFO:teuthology.orchestra.run.trial027.stdout:/bin/podman: stderr Copying blob sha256:5c1727b62f074b91c1b5940e1a5d1c56ebd5e8678bc6c3d263cfccafcfd02191 2026-02-19T08:23:26.864 INFO:teuthology.orchestra.run.trial027.stdout:/bin/podman: stderr Copying blob sha256:f288f3bfe1f1dd15cb8f17590a708af9d9397de617368b4f9c06e9bc583d4a6b 2026-02-19T08:23:26.864 INFO:teuthology.orchestra.run.trial027.stdout:/bin/podman: stderr Copying config sha256:c14711ab021379ae69df099a7c56897872be92f7e323d46f96413a3a8067c281 2026-02-19T08:23:26.864 INFO:teuthology.orchestra.run.trial027.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-19T08:23:26.987 INFO:teuthology.orchestra.run.trial027.stdout:ceph: stdout ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-19T08:23:26.987 INFO:teuthology.orchestra.run.trial027.stdout:Ceph version: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-19T08:23:26.987 INFO:teuthology.orchestra.run.trial027.stdout:Extracting ceph user uid/gid from container image... 2026-02-19T08:23:27.043 INFO:teuthology.orchestra.run.trial027.stdout:stat: stdout 167 167 2026-02-19T08:23:27.043 INFO:teuthology.orchestra.run.trial027.stdout:Creating initial keys... 2026-02-19T08:23:27.180 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph-authtool: stdout AQB/yJZpWkrnCRAAn7RCF1ibpXa8Z1edLbmfyQ== 2026-02-19T08:23:27.298 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph-authtool: stdout AQB/yJZpxzfhEBAAvtzzZALe/xAuATdfQgLvdA== 2026-02-19T08:23:27.427 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph-authtool: stdout AQB/yJZpPYqYGBAApwvONRrZb23VrVPrT4GZVw== 2026-02-19T08:23:27.428 INFO:teuthology.orchestra.run.trial027.stdout:Creating initial monmap... 2026-02-19T08:23:27.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-19T08:23:27.569 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-19T08:23:27.569 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:27.569 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-19T08:23:27.569 INFO:teuthology.orchestra.run.trial027.stdout:monmaptool for a [v2:10.20.193.27:3300,v1:10.20.193.27:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-19T08:23:27.569 INFO:teuthology.orchestra.run.trial027.stdout:setting min_mon_release = quincy 2026-02-19T08:23:27.569 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/monmaptool: set fsid to 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:27.569 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-19T08:23:27.569 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:27.569 INFO:teuthology.orchestra.run.trial027.stdout:Creating mon... 2026-02-19T08:23:27.705 INFO:teuthology.orchestra.run.trial027.stdout:create mon.a on 2026-02-19T08:23:27.878 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-19T08:23:27.983 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-19T08:23:28.099 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460.target → /etc/systemd/system/ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460.target. 2026-02-19T08:23:28.100 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460.target → /etc/systemd/system/ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460.target. 2026-02-19T08:23:28.228 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mon.a 2026-02-19T08:23:28.228 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mon.a.service: Unit ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mon.a.service not loaded. 2026-02-19T08:23:28.348 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460.target.wants/ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@.service. 2026-02-19T08:23:28.498 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-19T08:23:28.498 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout disabled 2026-02-19T08:23:28.504 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-19T08:23:28.504 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout inactive 2026-02-19T08:23:28.505 INFO:teuthology.orchestra.run.trial027.stdout:firewalld.service is not enabled 2026-02-19T08:23:28.505 INFO:teuthology.orchestra.run.trial027.stdout:Not possible to enable service . firewalld.service is not available 2026-02-19T08:23:28.505 INFO:teuthology.orchestra.run.trial027.stdout:Waiting for mon to start... 2026-02-19T08:23:28.505 INFO:teuthology.orchestra.run.trial027.stdout:Waiting for mon... 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout cluster: 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout id: 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout services: 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.129714s) 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout data: 2026-02-19T08:23:28.664 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout pgs: 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.603+0000 7f3ccff4a640 1 Processor -- start 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.603+0000 7f3ccff4a640 1 -- start start 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.603+0000 7f3ccff4a640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc81094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.603+0000 7f3ccff4a640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc8109aa0 con 0x7f3cc81090d0 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.603+0000 7f3ccdcbf640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc81094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.603+0000 7f3ccdcbf640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc81094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33744/0 (socket says 10.20.193.27:33744) 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.603+0000 7f3ccdcbf640 1 -- 10.20.193.27:0/940497518 learned_addr learned my addr 10.20.193.27:0/940497518 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:28.665 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.603+0000 7f3ccdcbf640 1 -- 10.20.193.27:0/940497518 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc810a2d0 con 0x7f3cc81090d0 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccdcbf640 1 --2- 10.20.193.27:0/940497518 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc81094d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009920 tx=0x7f3cb802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff3c6455aee3933 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccccbd640 1 -- 10.20.193.27:0/940497518 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb803c070 con 0x7f3cc81090d0 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccccbd640 1 -- 10.20.193.27:0/940497518 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb802fae0 con 0x7f3cc81090d0 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccccbd640 1 -- 10.20.193.27:0/940497518 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb802fde0 con 0x7f3cc81090d0 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccff4a640 1 -- 10.20.193.27:0/940497518 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 msgr2=0x7f3cc81094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccff4a640 1 --2- 10.20.193.27:0/940497518 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc81094d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009920 tx=0x7f3cb802ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccff4a640 1 -- 10.20.193.27:0/940497518 shutdown_connections 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccff4a640 1 --2- 10.20.193.27:0/940497518 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc81094d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccff4a640 1 -- 10.20.193.27:0/940497518 >> 10.20.193.27:0/940497518 conn(0x7f3cc807c550 msgr2=0x7f3cc807c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccff4a640 1 -- 10.20.193.27:0/940497518 shutdown_connections 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.605+0000 7f3ccff4a640 1 -- 10.20.193.27:0/940497518 wait complete. 2026-02-19T08:23:28.666 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccff4a640 1 Processor -- start 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccff4a640 1 -- start start 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccff4a640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccff4a640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc810a800 con 0x7f3cc81090d0 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccdcbf640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccdcbf640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc819e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33760/0 (socket says 10.20.193.27:33760) 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccdcbf640 1 -- 10.20.193.27:0/620944640 learned_addr learned my addr 10.20.193.27:0/620944640 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccdcbf640 1 -- 10.20.193.27:0/620944640 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc819ebd0 con 0x7f3cc81090d0 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccdcbf640 1 --2- 10.20.193.27:0/620944640 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc819e690 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009a50 tx=0x7f3cb80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3cb6ffd640 1 -- 10.20.193.27:0/620944640 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb803c050 con 0x7f3cc81090d0 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3cb6ffd640 1 -- 10.20.193.27:0/620944640 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb8048070 con 0x7f3cc81090d0 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccff4a640 1 -- 10.20.193.27:0/620944640 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc819ee60 con 0x7f3cc81090d0 2026-02-19T08:23:28.667 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3cb6ffd640 1 -- 10.20.193.27:0/620944640 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb8043710 con 0x7f3cc81090d0 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3ccff4a640 1 -- 10.20.193.27:0/620944640 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc81a1b50 con 0x7f3cc81090d0 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3cb6ffd640 1 -- 10.20.193.27:0/620944640 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f3cb80438b0 con 0x7f3cc81090d0 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3cb6ffd640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3cb6ffd640 4 mgrc handle_mgr_map Got map version 1 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3cb6ffd640 4 mgrc handle_mgr_map Active mgr is now 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3cb6ffd640 4 mgrc reconnect No active mgr available yet 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.606+0000 7f3cb6ffd640 1 -- 10.20.193.27:0/620944640 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3cb804dc60 con 0x7f3cc81090d0 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.607+0000 7f3ccff4a640 1 -- 10.20.193.27:0/620944640 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc810ade0 con 0x7f3cc81090d0 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.608+0000 7f3cb6ffd640 1 -- 10.20.193.27:0/620944640 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f3cb8043d60 con 0x7f3cc81090d0 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.636+0000 7f3ccff4a640 1 -- 10.20.193.27:0/620944640 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f3cc8197730 con 0x7f3cc81090d0 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.636+0000 7f3cb6ffd640 1 -- 10.20.193.27:0/620944640 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f3cb804d460 con 0x7f3cc81090d0 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.636+0000 7f3ccff4a640 10 mgrc shutdown 2026-02-19T08:23:28.668 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.636+0000 7f3ccff4a640 1 -- 10.20.193.27:0/620944640 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 msgr2=0x7f3cc819e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:28.669 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.637+0000 7f3ccff4a640 1 --2- 10.20.193.27:0/620944640 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc819e690 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009a50 tx=0x7f3cb80047c0 comp rx=0 tx=0).stop 2026-02-19T08:23:28.669 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.637+0000 7f3ccff4a640 1 -- 10.20.193.27:0/620944640 shutdown_connections 2026-02-19T08:23:28.669 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.637+0000 7f3ccff4a640 1 --2- 10.20.193.27:0/620944640 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3cc81090d0 0x7f3cc819e690 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:28.669 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.637+0000 7f3ccff4a640 1 -- 10.20.193.27:0/620944640 >> 10.20.193.27:0/620944640 conn(0x7f3cc807c550 msgr2=0x7f3cc81929a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:28.669 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.637+0000 7f3ccff4a640 1 -- 10.20.193.27:0/620944640 shutdown_connections 2026-02-19T08:23:28.669 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.637+0000 7f3ccff4a640 1 -- 10.20.193.27:0/620944640 wait complete. 2026-02-19T08:23:28.669 INFO:teuthology.orchestra.run.trial027.stdout:mon is available 2026-02-19T08:23:28.669 INFO:teuthology.orchestra.run.trial027.stdout:Assimilating anything we can from ceph.conf... 2026-02-19T08:23:28.822 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:28.822 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout [global] 2026-02-19T08:23:28.822 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout fsid = 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:28.822 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.27:3300,v1:10.20.193.27:6789] 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout [osd] 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-19T08:23:28.823 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.759+0000 7f1af4bde640 1 Processor -- start 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.759+0000 7f1af4bde640 1 -- start start 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.759+0000 7f1af4bde640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af01094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.759+0000 7f1af4bde640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1af0109a80 con 0x7f1af01090b0 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.759+0000 7f1aee575640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af01094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.759+0000 7f1aee575640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af01094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33766/0 (socket says 10.20.193.27:33766) 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.759+0000 7f1aee575640 1 -- 10.20.193.27:0/2227964026 learned_addr learned my addr 10.20.193.27:0/2227964026 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.759+0000 7f1aee575640 1 -- 10.20.193.27:0/2227964026 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af010a2b0 con 0x7f1af01090b0 2026-02-19T08:23:28.824 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.759+0000 7f1aee575640 1 --2- 10.20.193.27:0/2227964026 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af01094b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009920 tx=0x7f1ae402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d66df0c03f7849 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1aed573640 1 -- 10.20.193.27:0/2227964026 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ae403c070 con 0x7f1af01090b0 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1aed573640 1 -- 10.20.193.27:0/2227964026 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ae402fae0 con 0x7f1af01090b0 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1aed573640 1 -- 10.20.193.27:0/2227964026 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ae402fde0 con 0x7f1af01090b0 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 -- 10.20.193.27:0/2227964026 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 msgr2=0x7f1af01094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 --2- 10.20.193.27:0/2227964026 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af01094b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009920 tx=0x7f1ae402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 -- 10.20.193.27:0/2227964026 shutdown_connections 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 --2- 10.20.193.27:0/2227964026 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af01094b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 -- 10.20.193.27:0/2227964026 >> 10.20.193.27:0/2227964026 conn(0x7f1af007c530 msgr2=0x7f1af007c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 -- 10.20.193.27:0/2227964026 shutdown_connections 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 -- 10.20.193.27:0/2227964026 wait complete. 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 Processor -- start 2026-02-19T08:23:28.825 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 -- start start 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af019e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1af4bde640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1af010a7e0 con 0x7f1af01090b0 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1aee575640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af019e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1aee575640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af019e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33782/0 (socket says 10.20.193.27:33782) 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.760+0000 7f1aee575640 1 -- 10.20.193.27:0/117350126 learned_addr learned my addr 10.20.193.27:0/117350126 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1aee575640 1 -- 10.20.193.27:0/117350126 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af019ebf0 con 0x7f1af01090b0 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1aee575640 1 --2- 10.20.193.27:0/117350126 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af019e6b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009a50 tx=0x7f1ae40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1ad77fe640 1 -- 10.20.193.27:0/117350126 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ae403c050 con 0x7f1af01090b0 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1ad77fe640 1 -- 10.20.193.27:0/117350126 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ae4048070 con 0x7f1af01090b0 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1af4bde640 1 -- 10.20.193.27:0/117350126 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af019ee80 con 0x7f1af01090b0 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1ad77fe640 1 -- 10.20.193.27:0/117350126 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ae4043710 con 0x7f1af01090b0 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1af4bde640 1 -- 10.20.193.27:0/117350126 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af01a1b70 con 0x7f1af01090b0 2026-02-19T08:23:28.826 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1ad77fe640 1 -- 10.20.193.27:0/117350126 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f1ae40438b0 con 0x7f1af01090b0 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1ad77fe640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1ad77fe640 4 mgrc handle_mgr_map Got map version 1 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1ad77fe640 4 mgrc handle_mgr_map Active mgr is now 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1ad77fe640 4 mgrc reconnect No active mgr available yet 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1ad77fe640 1 -- 10.20.193.27:0/117350126 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1ae404dc60 con 0x7f1af01090b0 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.761+0000 7f1af4bde640 1 -- 10.20.193.27:0/117350126 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1af010adc0 con 0x7f1af01090b0 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.763+0000 7f1ad77fe640 1 -- 10.20.193.27:0/117350126 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f1ae4043d60 con 0x7f1af01090b0 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.790+0000 7f1af4bde640 1 -- 10.20.193.27:0/117350126 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f1af01a3040 con 0x7f1af01090b0 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.792+0000 7f1ad77fe640 1 -- 10.20.193.27:0/117350126 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f1ae404d460 con 0x7f1af01090b0 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.793+0000 7f1ad77fe640 1 -- 10.20.193.27:0/117350126 <== mon.0 v2:10.20.193.27:3300/0 8 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f1ae403d040 con 0x7f1af01090b0 2026-02-19T08:23:28.827 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.793+0000 7f1af4bde640 10 mgrc shutdown 2026-02-19T08:23:28.828 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.793+0000 7f1af4bde640 1 -- 10.20.193.27:0/117350126 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 msgr2=0x7f1af019e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:28.828 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.793+0000 7f1af4bde640 1 --2- 10.20.193.27:0/117350126 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af019e6b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009a50 tx=0x7f1ae40047c0 comp rx=0 tx=0).stop 2026-02-19T08:23:28.828 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.793+0000 7f1af4bde640 1 -- 10.20.193.27:0/117350126 shutdown_connections 2026-02-19T08:23:28.828 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.793+0000 7f1af4bde640 1 --2- 10.20.193.27:0/117350126 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1af01090b0 0x7f1af019e6b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:28.828 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.793+0000 7f1af4bde640 1 -- 10.20.193.27:0/117350126 >> 10.20.193.27:0/117350126 conn(0x7f1af007c530 msgr2=0x7f1af0192ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:28.828 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.793+0000 7f1af4bde640 1 -- 10.20.193.27:0/117350126 shutdown_connections 2026-02-19T08:23:28.828 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.793+0000 7f1af4bde640 1 -- 10.20.193.27:0/117350126 wait complete. 2026-02-19T08:23:28.828 INFO:teuthology.orchestra.run.trial027.stdout:Generating new minimal ceph.conf... 2026-02-19T08:23:28.978 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.908+0000 7f5eefa00640 1 Processor -- start 2026-02-19T08:23:28.978 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.908+0000 7f5eefa00640 1 -- start start 2026-02-19T08:23:28.978 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.908+0000 7f5eefa00640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee81094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:28.978 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.908+0000 7f5eefa00640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8109a80 con 0x7f5ee81090b0 2026-02-19T08:23:28.978 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.908+0000 7f5eed775640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee81094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:28.978 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.908+0000 7f5eed775640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee81094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33796/0 (socket says 10.20.193.27:33796) 2026-02-19T08:23:28.978 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.908+0000 7f5eed775640 1 -- 10.20.193.27:0/2326894465 learned_addr learned my addr 10.20.193.27:0/2326894465 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:28.978 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.908+0000 7f5eed775640 1 -- 10.20.193.27:0/2326894465 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee810a2b0 con 0x7f5ee81090b0 2026-02-19T08:23:28.978 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5eed775640 1 --2- 10.20.193.27:0/2326894465 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee81094b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009920 tx=0x7f5ed802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9038b084b5821a server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5ed7fff640 1 -- 10.20.193.27:0/2326894465 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ed803c070 con 0x7f5ee81090b0 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5ed7fff640 1 -- 10.20.193.27:0/2326894465 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f5ed8037440 con 0x7f5ee81090b0 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5ed7fff640 1 -- 10.20.193.27:0/2326894465 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ed8035340 con 0x7f5ee81090b0 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5eefa00640 1 -- 10.20.193.27:0/2326894465 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 msgr2=0x7f5ee81094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5eefa00640 1 --2- 10.20.193.27:0/2326894465 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee81094b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009920 tx=0x7f5ed802ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5eefa00640 1 -- 10.20.193.27:0/2326894465 shutdown_connections 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5eefa00640 1 --2- 10.20.193.27:0/2326894465 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee81094b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5eefa00640 1 -- 10.20.193.27:0/2326894465 >> 10.20.193.27:0/2326894465 conn(0x7f5ee807c530 msgr2=0x7f5ee807c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5eefa00640 1 -- 10.20.193.27:0/2326894465 shutdown_connections 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.909+0000 7f5eefa00640 1 -- 10.20.193.27:0/2326894465 wait complete. 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eefa00640 1 Processor -- start 2026-02-19T08:23:28.979 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eefa00640 1 -- start start 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eefa00640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee819edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eefa00640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee810d4e0 con 0x7f5ee81090b0 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eed775640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee819edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eed775640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee819edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33804/0 (socket says 10.20.193.27:33804) 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eed775640 1 -- 10.20.193.27:0/2972356275 learned_addr learned my addr 10.20.193.27:0/2972356275 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eed775640 1 -- 10.20.193.27:0/2972356275 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee819f330 con 0x7f5ee81090b0 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eed775640 1 --2- 10.20.193.27:0/2972356275 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee819edf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8006fd0 tx=0x7f5ed8037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5ed67fc640 1 -- 10.20.193.27:0/2972356275 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ed8045070 con 0x7f5ee81090b0 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eefa00640 1 -- 10.20.193.27:0/2972356275 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee819f5c0 con 0x7f5ee81090b0 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5ed67fc640 1 -- 10.20.193.27:0/2972356275 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f5ed8040450 con 0x7f5ee81090b0 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5ed67fc640 1 -- 10.20.193.27:0/2972356275 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ed803c070 con 0x7f5ee81090b0 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5eefa00640 1 -- 10.20.193.27:0/2972356275 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee81a22b0 con 0x7f5ee81090b0 2026-02-19T08:23:28.980 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5ed67fc640 1 -- 10.20.193.27:0/2972356275 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f5ed804a440 con 0x7f5ee81090b0 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5ed67fc640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5ed67fc640 4 mgrc handle_mgr_map Got map version 1 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5ed67fc640 4 mgrc handle_mgr_map Active mgr is now 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5ed67fc640 4 mgrc reconnect No active mgr available yet 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.910+0000 7f5ed67fc640 1 -- 10.20.193.27:0/2972356275 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5ed8049950 con 0x7f5ee81090b0 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.911+0000 7f5eefa00640 1 -- 10.20.193.27:0/2972356275 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee8109530 con 0x7f5ee81090b0 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.912+0000 7f5ed67fc640 1 -- 10.20.193.27:0/2972356275 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f5ed8049b50 con 0x7f5ee81090b0 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.939+0000 7f5eefa00640 1 -- 10.20.193.27:0/2972356275 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f5ee81a2690 con 0x7f5ee81090b0 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.940+0000 7f5ed67fc640 1 -- 10.20.193.27:0/2972356275 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f5ed8049d30 con 0x7f5ee81090b0 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.940+0000 7f5eefa00640 10 mgrc shutdown 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.940+0000 7f5eefa00640 1 -- 10.20.193.27:0/2972356275 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 msgr2=0x7f5ee819edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:28.981 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.940+0000 7f5eefa00640 1 --2- 10.20.193.27:0/2972356275 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee819edf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8006fd0 tx=0x7f5ed8037b70 comp rx=0 tx=0).stop 2026-02-19T08:23:28.982 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.940+0000 7f5eefa00640 1 -- 10.20.193.27:0/2972356275 shutdown_connections 2026-02-19T08:23:28.982 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.940+0000 7f5eefa00640 1 --2- 10.20.193.27:0/2972356275 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5ee81090b0 0x7f5ee819edf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:28.982 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.940+0000 7f5eefa00640 1 -- 10.20.193.27:0/2972356275 >> 10.20.193.27:0/2972356275 conn(0x7f5ee807c530 msgr2=0x7f5ee8106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:28.982 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.940+0000 7f5eefa00640 1 -- 10.20.193.27:0/2972356275 shutdown_connections 2026-02-19T08:23:28.982 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:28.940+0000 7f5eefa00640 1 -- 10.20.193.27:0/2972356275 wait complete. 2026-02-19T08:23:28.982 INFO:teuthology.orchestra.run.trial027.stdout:Restarting the monitor... 2026-02-19T08:23:29.153 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mon-a[21299]: 2026-02-19T08:23:29.048+0000 7f331dac6640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-19T08:23:29.153 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 podman[21585]: 2026-02-19 08:23:29.150294511 +0000 UTC m=+0.114677778 container died f9123ed72afe38701b72bbec4051fcea8f5d38e05e41050b8abec9cec56bf531 (image=quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, name=ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mon-a, org.label-schema.build-date=20260209, CEPH_REF=wip-bharath19-testing-2026-02-13-0903-squid, CEPH_SHA1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-19T08:23:29.344 INFO:teuthology.orchestra.run.trial027.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-19T08:23:29.404 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 podman[21585]: 2026-02-19 08:23:29.159351194 +0000 UTC m=+0.123734461 container remove f9123ed72afe38701b72bbec4051fcea8f5d38e05e41050b8abec9cec56bf531 (image=quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, name=ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mon-a, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260209, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-bharath19-testing-2026-02-13-0903-squid, CEPH_SHA1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2026-02-19T08:23:29.404 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 bash[21585]: ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mon-a 2026-02-19T08:23:29.405 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 systemd[1]: ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-19T08:23:29.405 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 systemd[1]: Stopped Ceph mon.a for 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460. 2026-02-19T08:23:29.405 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 systemd[1]: Starting Ceph mon.a for 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460... 2026-02-19T08:23:29.405 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 podman[21713]: 2026-02-19 08:23:29.306429341 +0000 UTC m=+0.016106312 container create 881de0377e559c1fc22c4eb0095cb305e88a9b47cedac32702dda71e3a1a3fe9 (image=quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, name=ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mon-a, CEPH_REF=wip-bharath19-testing-2026-02-13-0903-squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_SHA1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, ceph=True, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-19T08:23:29.405 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 podman[21713]: 2026-02-19 08:23:29.334111424 +0000 UTC m=+0.043788315 container init 881de0377e559c1fc22c4eb0095cb305e88a9b47cedac32702dda71e3a1a3fe9 (image=quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, name=ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260209, CEPH_SHA1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_REF=wip-bharath19-testing-2026-02-13-0903-squid) 2026-02-19T08:23:29.405 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 podman[21713]: 2026-02-19 08:23:29.336597773 +0000 UTC m=+0.046274664 container start 881de0377e559c1fc22c4eb0095cb305e88a9b47cedac32702dda71e3a1a3fe9 (image=quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, name=ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260209, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, CEPH_REF=wip-bharath19-testing-2026-02-13-0903-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_SHA1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, OSD_FLAVOR=default) 2026-02-19T08:23:29.405 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 bash[21713]: 881de0377e559c1fc22c4eb0095cb305e88a9b47cedac32702dda71e3a1a3fe9 2026-02-19T08:23:29.405 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 podman[21713]: 2026-02-19 08:23:29.300161427 +0000 UTC m=+0.009838328 image pull c14711ab021379ae69df099a7c56897872be92f7e323d46f96413a3a8067c281 quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-19T08:23:29.405 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 systemd[1]: Started Ceph mon.a for 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460. 2026-02-19T08:23:29.405 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: set uid:gid to 167:167 (ceph:ceph) 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable), process ceph-mon, pid 2 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: pidfile_write: ignore empty --pid-file 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: load: jerasure load: lrc 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: RocksDB version: 7.9.2 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Git sha 0 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Compile date 2026-02-13 10:09:30 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: DB SUMMARY 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: DB Session ID: 5LZ7T111RPW2X4HDQK8Z 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: CURRENT file: CURRENT 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: IDENTITY file: IDENTITY 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-19T08:23:29.406 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 82105 ; 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.error_if_exists: 0 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.create_if_missing: 0 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.paranoid_checks: 1 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.env: 0x5641e5a04dc0 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.fs: PosixFileSystem 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.info_log: 0x5641e7c5d880 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_file_opening_threads: 16 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.statistics: (nil) 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.use_fsync: 0 2026-02-19T08:23:29.407 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_log_file_size: 0 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.keep_log_file_num: 1000 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.recycle_log_file_num: 0 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.allow_fallocate: 1 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.allow_mmap_reads: 0 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.allow_mmap_writes: 0 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.use_direct_reads: 0 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.create_missing_column_families: 0 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.db_log_dir: 2026-02-19T08:23:29.408 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.wal_dir: 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.advise_random_on_open: 1 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.db_write_buffer_size: 0 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.write_buffer_manager: 0x5641e7c61900 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-19T08:23:29.409 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.rate_limiter: (nil) 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.wal_recovery_mode: 2 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.enable_thread_tracking: 0 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.enable_pipelined_write: 0 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.unordered_write: 0 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.row_cache: None 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.wal_filter: None 2026-02-19T08:23:29.410 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.allow_ingest_behind: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.two_write_queues: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.manual_wal_flush: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.wal_compression: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.atomic_flush: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.log_readahead_size: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.best_efforts_recovery: 0 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-19T08:23:29.411 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.allow_data_in_errors: 0 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.db_host_id: __hostname__ 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_background_jobs: 2 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_background_compactions: -1 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_subcompactions: 1 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_total_wal_size: 0 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-19T08:23:29.412 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_open_files: -1 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bytes_per_sync: 0 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_readahead_size: 0 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_background_flushes: -1 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Compression algorithms supported: 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: kZSTD supported: 0 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: kXpressCompression supported: 0 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: kBZip2Compression supported: 0 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: kLZ4Compression supported: 1 2026-02-19T08:23:29.413 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: kZlibCompression supported: 1 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: kLZ4HCCompression supported: 1 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: kSnappyCompression supported: 1 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.merge_operator: 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_filter: None 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_filter_factory: None 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.sst_partitioner_factory: None 2026-02-19T08:23:29.414 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5641e7c5c480) 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: cache_index_and_filter_blocks: 1 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: pin_top_level_index_and_filter: 1 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: index_type: 0 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: data_block_index_type: 0 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: index_shortening: 1 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: checksum: 4 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: no_block_cache: 0 2026-02-19T08:23:29.415 INFO:journalctl@ceph.mon.a.trial027.stdout: block_cache: 0x5641e7c81350 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: block_cache_name: BinnedLRUCache 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: block_cache_options: 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: capacity : 536870912 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: num_shard_bits : 4 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: strict_capacity_limit : 0 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: high_pri_pool_ratio: 0.000 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: block_cache_compressed: (nil) 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: persistent_cache: (nil) 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: block_size: 4096 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: block_size_deviation: 10 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: block_restart_interval: 16 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: index_block_restart_interval: 1 2026-02-19T08:23:29.416 INFO:journalctl@ceph.mon.a.trial027.stdout: metadata_block_size: 4096 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: partition_filters: 0 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: use_delta_encoding: 1 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: filter_policy: bloomfilter 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: whole_key_filtering: 1 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: verify_compression: 0 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: read_amp_bytes_per_bit: 0 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: format_version: 5 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: enable_index_compression: 1 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: block_align: 0 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: max_auto_readahead_size: 262144 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: prepopulate_block_cache: 0 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: initial_auto_readahead_size: 8192 2026-02-19T08:23:29.417 INFO:journalctl@ceph.mon.a.trial027.stdout: num_file_reads_for_auto_readahead: 2 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.write_buffer_size: 33554432 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_write_buffer_number: 2 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compression: NoCompression 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bottommost_compression: Disabled 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.prefix_extractor: nullptr 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.num_levels: 7 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-19T08:23:29.418 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compression_opts.level: 32767 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compression_opts.strategy: 0 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-19T08:23:29.419 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compression_opts.enabled: false 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.target_file_size_base: 67108864 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-19T08:23:29.420 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.arena_block_size: 1048576 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.disable_auto_compactions: 0 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-19T08:23:29.421 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.inplace_update_support: 0 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-19T08:23:29.422 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.bloom_locality: 0 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.max_successive_merges: 0 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.paranoid_file_checks: 0 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.force_consistency_checks: 1 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.report_bg_io_stats: 0 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.ttl: 2592000 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.enable_blob_files: false 2026-02-19T08:23:29.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.min_blob_size: 0 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.blob_file_size: 268435456 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.blob_file_starting_level: 0 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d5245f0d-9009-49e2-99cd-af4b41271fb0 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771489409354685, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-19T08:23:29.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771489409355371, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 78541, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 255, "table_properties": {"data_size": 76711, "index_size": 215, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11310, "raw_average_key_size": 50, "raw_value_size": 70489, "raw_average_value_size": 311, "num_data_blocks": 9, "num_entries": 226, "num_filter_entries": 226, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771489409, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d5245f0d-9009-49e2-99cd-af4b41271fb0", "db_session_id": "5LZ7T111RPW2X4HDQK8Z", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771489409355420, "job": 1, "event": "recovery_finished"} 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5641e7c82e00 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: DB pointer 0x5641e7d8e000 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout: ** DB Stats ** 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-19T08:23:29.425 INFO:journalctl@ceph.mon.a.trial027.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: ** Compaction Stats [default] ** 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: L0 2/0 78.56 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 177.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: Sum 2/0 78.56 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 177.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 177.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T08:23:29.426 INFO:journalctl@ceph.mon.a.trial027.stdout: 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: ** Compaction Stats [default] ** 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 177.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-19T08:23:29.427 INFO:journalctl@ceph.mon.a.trial027.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout: Cumulative compaction: 0.00 GB write, 32.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout: Interval compaction: 0.00 GB write, 32.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout: Block cache BinnedLRUCache@0x5641e7c81350#2 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 5e-06 secs_since: 0 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout: 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: starting mon.a rank 0 at public addrs [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] at bind addrs [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: mon.a@-1(???) e1 preinit fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: mon.a@-1(???).mds e1 new map 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: mon.a@-1(???).mds e1 print_map 2026-02-19T08:23:29.428 INFO:journalctl@ceph.mon.a.trial027.stdout: e1 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout: btime 2026-02-19T08:23:28:508473+0000 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout: legacy client fscid: -1 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout: 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout: No filesystems configured 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T08:23:29.429 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-19T08:23:29.506 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.443+0000 7f467b440640 1 Processor -- start 2026-02-19T08:23:29.506 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.444+0000 7f467b440640 1 -- start start 2026-02-19T08:23:29.506 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.444+0000 7f467b440640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f46741094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:29.506 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.444+0000 7f467b440640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4674109aa0 con 0x7f46741090d0 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.444+0000 7f46791b5640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f46741094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.444+0000 7f46791b5640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f46741094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33806/0 (socket says 10.20.193.27:33806) 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.444+0000 7f46791b5640 1 -- 10.20.193.27:0/1263909301 learned_addr learned my addr 10.20.193.27:0/1263909301 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.444+0000 7f46791b5640 1 -- 10.20.193.27:0/1263909301 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467410a2d0 con 0x7f46741090d0 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.445+0000 7f46791b5640 1 --2- 10.20.193.27:0/1263909301 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f46741094d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4664009920 tx=0x7f466402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db36a966d6801e1f server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.445+0000 7f4663fff640 1 -- 10.20.193.27:0/1263909301 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f466403c070 con 0x7f46741090d0 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.445+0000 7f4663fff640 1 -- 10.20.193.27:0/1263909301 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f4664037440 con 0x7f46741090d0 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.445+0000 7f4663fff640 1 -- 10.20.193.27:0/1263909301 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4664035340 con 0x7f46741090d0 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.446+0000 7f467b440640 1 -- 10.20.193.27:0/1263909301 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 msgr2=0x7f46741094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.446+0000 7f467b440640 1 --2- 10.20.193.27:0/1263909301 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f46741094d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4664009920 tx=0x7f466402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.446+0000 7f467b440640 1 -- 10.20.193.27:0/1263909301 shutdown_connections 2026-02-19T08:23:29.507 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.446+0000 7f467b440640 1 --2- 10.20.193.27:0/1263909301 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f46741094d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.446+0000 7f467b440640 1 -- 10.20.193.27:0/1263909301 >> 10.20.193.27:0/1263909301 conn(0x7f467407c550 msgr2=0x7f467407c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.446+0000 7f467b440640 1 -- 10.20.193.27:0/1263909301 shutdown_connections 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.446+0000 7f467b440640 1 -- 10.20.193.27:0/1263909301 wait complete. 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.446+0000 7f467b440640 1 Processor -- start 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.446+0000 7f467b440640 1 -- start start 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f467b440640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f4674080c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f467b440640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f467410d500 con 0x7f46741090d0 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46791b5640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f4674080c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46791b5640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f4674080c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33818/0 (socket says 10.20.193.27:33818) 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46791b5640 1 -- 10.20.193.27:0/2878891393 learned_addr learned my addr 10.20.193.27:0/2878891393 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46791b5640 1 -- 10.20.193.27:0/2878891393 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4674081150 con 0x7f46741090d0 2026-02-19T08:23:29.508 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46791b5640 1 --2- 10.20.193.27:0/2878891393 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f4674080c10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f466402f4a0 tx=0x7f4664035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46627fc640 1 -- 10.20.193.27:0/2878891393 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4664045070 con 0x7f46741090d0 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46627fc640 1 -- 10.20.193.27:0/2878891393 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f4664040450 con 0x7f46741090d0 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f467b440640 1 -- 10.20.193.27:0/2878891393 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46740813e0 con 0x7f46741090d0 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46627fc640 1 -- 10.20.193.27:0/2878891393 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f466403c070 con 0x7f46741090d0 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f467b440640 1 -- 10.20.193.27:0/2878891393 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467407d750 con 0x7f46741090d0 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46627fc640 1 -- 10.20.193.27:0/2878891393 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f466404a440 con 0x7f46741090d0 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46627fc640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46627fc640 4 mgrc handle_mgr_map Got map version 1 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46627fc640 4 mgrc handle_mgr_map Active mgr is now 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46627fc640 4 mgrc reconnect No active mgr available yet 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f46627fc640 1 -- 10.20.193.27:0/2878891393 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f46640498b0 con 0x7f46741090d0 2026-02-19T08:23:29.509 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.447+0000 7f467b440640 1 -- 10.20.193.27:0/2878891393 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4674109550 con 0x7f46741090d0 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.449+0000 7f46627fc640 1 -- 10.20.193.27:0/2878891393 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f4664040600 con 0x7f46741090d0 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.477+0000 7f467b440640 1 -- 10.20.193.27:0/2878891393 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f467407d9f0 con 0x7f46741090d0 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.478+0000 7f46627fc640 1 -- 10.20.193.27:0/2878891393 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 125+0+0 (secure 0 0 0) 0x7f467407d9f0 con 0x7f46741090d0 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.478+0000 7f467b440640 10 mgrc shutdown 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.478+0000 7f467b440640 1 -- 10.20.193.27:0/2878891393 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 msgr2=0x7f4674080c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.478+0000 7f467b440640 1 --2- 10.20.193.27:0/2878891393 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f4674080c10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f466402f4a0 tx=0x7f4664035f80 comp rx=0 tx=0).stop 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.478+0000 7f467b440640 1 -- 10.20.193.27:0/2878891393 shutdown_connections 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.478+0000 7f467b440640 1 --2- 10.20.193.27:0/2878891393 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f46741090d0 0x7f4674080c10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.478+0000 7f467b440640 1 -- 10.20.193.27:0/2878891393 >> 10.20.193.27:0/2878891393 conn(0x7f467407c550 msgr2=0x7f46741065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.478+0000 7f467b440640 1 -- 10.20.193.27:0/2878891393 shutdown_connections 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:29.478+0000 7f467b440640 1 -- 10.20.193.27:0/2878891393 wait complete. 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-19T08:23:29.510 INFO:teuthology.orchestra.run.trial027.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-19T08:23:29.511 INFO:teuthology.orchestra.run.trial027.stdout:Creating mgr... 2026-02-19T08:23:29.511 INFO:teuthology.orchestra.run.trial027.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-19T08:23:29.511 INFO:teuthology.orchestra.run.trial027.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-19T08:23:29.636 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mgr.a 2026-02-19T08:23:29.636 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mgr.a.service: Unit ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mgr.a.service not loaded. 2026-02-19T08:23:29.678 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-19T08:23:29.678 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: monmap epoch 1 2026-02-19T08:23:29.678 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:29.678 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: last_changed 2026-02-19T08:23:27.537335+0000 2026-02-19T08:23:29.678 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: created 2026-02-19T08:23:27.537335+0000 2026-02-19T08:23:29.678 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: min_mon_release 19 (squid) 2026-02-19T08:23:29.679 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: election_strategy: 1 2026-02-19T08:23:29.679 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: 0: [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] mon.a 2026-02-19T08:23:29.679 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: fsmap 2026-02-19T08:23:29.679 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: osdmap e1: 0 total, 0 up, 0 in 2026-02-19T08:23:29.679 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:29 trial027 ceph-mon[21739]: mgrmap e1: no daemons active 2026-02-19T08:23:29.749 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460.target.wants/ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@mgr.a.service → /etc/systemd/system/ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@.service. 2026-02-19T08:23:29.893 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-19T08:23:29.893 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout disabled 2026-02-19T08:23:29.900 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-19T08:23:29.900 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout inactive 2026-02-19T08:23:29.900 INFO:teuthology.orchestra.run.trial027.stdout:firewalld.service is not enabled 2026-02-19T08:23:29.900 INFO:teuthology.orchestra.run.trial027.stdout:Not possible to enable service . firewalld.service is not available 2026-02-19T08:23:29.907 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-19T08:23:29.907 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout disabled 2026-02-19T08:23:29.913 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-19T08:23:29.913 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout inactive 2026-02-19T08:23:29.913 INFO:teuthology.orchestra.run.trial027.stdout:firewalld.service is not enabled 2026-02-19T08:23:29.913 INFO:teuthology.orchestra.run.trial027.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-19T08:23:29.913 INFO:teuthology.orchestra.run.trial027.stdout:Waiting for mgr to start... 2026-02-19T08:23:29.913 INFO:teuthology.orchestra.run.trial027.stdout:Waiting for mgr... 2026-02-19T08:23:30.082 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:30.083 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout { 2026-02-19T08:23:30.083 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "fsid": "3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460", 2026-02-19T08:23:30.083 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "health": { 2026-02-19T08:23:30.083 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-19T08:23:30.083 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-19T08:23:30.083 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-19T08:23:30.083 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:30.083 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-19T08:23:30.083 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-19T08:23:30.083 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 0 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout ], 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "a" 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout ], 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:30.084 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-19T08:23:30.085 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "btime": "2026-02-19T08:23:28:508473+0000", 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-19T08:23:30.086 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "restful" 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout ], 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "modified": "2026-02-19T08:23:28.508971+0000", 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:30.087 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout } 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.017+0000 7fa679292640 1 Processor -- start 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.017+0000 7fa679292640 1 -- start start 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.017+0000 7fa679292640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa6741094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.017+0000 7fa679292640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa674109ac0 con 0x7fa6741090f0 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.018+0000 7fa672ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa6741094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.018+0000 7fa672ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa6741094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33844/0 (socket says 10.20.193.27:33844) 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.018+0000 7fa672ffd640 1 -- 10.20.193.27:0/712795225 learned_addr learned my addr 10.20.193.27:0/712795225 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.018+0000 7fa672ffd640 1 -- 10.20.193.27:0/712795225 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67410a2f0 con 0x7fa6741090f0 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.018+0000 7fa672ffd640 1 --2- 10.20.193.27:0/712795225 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa6741094f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa668009920 tx=0x7fa66802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752a653d10113b0f server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.018+0000 7fa671ffb640 1 -- 10.20.193.27:0/712795225 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66803c070 con 0x7fa6741090f0 2026-02-19T08:23:30.088 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.018+0000 7fa671ffb640 1 -- 10.20.193.27:0/712795225 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa668037440 con 0x7fa6741090f0 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.018+0000 7fa671ffb640 1 -- 10.20.193.27:0/712795225 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa668035340 con 0x7fa6741090f0 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 -- 10.20.193.27:0/712795225 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 msgr2=0x7fa6741094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 --2- 10.20.193.27:0/712795225 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa6741094f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa668009920 tx=0x7fa66802ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 -- 10.20.193.27:0/712795225 shutdown_connections 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 --2- 10.20.193.27:0/712795225 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa6741094f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 -- 10.20.193.27:0/712795225 >> 10.20.193.27:0/712795225 conn(0x7fa67407c610 msgr2=0x7fa67407ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 -- 10.20.193.27:0/712795225 shutdown_connections 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 -- 10.20.193.27:0/712795225 wait complete. 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 Processor -- start 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 -- start start 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa67419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:30.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.019+0000 7fa679292640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa67410d520 con 0x7fa6741090f0 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa672ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa67419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa672ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa67419ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33858/0 (socket says 10.20.193.27:33858) 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa672ffd640 1 -- 10.20.193.27:0/4057886994 learned_addr learned my addr 10.20.193.27:0/4057886994 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa672ffd640 1 -- 10.20.193.27:0/4057886994 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67419f3a0 con 0x7fa6741090f0 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa672ffd640 1 --2- 10.20.193.27:0/4057886994 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa67419ee60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa668006fd0 tx=0x7fa668035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa653fff640 1 -- 10.20.193.27:0/4057886994 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa668045070 con 0x7fa6741090f0 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa679292640 1 -- 10.20.193.27:0/4057886994 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67419f630 con 0x7fa6741090f0 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa653fff640 1 -- 10.20.193.27:0/4057886994 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa668040450 con 0x7fa6741090f0 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa653fff640 1 -- 10.20.193.27:0/4057886994 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa66803c070 con 0x7fa6741090f0 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa679292640 1 -- 10.20.193.27:0/4057886994 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6741a2320 con 0x7fa6741090f0 2026-02-19T08:23:30.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa653fff640 1 -- 10.20.193.27:0/4057886994 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa66804a440 con 0x7fa6741090f0 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa653fff640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa653fff640 4 mgrc handle_mgr_map Got map version 1 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa653fff640 4 mgrc handle_mgr_map Active mgr is now 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa653fff640 4 mgrc reconnect No active mgr available yet 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa653fff640 1 -- 10.20.193.27:0/4057886994 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa668049950 con 0x7fa6741090f0 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.020+0000 7fa679292640 1 -- 10.20.193.27:0/4057886994 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa674109570 con 0x7fa6741090f0 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.022+0000 7fa653fff640 1 -- 10.20.193.27:0/4057886994 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fa668049bf0 con 0x7fa6741090f0 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.050+0000 7fa679292640 1 -- 10.20.193.27:0/4057886994 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa6741a2690 con 0x7fa6741090f0 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.050+0000 7fa653fff640 1 -- 10.20.193.27:0/4057886994 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fa668049dd0 con 0x7fa6741090f0 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.051+0000 7fa679292640 10 mgrc shutdown 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.051+0000 7fa679292640 1 -- 10.20.193.27:0/4057886994 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 msgr2=0x7fa67419ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.051+0000 7fa679292640 1 --2- 10.20.193.27:0/4057886994 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa67419ee60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa668006fd0 tx=0x7fa668035570 comp rx=0 tx=0).stop 2026-02-19T08:23:30.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.051+0000 7fa679292640 1 -- 10.20.193.27:0/4057886994 shutdown_connections 2026-02-19T08:23:30.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.051+0000 7fa679292640 1 --2- 10.20.193.27:0/4057886994 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6741090f0 0x7fa67419ee60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:30.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.051+0000 7fa679292640 1 -- 10.20.193.27:0/4057886994 >> 10.20.193.27:0/4057886994 conn(0x7fa67407c610 msgr2=0x7fa674106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:30.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.051+0000 7fa679292640 1 -- 10.20.193.27:0/4057886994 shutdown_connections 2026-02-19T08:23:30.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:30.051+0000 7fa679292640 1 -- 10.20.193.27:0/4057886994 wait complete. 2026-02-19T08:23:30.092 INFO:teuthology.orchestra.run.trial027.stdout:mgr not available, waiting (1/15)... 2026-02-19T08:23:30.348 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.263+0000 7f10f2d5f140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-19T08:23:30.680 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2878891393' entity='client.admin' 2026-02-19T08:23:30.680 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/4057886994' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-19T08:23:30.680 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.406+0000 7f10f2d5f140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-19T08:23:30.680 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.439+0000 7f10f2d5f140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-19T08:23:30.680 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.480+0000 7f10f2d5f140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-19T08:23:30.680 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.510+0000 7f10f2d5f140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-19T08:23:30.681 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.543+0000 7f10f2d5f140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-19T08:23:30.681 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.607+0000 7f10f2d5f140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-19T08:23:30.681 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-19T08:23:30.681 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-19T08:23:30.681 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: from numpy import show_config as show_numpy_config 2026-02-19T08:23:30.934 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.680+0000 7f10f2d5f140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-19T08:23:30.934 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.713+0000 7f10f2d5f140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-19T08:23:30.934 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.807+0000 7f10f2d5f140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-19T08:23:30.934 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.864+0000 7f10f2d5f140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-19T08:23:30.934 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.898+0000 7f10f2d5f140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-19T08:23:30.934 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.929+0000 7f10f2d5f140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-19T08:23:31.236 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.962+0000 7f10f2d5f140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-19T08:23:31.236 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:30.992+0000 7f10f2d5f140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-19T08:23:31.237 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:31 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:31.232+0000 7f10f2d5f140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-19T08:23:31.487 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:31 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:31.330+0000 7f10f2d5f140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-19T08:23:31.487 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:31 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:31.360+0000 7f10f2d5f140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-19T08:23:31.487 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:31 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:31.390+0000 7f10f2d5f140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-19T08:23:31.487 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:31 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:31.482+0000 7f10f2d5f140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-19T08:23:31.847 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:31 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:31.510+0000 7f10f2d5f140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-19T08:23:31.848 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:31 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:31.603+0000 7f10f2d5f140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-19T08:23:32.250 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:32.250 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout { 2026-02-19T08:23:32.250 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "fsid": "3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460", 2026-02-19T08:23:32.250 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "health": { 2026-02-19T08:23:32.250 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-19T08:23:32.250 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-19T08:23:32.250 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-19T08:23:32.250 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 0 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout ], 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "a" 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout ], 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-19T08:23:32.251 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-19T08:23:32.252 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "btime": "2026-02-19T08:23:28:508473+0000", 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-19T08:23:32.253 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "restful" 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout ], 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:32.254 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "modified": "2026-02-19T08:23:28.508971+0000", 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout } 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.185+0000 7fb056187640 1 Processor -- start 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.185+0000 7fb056187640 1 -- start start 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.185+0000 7fb056187640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb0501094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.185+0000 7fb056187640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb050109ac0 con 0x7fb0501090f0 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.185+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb0501094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.185+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb0501094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33860/0 (socket says 10.20.193.27:33860) 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.185+0000 7fb04f7fe640 1 -- 10.20.193.27:0/2931558035 learned_addr learned my addr 10.20.193.27:0/2931558035 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:32.255 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.186+0000 7fb04f7fe640 1 -- 10.20.193.27:0/2931558035 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05010a2f0 con 0x7fb0501090f0 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.186+0000 7fb04f7fe640 1 --2- 10.20.193.27:0/2931558035 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb0501094f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009920 tx=0x7fb03c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b14cd3739077872 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.186+0000 7fb04e7fc640 1 -- 10.20.193.27:0/2931558035 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03c03c070 con 0x7fb0501090f0 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.186+0000 7fb04e7fc640 1 -- 10.20.193.27:0/2931558035 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fb03c037440 con 0x7fb0501090f0 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.186+0000 7fb04e7fc640 1 -- 10.20.193.27:0/2931558035 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03c035340 con 0x7fb0501090f0 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 -- 10.20.193.27:0/2931558035 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 msgr2=0x7fb0501094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 --2- 10.20.193.27:0/2931558035 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb0501094f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009920 tx=0x7fb03c02ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 -- 10.20.193.27:0/2931558035 shutdown_connections 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 --2- 10.20.193.27:0/2931558035 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb0501094f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 -- 10.20.193.27:0/2931558035 >> 10.20.193.27:0/2931558035 conn(0x7fb05007c610 msgr2=0x7fb05007ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 -- 10.20.193.27:0/2931558035 shutdown_connections 2026-02-19T08:23:32.256 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 -- 10.20.193.27:0/2931558035 wait complete. 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 Processor -- start 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 -- start start 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb05019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb056187640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb05010d520 con 0x7fb0501090f0 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb05019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb05019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33866/0 (socket says 10.20.193.27:33866) 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.187+0000 7fb04f7fe640 1 -- 10.20.193.27:0/347153548 learned_addr learned my addr 10.20.193.27:0/347153548 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04f7fe640 1 -- 10.20.193.27:0/347153548 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05019f3a0 con 0x7fb0501090f0 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04f7fe640 1 --2- 10.20.193.27:0/347153548 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb05019ee60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb03c02f4a0 tx=0x7fb03c035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04cff9640 1 -- 10.20.193.27:0/347153548 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03c045070 con 0x7fb0501090f0 2026-02-19T08:23:32.257 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb056187640 1 -- 10.20.193.27:0/347153548 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05019f630 con 0x7fb0501090f0 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04cff9640 1 -- 10.20.193.27:0/347153548 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fb03c040450 con 0x7fb0501090f0 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04cff9640 1 -- 10.20.193.27:0/347153548 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03c03c070 con 0x7fb0501090f0 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb056187640 1 -- 10.20.193.27:0/347153548 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0501a2320 con 0x7fb0501090f0 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04cff9640 1 -- 10.20.193.27:0/347153548 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fb03c04a440 con 0x7fb0501090f0 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04cff9640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04cff9640 4 mgrc handle_mgr_map Got map version 1 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04cff9640 4 mgrc handle_mgr_map Active mgr is now 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04cff9640 4 mgrc reconnect No active mgr available yet 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb04cff9640 1 -- 10.20.193.27:0/347153548 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb03c049880 con 0x7fb0501090f0 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.188+0000 7fb056187640 1 -- 10.20.193.27:0/347153548 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb050109570 con 0x7fb0501090f0 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.189+0000 7fb04cff9640 1 -- 10.20.193.27:0/347153548 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fb03c040600 con 0x7fb0501090f0 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.218+0000 7fb056187640 1 -- 10.20.193.27:0/347153548 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb0501a2690 con 0x7fb0501090f0 2026-02-19T08:23:32.258 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.218+0000 7fb04cff9640 1 -- 10.20.193.27:0/347153548 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb03c040950 con 0x7fb0501090f0 2026-02-19T08:23:32.259 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.218+0000 7fb056187640 10 mgrc shutdown 2026-02-19T08:23:32.259 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.218+0000 7fb056187640 1 -- 10.20.193.27:0/347153548 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 msgr2=0x7fb05019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:32.259 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.218+0000 7fb056187640 1 --2- 10.20.193.27:0/347153548 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb05019ee60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb03c02f4a0 tx=0x7fb03c035f80 comp rx=0 tx=0).stop 2026-02-19T08:23:32.259 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.218+0000 7fb056187640 1 -- 10.20.193.27:0/347153548 shutdown_connections 2026-02-19T08:23:32.259 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.218+0000 7fb056187640 1 --2- 10.20.193.27:0/347153548 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb0501090f0 0x7fb05019ee60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:32.259 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.218+0000 7fb056187640 1 -- 10.20.193.27:0/347153548 >> 10.20.193.27:0/347153548 conn(0x7fb05007c610 msgr2=0x7fb050106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:32.259 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.218+0000 7fb056187640 1 -- 10.20.193.27:0/347153548 shutdown_connections 2026-02-19T08:23:32.259 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:32.218+0000 7fb056187640 1 -- 10.20.193.27:0/347153548 wait complete. 2026-02-19T08:23:32.259 INFO:teuthology.orchestra.run.trial027.stdout:mgr not available, waiting (2/15)... 2026-02-19T08:23:32.347 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:32 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/347153548' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-19T08:23:32.348 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:32 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:32.056+0000 7f10f2d5f140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-19T08:23:32.348 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:32 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:32.085+0000 7f10f2d5f140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-19T08:23:32.847 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:32 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:32.489+0000 7f10f2d5f140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-19T08:23:33.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: Activating manager daemon a 2026-02-19T08:23:33.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: mgrmap e2: a(active, starting, since 0.00212748s) 2026-02-19T08:23:33.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: from='mgr.14100 10.20.193.27:0/3184666427' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-19T08:23:33.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: from='mgr.14100 10.20.193.27:0/3184666427' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-19T08:23:33.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: from='mgr.14100 10.20.193.27:0/3184666427' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-19T08:23:33.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: from='mgr.14100 10.20.193.27:0/3184666427' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-19T08:23:33.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: from='mgr.14100 10.20.193.27:0/3184666427' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-19T08:23:33.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: Manager daemon a is now available 2026-02-19T08:23:33.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: from='mgr.14100 10.20.193.27:0/3184666427' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-19T08:23:33.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: from='mgr.14100 10.20.193.27:0/3184666427' entity='mgr.a' 2026-02-19T08:23:33.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: from='mgr.14100 10.20.193.27:0/3184666427' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-19T08:23:33.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: from='mgr.14100 10.20.193.27:0/3184666427' entity='mgr.a' 2026-02-19T08:23:33.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:33 trial027 ceph-mon[21739]: from='mgr.14100 10.20.193.27:0/3184666427' entity='mgr.a' 2026-02-19T08:23:34.491 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:34.491 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout { 2026-02-19T08:23:34.491 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "fsid": "3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460", 2026-02-19T08:23:34.491 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "health": { 2026-02-19T08:23:34.491 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 0 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout ], 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "a" 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout ], 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-19T08:23:34.492 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-19T08:23:34.493 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:34.494 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "btime": "2026-02-19T08:23:28:508473+0000", 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "restful" 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout ], 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-19T08:23:34.495 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "modified": "2026-02-19T08:23:28.508971+0000", 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout }, 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout } 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.334+0000 7f1da5571640 1 Processor -- start 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.334+0000 7f1da5571640 1 -- start start 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.335+0000 7f1da5571640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da01094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.335+0000 7f1da5571640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1da0109ac0 con 0x7f1da01090f0 2026-02-19T08:23:34.496 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.335+0000 7f1d9effd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da01094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.335+0000 7f1d9effd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da01094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33934/0 (socket says 10.20.193.27:33934) 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.335+0000 7f1d9effd640 1 -- 10.20.193.27:0/1890830880 learned_addr learned my addr 10.20.193.27:0/1890830880 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.335+0000 7f1d9effd640 1 -- 10.20.193.27:0/1890830880 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da010a2f0 con 0x7f1da01090f0 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1d9effd640 1 --2- 10.20.193.27:0/1890830880 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da01094f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009920 tx=0x7f1d9402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11174b6fdc56718f server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1d9dffb640 1 -- 10.20.193.27:0/1890830880 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d9403c070 con 0x7f1da01090f0 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1d9dffb640 1 -- 10.20.193.27:0/1890830880 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f1d94037440 con 0x7f1da01090f0 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1d9dffb640 1 -- 10.20.193.27:0/1890830880 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d94035340 con 0x7f1da01090f0 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 -- 10.20.193.27:0/1890830880 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 msgr2=0x7f1da01094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 --2- 10.20.193.27:0/1890830880 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da01094f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009920 tx=0x7f1d9402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 -- 10.20.193.27:0/1890830880 shutdown_connections 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 --2- 10.20.193.27:0/1890830880 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da01094f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:34.497 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 -- 10.20.193.27:0/1890830880 >> 10.20.193.27:0/1890830880 conn(0x7f1da007c610 msgr2=0x7f1da007ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 -- 10.20.193.27:0/1890830880 shutdown_connections 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 -- 10.20.193.27:0/1890830880 wait complete. 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 Processor -- start 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 -- start start 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1da5571640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1da010d520 con 0x7f1da01090f0 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1d9effd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1d9effd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33946/0 (socket says 10.20.193.27:33946) 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.336+0000 7f1d9effd640 1 -- 10.20.193.27:0/1643010279 learned_addr learned my addr 10.20.193.27:0/1643010279 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.337+0000 7f1d9effd640 1 -- 10.20.193.27:0/1643010279 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da019f3a0 con 0x7f1da01090f0 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.337+0000 7f1d9effd640 1 --2- 10.20.193.27:0/1643010279 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da019ee60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1d94006fd0 tx=0x7f1d94035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:34.498 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.337+0000 7f1d7ffff640 1 -- 10.20.193.27:0/1643010279 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d94045070 con 0x7f1da01090f0 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.337+0000 7f1d7ffff640 1 -- 10.20.193.27:0/1643010279 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f1d94040450 con 0x7f1da01090f0 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.337+0000 7f1d7ffff640 1 -- 10.20.193.27:0/1643010279 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d9403c070 con 0x7f1da01090f0 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.337+0000 7f1da5571640 1 -- 10.20.193.27:0/1643010279 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da019f630 con 0x7f1da01090f0 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.337+0000 7f1da5571640 1 -- 10.20.193.27:0/1643010279 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da01a2320 con 0x7f1da01090f0 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.337+0000 7f1d7ffff640 1 -- 10.20.193.27:0/1643010279 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 3) ==== 50208+0+0 (secure 0 0 0) 0x7f1d940493b0 con 0x7f1da01090f0 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.337+0000 7f1d7ffff640 20 mgrc handle_mgr_map mgrmap(e 3) 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.337+0000 7f1da5571640 1 -- 10.20.193.27:0/1643010279 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da0109570 con 0x7f1da01090f0 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.338+0000 7f1d7ffff640 4 mgrc handle_mgr_map Got map version 3 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.338+0000 7f1d7ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.338+0000 7f1d7ffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.338+0000 7f1d7ffff640 1 --2- 10.20.193.27:0/1643010279 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1d7403dc20 0x7f1d740400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:34.499 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.338+0000 7f1d7ffff640 1 -- 10.20.193.27:0/1643010279 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1d940766a0 con 0x7f1da01090f0 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.338+0000 7f1d9e7fc640 1 --2- 10.20.193.27:0/1643010279 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1d7403dc20 0x7f1d740400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.338+0000 7f1d9e7fc640 1 --2- 10.20.193.27:0/1643010279 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1d7403dc20 0x7f1d740400e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1d880099c0 tx=0x7f1d88006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.340+0000 7f1d7ffff640 1 -- 10.20.193.27:0/1643010279 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1d94047d40 con 0x7f1da01090f0 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.457+0000 7f1da5571640 1 -- 10.20.193.27:0/1643010279 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1da01a2780 con 0x7f1da01090f0 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.457+0000 7f1d7ffff640 1 -- 10.20.193.27:0/1643010279 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f1d940496d0 con 0x7f1da01090f0 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 10 mgrc shutdown 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 1 -- 10.20.193.27:0/1643010279 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1d7403dc20 msgr2=0x7f1d740400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 1 --2- 10.20.193.27:0/1643010279 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1d7403dc20 0x7f1d740400e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1d880099c0 tx=0x7f1d88006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 1 -- 10.20.193.27:0/1643010279 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 msgr2=0x7f1da019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 1 --2- 10.20.193.27:0/1643010279 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da019ee60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1d94006fd0 tx=0x7f1d94035570 comp rx=0 tx=0).stop 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 1 -- 10.20.193.27:0/1643010279 shutdown_connections 2026-02-19T08:23:34.500 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 1 --2- 10.20.193.27:0/1643010279 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1d7403dc20 0x7f1d740400e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:34.501 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 1 --2- 10.20.193.27:0/1643010279 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1da01090f0 0x7f1da019ee60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:34.501 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 1 -- 10.20.193.27:0/1643010279 >> 10.20.193.27:0/1643010279 conn(0x7f1da007c610 msgr2=0x7f1da0106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:34.501 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 1 -- 10.20.193.27:0/1643010279 shutdown_connections 2026-02-19T08:23:34.501 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.458+0000 7f1da5571640 1 -- 10.20.193.27:0/1643010279 wait complete. 2026-02-19T08:23:34.501 INFO:teuthology.orchestra.run.trial027.stdout:mgr is available 2026-02-19T08:23:34.526 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:34 trial027 ceph-mon[21739]: mgrmap e3: a(active, since 1.00446s) 2026-02-19T08:23:34.526 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:34 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1643010279' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-19T08:23:34.694 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:34.695 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout [global] 2026-02-19T08:23:34.695 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout fsid = 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:34.695 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-19T08:23:34.695 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.27:3300,v1:10.20.193.27:6789] 2026-02-19T08:23:34.695 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-19T08:23:34.695 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-19T08:23:34.695 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-19T08:23:34.695 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-19T08:23:34.695 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:34.695 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout [osd] 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.576+0000 7f8073489640 1 Processor -- start 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.576+0000 7f8073489640 1 -- start start 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.576+0000 7f8073489640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c1094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.576+0000 7f8073489640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f806c109ac0 con 0x7f806c1090f0 2026-02-19T08:23:34.696 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.577+0000 7f80711fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c1094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.577+0000 7f80711fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c1094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33956/0 (socket says 10.20.193.27:33956) 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.577+0000 7f80711fe640 1 -- 10.20.193.27:0/49095861 learned_addr learned my addr 10.20.193.27:0/49095861 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.577+0000 7f80711fe640 1 -- 10.20.193.27:0/49095861 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c10a2f0 con 0x7f806c1090f0 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.577+0000 7f80711fe640 1 --2- 10.20.193.27:0/49095861 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c1094f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f805c009920 tx=0x7f805c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec1fb28079a6f8a server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.577+0000 7f805bfff640 1 -- 10.20.193.27:0/49095861 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c03c070 con 0x7f806c1090f0 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.577+0000 7f805bfff640 1 -- 10.20.193.27:0/49095861 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f805c037440 con 0x7f806c1090f0 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.577+0000 7f805bfff640 1 -- 10.20.193.27:0/49095861 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c035340 con 0x7f806c1090f0 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 -- 10.20.193.27:0/49095861 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 msgr2=0x7f806c1094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 --2- 10.20.193.27:0/49095861 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c1094f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f805c009920 tx=0x7f805c02ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 -- 10.20.193.27:0/49095861 shutdown_connections 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 --2- 10.20.193.27:0/49095861 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c1094f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:34.697 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 -- 10.20.193.27:0/49095861 >> 10.20.193.27:0/49095861 conn(0x7f806c07c610 msgr2=0x7f806c07ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 -- 10.20.193.27:0/49095861 shutdown_connections 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 -- 10.20.193.27:0/49095861 wait complete. 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 Processor -- start 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 -- start start 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f8073489640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f806c10d520 con 0x7f806c1090f0 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f80711fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f80711fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c19ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33966/0 (socket says 10.20.193.27:33966) 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f80711fe640 1 -- 10.20.193.27:0/4092394061 learned_addr learned my addr 10.20.193.27:0/4092394061 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f80711fe640 1 -- 10.20.193.27:0/4092394061 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806c19f3a0 con 0x7f806c1090f0 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f80711fe640 1 --2- 10.20.193.27:0/4092394061 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c19ee60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f805c006fd0 tx=0x7f805c035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:34.698 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.578+0000 7f805a7fc640 1 -- 10.20.193.27:0/4092394061 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c045070 con 0x7f806c1090f0 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f805a7fc640 1 -- 10.20.193.27:0/4092394061 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f805c040450 con 0x7f806c1090f0 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f8073489640 1 -- 10.20.193.27:0/4092394061 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806c19f630 con 0x7f806c1090f0 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f805a7fc640 1 -- 10.20.193.27:0/4092394061 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f805c03c070 con 0x7f806c1090f0 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f8073489640 1 -- 10.20.193.27:0/4092394061 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806c1a2320 con 0x7f806c1090f0 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f8073489640 1 -- 10.20.193.27:0/4092394061 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806c109570 con 0x7f806c1090f0 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f805a7fc640 1 -- 10.20.193.27:0/4092394061 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 4) ==== 50314+0+0 (secure 0 0 0) 0x7f805c0493b0 con 0x7f806c1090f0 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f805a7fc640 20 mgrc handle_mgr_map mgrmap(e 4) 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f805a7fc640 4 mgrc handle_mgr_map Got map version 4 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f805a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f805a7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f805a7fc640 1 --2- 10.20.193.27:0/4092394061 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f804803dd40 0x7f8048040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:34.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f805a7fc640 1 -- 10.20.193.27:0/4092394061 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f805c0767f0 con 0x7f806c1090f0 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.579+0000 7f80709fd640 1 --2- 10.20.193.27:0/4092394061 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f804803dd40 0x7f8048040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.580+0000 7f80709fd640 1 --2- 10.20.193.27:0/4092394061 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f804803dd40 0x7f8048040200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f80600099c0 tx=0x7f8060006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.582+0000 7f805a7fc640 1 -- 10.20.193.27:0/4092394061 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f805c076210 con 0x7f806c1090f0 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.664+0000 7f8073489640 1 -- 10.20.193.27:0/4092394061 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f806c1a3900 con 0x7f806c1090f0 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.665+0000 7f805a7fc640 1 -- 10.20.193.27:0/4092394061 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+465 (secure 0 0 0) 0x7f805c078c30 con 0x7f806c1090f0 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 10 mgrc shutdown 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 1 -- 10.20.193.27:0/4092394061 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f804803dd40 msgr2=0x7f8048040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 1 --2- 10.20.193.27:0/4092394061 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f804803dd40 0x7f8048040200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f80600099c0 tx=0x7f8060006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 1 -- 10.20.193.27:0/4092394061 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 msgr2=0x7f806c19ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 1 --2- 10.20.193.27:0/4092394061 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c19ee60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f805c006fd0 tx=0x7f805c035570 comp rx=0 tx=0).stop 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 1 -- 10.20.193.27:0/4092394061 shutdown_connections 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 1 --2- 10.20.193.27:0/4092394061 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f804803dd40 0x7f8048040200 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:34.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 1 --2- 10.20.193.27:0/4092394061 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f806c1090f0 0x7f806c19ee60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:34.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 1 -- 10.20.193.27:0/4092394061 >> 10.20.193.27:0/4092394061 conn(0x7f806c07c610 msgr2=0x7f806c106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:34.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 1 -- 10.20.193.27:0/4092394061 shutdown_connections 2026-02-19T08:23:34.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.666+0000 7f8073489640 1 -- 10.20.193.27:0/4092394061 wait complete. 2026-02-19T08:23:34.701 INFO:teuthology.orchestra.run.trial027.stdout:Enabling cephadm module... 2026-02-19T08:23:35.531 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.779+0000 7f94ce8c1640 1 Processor -- start 2026-02-19T08:23:35.531 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.779+0000 7f94ce8c1640 1 -- start start 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.779+0000 7f94ce8c1640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c807b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.779+0000 7f94ce8c1640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f94c807b890 con 0x7f94c807cef0 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.779+0000 7f94c7fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c807b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.779+0000 7f94c7fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c807b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33974/0 (socket says 10.20.193.27:33974) 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.779+0000 7f94c7fff640 1 -- 10.20.193.27:0/329857514 learned_addr learned my addr 10.20.193.27:0/329857514 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94c7fff640 1 -- 10.20.193.27:0/329857514 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c807ba10 con 0x7f94c807cef0 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94c7fff640 1 --2- 10.20.193.27:0/329857514 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c807b350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009920 tx=0x7f94b402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91eab7a449d4a445 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94c6ffd640 1 -- 10.20.193.27:0/329857514 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94b403c070 con 0x7f94c807cef0 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94c6ffd640 1 -- 10.20.193.27:0/329857514 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f94b4037440 con 0x7f94c807cef0 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94c6ffd640 1 -- 10.20.193.27:0/329857514 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94b4035340 con 0x7f94c807cef0 2026-02-19T08:23:35.532 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94ce8c1640 1 -- 10.20.193.27:0/329857514 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 msgr2=0x7f94c807b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94ce8c1640 1 --2- 10.20.193.27:0/329857514 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c807b350 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009920 tx=0x7f94b402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94ce8c1640 1 -- 10.20.193.27:0/329857514 shutdown_connections 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94ce8c1640 1 --2- 10.20.193.27:0/329857514 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c807b350 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94ce8c1640 1 -- 10.20.193.27:0/329857514 >> 10.20.193.27:0/329857514 conn(0x7f94c8102640 msgr2=0x7f94c8104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94ce8c1640 1 -- 10.20.193.27:0/329857514 shutdown_connections 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.780+0000 7f94ce8c1640 1 -- 10.20.193.27:0/329857514 wait complete. 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94ce8c1640 1 Processor -- start 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94ce8c1640 1 -- start start 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94ce8c1640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94ce8c1640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f94c810d2c0 con 0x7f94c807cef0 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94c7fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:35.533 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94c7fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c819edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33982/0 (socket says 10.20.193.27:33982) 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94c7fff640 1 -- 10.20.193.27:0/2934313223 learned_addr learned my addr 10.20.193.27:0/2934313223 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94c7fff640 1 -- 10.20.193.27:0/2934313223 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c819f300 con 0x7f94c807cef0 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94c7fff640 1 --2- 10.20.193.27:0/2934313223 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c819edc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f94b4006fd0 tx=0x7f94b4035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94c57fa640 1 -- 10.20.193.27:0/2934313223 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94b4045070 con 0x7f94c807cef0 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94c57fa640 1 -- 10.20.193.27:0/2934313223 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f94b4040450 con 0x7f94c807cef0 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94ce8c1640 1 -- 10.20.193.27:0/2934313223 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c819f590 con 0x7f94c807cef0 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94c57fa640 1 -- 10.20.193.27:0/2934313223 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94b403c070 con 0x7f94c807cef0 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.781+0000 7f94ce8c1640 1 -- 10.20.193.27:0/2934313223 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c81a2280 con 0x7f94c807cef0 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.782+0000 7f94c57fa640 1 -- 10.20.193.27:0/2934313223 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 4) ==== 50314+0+0 (secure 0 0 0) 0x7f94b402fae0 con 0x7f94c807cef0 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.782+0000 7f94c57fa640 20 mgrc handle_mgr_map mgrmap(e 4) 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.782+0000 7f94ce8c1640 1 -- 10.20.193.27:0/2934313223 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c807b3d0 con 0x7f94c807cef0 2026-02-19T08:23:35.534 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.782+0000 7f94c57fa640 4 mgrc handle_mgr_map Got map version 4 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.782+0000 7f94c57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.782+0000 7f94c57fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.782+0000 7f94c57fa640 1 --2- 10.20.193.27:0/2934313223 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f949c03dd40 0x7f949c040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.782+0000 7f94c57fa640 1 -- 10.20.193.27:0/2934313223 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f94b4076800 con 0x7f94c807cef0 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.782+0000 7f94c77fe640 1 --2- 10.20.193.27:0/2934313223 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f949c03dd40 0x7f949c040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.782+0000 7f94c77fe640 1 --2- 10.20.193.27:0/2934313223 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f949c03dd40 0x7f949c040200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94b80099c0 tx=0x7f94b8006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.785+0000 7f94c57fa640 1 -- 10.20.193.27:0/2934313223 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f94b4033200 con 0x7f94c807cef0 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:34.892+0000 7f94ce8c1640 1 -- 10.20.193.27:0/2934313223 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f94c81a26e0 con 0x7f94c807cef0 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.499+0000 7f94c57fa640 1 -- 10.20.193.27:0/2934313223 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f94b4076220 con 0x7f94c807cef0 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.501+0000 7f94c57fa640 1 -- 10.20.193.27:0/2934313223 <== mon.0 v2:10.20.193.27:3300/0 8 ==== mgrmap(e 5) ==== 50325+0+0 (secure 0 0 0) 0x7f94b4078c40 con 0x7f94c807cef0 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.501+0000 7f94c57fa640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-19T08:23:35.535 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.501+0000 7f94c57fa640 4 mgrc handle_mgr_map Got map version 5 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.501+0000 7f94c57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 10 mgrc shutdown 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 1 -- 10.20.193.27:0/2934313223 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f949c03dd40 msgr2=0x7f949c040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 1 --2- 10.20.193.27:0/2934313223 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f949c03dd40 0x7f949c040200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94b80099c0 tx=0x7f94b8006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 1 -- 10.20.193.27:0/2934313223 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 msgr2=0x7f94c819edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 1 --2- 10.20.193.27:0/2934313223 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c819edc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f94b4006fd0 tx=0x7f94b4035570 comp rx=0 tx=0).stop 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 1 -- 10.20.193.27:0/2934313223 shutdown_connections 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 1 --2- 10.20.193.27:0/2934313223 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f949c03dd40 0x7f949c040200 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 1 --2- 10.20.193.27:0/2934313223 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f94c807cef0 0x7f94c819edc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 1 -- 10.20.193.27:0/2934313223 >> 10.20.193.27:0/2934313223 conn(0x7f94c8102640 msgr2=0x7f94c81031f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 1 -- 10.20.193.27:0/2934313223 shutdown_connections 2026-02-19T08:23:35.536 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.502+0000 7f94ce8c1640 1 -- 10.20.193.27:0/2934313223 wait complete. 2026-02-19T08:23:35.758 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:35 trial027 ceph-mon[21739]: mgrmap e4: a(active, since 2s) 2026-02-19T08:23:35.758 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:35 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/4092394061' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-19T08:23:35.759 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:35 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2934313223' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-19T08:23:35.759 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:35 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: ignoring --setuser ceph since I am not root 2026-02-19T08:23:35.759 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:35 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: ignoring --setgroup ceph since I am not root 2026-02-19T08:23:35.779 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout { 2026-02-19T08:23:35.779 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout } 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.621+0000 7f08b6c0f640 1 Processor -- start 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.621+0000 7f08b6c0f640 1 -- start start 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.621+0000 7f08b6c0f640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b01094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.621+0000 7f08b6c0f640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f08b0109ac0 con 0x7f08b01090f0 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.621+0000 7f08b4984640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b01094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.621+0000 7f08b4984640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b01094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:34016/0 (socket says 10.20.193.27:34016) 2026-02-19T08:23:35.780 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.621+0000 7f08b4984640 1 -- 10.20.193.27:0/2237197686 learned_addr learned my addr 10.20.193.27:0/2237197686 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.621+0000 7f08b4984640 1 -- 10.20.193.27:0/2237197686 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b010a2f0 con 0x7f08b01090f0 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.621+0000 7f08b4984640 1 --2- 10.20.193.27:0/2237197686 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b01094f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009920 tx=0x7f08a002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8099f822767d6f48 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08a77fe640 1 -- 10.20.193.27:0/2237197686 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a003c070 con 0x7f08b01090f0 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08a77fe640 1 -- 10.20.193.27:0/2237197686 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f08a0037440 con 0x7f08b01090f0 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08a77fe640 1 -- 10.20.193.27:0/2237197686 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a0035340 con 0x7f08b01090f0 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 -- 10.20.193.27:0/2237197686 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 msgr2=0x7f08b01094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 --2- 10.20.193.27:0/2237197686 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b01094f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009920 tx=0x7f08a002ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 -- 10.20.193.27:0/2237197686 shutdown_connections 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 --2- 10.20.193.27:0/2237197686 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b01094f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 -- 10.20.193.27:0/2237197686 >> 10.20.193.27:0/2237197686 conn(0x7f08b007c610 msgr2=0x7f08b007ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 -- 10.20.193.27:0/2237197686 shutdown_connections 2026-02-19T08:23:35.781 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 -- 10.20.193.27:0/2237197686 wait complete. 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 Processor -- start 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 -- start start 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b6c0f640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f08b010d520 con 0x7f08b01090f0 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b4984640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b4984640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:34022/0 (socket says 10.20.193.27:34022) 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.622+0000 7f08b4984640 1 -- 10.20.193.27:0/3808616354 learned_addr learned my addr 10.20.193.27:0/3808616354 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.623+0000 7f08b4984640 1 -- 10.20.193.27:0/3808616354 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b019f3a0 con 0x7f08b01090f0 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.623+0000 7f08b4984640 1 --2- 10.20.193.27:0/3808616354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b019ee60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f08a002f4a0 tx=0x7f08a0035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.623+0000 7f08a5ffb640 1 -- 10.20.193.27:0/3808616354 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a0045070 con 0x7f08b01090f0 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.623+0000 7f08b6c0f640 1 -- 10.20.193.27:0/3808616354 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b019f630 con 0x7f08b01090f0 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.623+0000 7f08a5ffb640 1 -- 10.20.193.27:0/3808616354 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f08a0040450 con 0x7f08b01090f0 2026-02-19T08:23:35.782 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.623+0000 7f08a5ffb640 1 -- 10.20.193.27:0/3808616354 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a003c070 con 0x7f08b01090f0 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.623+0000 7f08b6c0f640 1 -- 10.20.193.27:0/3808616354 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b01a2320 con 0x7f08b01090f0 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.623+0000 7f08b6c0f640 1 -- 10.20.193.27:0/3808616354 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b019fb10 con 0x7f08b01090f0 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.623+0000 7f08a5ffb640 1 -- 10.20.193.27:0/3808616354 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 5) ==== 50325+0+0 (secure 0 0 0) 0x7f08a00493b0 con 0x7f08b01090f0 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.623+0000 7f08a5ffb640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.624+0000 7f08a5ffb640 4 mgrc handle_mgr_map Got map version 5 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.624+0000 7f08a5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.624+0000 7f08a5ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.624+0000 7f08a5ffb640 1 --2- 10.20.193.27:0/3808616354 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f088c03dd40 0x7f088c040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.624+0000 7f08a5ffb640 1 -- 10.20.193.27:0/3808616354 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f08a0076980 con 0x7f08b01090f0 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.624+0000 7f08a7fff640 1 -- 10.20.193.27:0/3808616354 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f088c03dd40 msgr2=0x7f088c040200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.27:6800/688875344 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.624+0000 7f08a7fff640 1 --2- 10.20.193.27:0/3808616354 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f088c03dd40 0x7f088c040200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-19T08:23:35.783 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.626+0000 7f08a5ffb640 1 -- 10.20.193.27:0/3808616354 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f08b019fb10 con 0x7f08b01090f0 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.731+0000 7f08b6c0f640 1 -- 10.20.193.27:0/3808616354 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f08b01a27c0 con 0x7f08b01090f0 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.731+0000 7f08a5ffb640 1 -- 10.20.193.27:0/3808616354 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f08a00763a0 con 0x7f08b01090f0 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.732+0000 7f08b6c0f640 10 mgrc shutdown 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.733+0000 7f08b6c0f640 1 -- 10.20.193.27:0/3808616354 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f088c03dd40 msgr2=0x7f088c040200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.733+0000 7f08b6c0f640 1 --2- 10.20.193.27:0/3808616354 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f088c03dd40 0x7f088c040200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.733+0000 7f08b6c0f640 1 -- 10.20.193.27:0/3808616354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 msgr2=0x7f08b019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.733+0000 7f08b6c0f640 1 --2- 10.20.193.27:0/3808616354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b019ee60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f08a002f4a0 tx=0x7f08a0035f80 comp rx=0 tx=0).stop 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.733+0000 7f08b6c0f640 1 -- 10.20.193.27:0/3808616354 shutdown_connections 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.733+0000 7f08b6c0f640 1 --2- 10.20.193.27:0/3808616354 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f088c03dd40 0x7f088c040200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.733+0000 7f08b6c0f640 1 --2- 10.20.193.27:0/3808616354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f08b01090f0 0x7f08b019ee60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.733+0000 7f08b6c0f640 1 -- 10.20.193.27:0/3808616354 >> 10.20.193.27:0/3808616354 conn(0x7f08b007c610 msgr2=0x7f08b0106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.733+0000 7f08b6c0f640 1 -- 10.20.193.27:0/3808616354 shutdown_connections 2026-02-19T08:23:35.784 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.733+0000 7f08b6c0f640 1 -- 10.20.193.27:0/3808616354 wait complete. 2026-02-19T08:23:35.785 INFO:teuthology.orchestra.run.trial027.stdout:Waiting for the mgr to restart... 2026-02-19T08:23:35.785 INFO:teuthology.orchestra.run.trial027.stdout:Waiting for mgr epoch 5... 2026-02-19T08:23:36.048 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:35 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:35.903+0000 7f6a8ce58140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-19T08:23:36.049 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.045+0000 7f6a8ce58140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-19T08:23:36.316 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.078+0000 7f6a8ce58140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-19T08:23:36.316 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.118+0000 7f6a8ce58140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-19T08:23:36.316 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.148+0000 7f6a8ce58140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-19T08:23:36.316 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.181+0000 7f6a8ce58140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-19T08:23:36.316 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.245+0000 7f6a8ce58140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-19T08:23:36.316 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-19T08:23:36.317 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-19T08:23:36.317 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: from numpy import show_config as show_numpy_config 2026-02-19T08:23:36.567 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2934313223' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-19T08:23:36.568 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-mon[21739]: mgrmap e5: a(active, since 3s) 2026-02-19T08:23:36.568 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/3808616354' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-19T08:23:36.568 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.316+0000 7f6a8ce58140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-19T08:23:36.568 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.349+0000 7f6a8ce58140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-19T08:23:36.568 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.443+0000 7f6a8ce58140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-19T08:23:36.568 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.499+0000 7f6a8ce58140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-19T08:23:36.568 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.532+0000 7f6a8ce58140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-19T08:23:36.847 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.564+0000 7f6a8ce58140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-19T08:23:36.847 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.597+0000 7f6a8ce58140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-19T08:23:36.848 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.627+0000 7f6a8ce58140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-19T08:23:37.136 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.857+0000 7f6a8ce58140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-19T08:23:37.137 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.955+0000 7f6a8ce58140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-19T08:23:37.137 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:36.984+0000 7f6a8ce58140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-19T08:23:37.137 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:37 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:37.014+0000 7f6a8ce58140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-19T08:23:37.137 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:37 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:37.105+0000 7f6a8ce58140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-19T08:23:37.137 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:37 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:37.133+0000 7f6a8ce58140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-19T08:23:37.597 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:37 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:37.223+0000 7f6a8ce58140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-19T08:23:38.097 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:37 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:37.674+0000 7f6a8ce58140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-19T08:23:38.097 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:37 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:37.704+0000 7f6a8ce58140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-19T08:23:38.097 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:38.094+0000 7f6a8ce58140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-19T08:23:38.347 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: Active manager daemon a restarted 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: Activating manager daemon a 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: osdmap e2: 0 total, 0 up, 0 in 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: mgrmap e6: a(active, starting, since 0.00252643s) 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: Manager daemon a is now available 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:38.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:38.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:38.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:38.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-19T08:23:38.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:38 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-19T08:23:39.133 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout { 2026-02-19T08:23:39.133 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-19T08:23:39.133 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout } 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.871+0000 7f1f7c6a7640 1 Processor -- start 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.871+0000 7f1f7c6a7640 1 -- start start 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.871+0000 7f1f7c6a7640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f74107230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.871+0000 7f1f7c6a7640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1f74107770 con 0x7f1f74106e30 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.871+0000 7f1f7a41c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f74107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.871+0000 7f1f7a41c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f74107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:34034/0 (socket says 10.20.193.27:34034) 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.871+0000 7f1f7a41c640 1 -- 10.20.193.27:0/1412184354 learned_addr learned my addr 10.20.193.27:0/1412184354 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.871+0000 7f1f7a41c640 1 -- 10.20.193.27:0/1412184354 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f74107f90 con 0x7f1f74106e30 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7a41c640 1 --2- 10.20.193.27:0/1412184354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f74107230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009920 tx=0x7f1f6402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccd3e27da22cec2 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.134 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7941a640 1 -- 10.20.193.27:0/1412184354 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6403c070 con 0x7f1f74106e30 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7941a640 1 -- 10.20.193.27:0/1412184354 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f1f64037440 con 0x7f1f74106e30 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7941a640 1 -- 10.20.193.27:0/1412184354 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f64035340 con 0x7f1f74106e30 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/1412184354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 msgr2=0x7f1f74107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7c6a7640 1 --2- 10.20.193.27:0/1412184354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f74107230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009920 tx=0x7f1f6402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/1412184354 shutdown_connections 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7c6a7640 1 --2- 10.20.193.27:0/1412184354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f74107230 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/1412184354 >> 10.20.193.27:0/1412184354 conn(0x7f1f741025a0 msgr2=0x7f1f74104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/1412184354 shutdown_connections 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/1412184354 wait complete. 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7c6a7640 1 Processor -- start 2026-02-19T08:23:39.135 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.872+0000 7f1f7c6a7640 1 -- start start 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7c6a7640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f7419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7c6a7640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7410b250 con 0x7f1f74106e30 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7a41c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f7419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7a41c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f7419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:34044/0 (socket says 10.20.193.27:34044) 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7a41c640 1 -- 10.20.193.27:0/2677700884 learned_addr learned my addr 10.20.193.27:0/2677700884 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7a41c640 1 -- 10.20.193.27:0/2677700884 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7419d0c0 con 0x7f1f74106e30 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7a41c640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f7419cb80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006fd0 tx=0x7f1f64035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f64045070 con 0x7f1f74106e30 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f1f64040450 con 0x7f1f74106e30 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/2677700884 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7419d350 con 0x7f1f74106e30 2026-02-19T08:23:39.136 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6403c070 con 0x7f1f74106e30 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/2677700884 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f741a0040 con 0x7f1f74106e30 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7c6a7640 20 mgrc start_tell_command target: cmd: [{"prefix": "get_command_descriptions"}] 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.873+0000 7f1f7c6a7640 5 mgrc start_tell_command no mgr session (no running mgr daemon?), or not active mgr, waiting 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 5) ==== 50325+0+0 (secure 0 0 0) 0x7f1f6402fae0 con 0x7f1f74106e30 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f5b7fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f5b7fe640 4 mgrc handle_mgr_map Got map version 5 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f5b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f5b7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f5b7fe640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 0x7f1f50040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f5b7fe640 10 mgrc reconnect resending 0 (tell) 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 --> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1f50040960 con 0x7f1f5003dd90 2026-02-19T08:23:39.137 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f79c1b640 1 -- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 msgr2=0x7f1f50040250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.27:6800/688875344 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1f64076870 con 0x7f1f74106e30 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:35.874+0000 7f1f79c1b640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 0x7f1f50040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:36.075+0000 7f1f79c1b640 1 -- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 msgr2=0x7f1f50040250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.27:6800/688875344 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:36.075+0000 7f1f79c1b640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 0x7f1f50040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:36.476+0000 7f1f79c1b640 1 -- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 msgr2=0x7f1f50040250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.27:6800/688875344 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:36.476+0000 7f1f79c1b640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 0x7f1f50040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:37.277+0000 7f1f79c1b640 1 -- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 msgr2=0x7f1f50040250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.27:6800/688875344 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:37.277+0000 7f1f79c1b640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 0x7f1f50040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:38.097+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mgrmap(e 6) ==== 50092+0+0 (secure 0 0 0) 0x7f1f64075330 con 0x7f1f74106e30 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:38.097+0000 7f1f5b7fe640 20 mgrc handle_mgr_map mgrmap(e 6) 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:38.097+0000 7f1f5b7fe640 4 mgrc handle_mgr_map Got map version 6 2026-02-19T08:23:39.138 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:38.097+0000 7f1f5b7fe640 4 mgrc handle_mgr_map Active mgr is now 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:38.097+0000 7f1f5b7fe640 4 mgrc reconnect Terminating session with v2:10.20.193.27:6800/688875344 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:38.097+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 msgr2=0x7f1f50040250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:38.097+0000 7f1f5b7fe640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 0x7f1f50040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:38.097+0000 7f1f5b7fe640 4 mgrc reconnect No active mgr available yet 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.097+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7f1f64075a30 con 0x7f1f74106e30 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.097+0000 7f1f5b7fe640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.097+0000 7f1f5b7fe640 4 mgrc handle_mgr_map Got map version 7 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.097+0000 7f1f5b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.097+0000 7f1f5b7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.097+0000 7f1f5b7fe640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f1f500416e0 0x7f1f50043ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.097+0000 7f1f5b7fe640 10 mgrc reconnect resending 0 (tell) 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.097+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 --> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1f50040960 con 0x7f1f500416e0 2026-02-19T08:23:39.139 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.097+0000 7f1f79c1b640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f1f500416e0 0x7f1f50043ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.098+0000 7f1f79c1b640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f1f500416e0 0x7f1f50043ad0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1f68003a80 tx=0x7f1f680092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.098+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 <== mgr.14118 v2:10.20.193.27:6800/2519751978 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f1f50040960 con 0x7f1f500416e0 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.098+0000 7f1f5b7fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.101+0000 7f1f7c6a7640 20 mgrc start_tell_command target: cmd: [{"prefix": "mgr_status"}] 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.101+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/2677700884 --> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f1f7419d830 con 0x7f1f500416e0 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f5b7fe640 1 -- 10.20.193.27:0/2677700884 <== mgr.14118 v2:10.20.193.27:6800/2519751978 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f1f7419d830 con 0x7f1f500416e0 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f5b7fe640 20 mgrc handle_command_reply tid 1 r 0 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 10 mgrc shutdown 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f1f500416e0 msgr2=0x7f1f50043ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f1f500416e0 0x7f1f50043ad0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1f68003a80 tx=0x7f1f680092b0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 msgr2=0x7f1f7419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f7419cb80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006fd0 tx=0x7f1f64035f80 comp rx=0 tx=0).stop 2026-02-19T08:23:39.140 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/2677700884 shutdown_connections 2026-02-19T08:23:39.141 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f1f500416e0 0x7f1f50043ad0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.141 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:6800/688875344,v1:10.20.193.27:6801/688875344] conn(0x7f1f5003dd90 0x7f1f50040250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.141 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 --2- 10.20.193.27:0/2677700884 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f74106e30 0x7f1f7419cb80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.141 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/2677700884 >> 10.20.193.27:0/2677700884 conn(0x7f1f741025a0 msgr2=0x7f1f74103170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:39.141 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/2677700884 shutdown_connections 2026-02-19T08:23:39.141 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.102+0000 7f1f7c6a7640 1 -- 10.20.193.27:0/2677700884 wait complete. 2026-02-19T08:23:39.141 INFO:teuthology.orchestra.run.trial027.stdout:mgr epoch 5 is available 2026-02-19T08:23:39.141 INFO:teuthology.orchestra.run.trial027.stdout:Setting orchestrator backend to cephadm... 2026-02-19T08:23:39.351 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.222+0000 7f782fad7640 1 Processor -- start 2026-02-19T08:23:39.351 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.222+0000 7f782fad7640 1 -- start start 2026-02-19T08:23:39.351 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.222+0000 7f782fad7640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f78281094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.222+0000 7f782fad7640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7828109ac0 con 0x7f78281090f0 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.222+0000 7f782d84c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f78281094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.222+0000 7f782d84c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f78281094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39260/0 (socket says 10.20.193.27:39260) 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.222+0000 7f782d84c640 1 -- 10.20.193.27:0/3765018041 learned_addr learned my addr 10.20.193.27:0/3765018041 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.222+0000 7f782d84c640 1 -- 10.20.193.27:0/3765018041 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782810a2f0 con 0x7f78281090f0 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.222+0000 7f782d84c640 1 --2- 10.20.193.27:0/3765018041 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f78281094f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7818009920 tx=0x7f781802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78ec4a7fde989a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782c84a640 1 -- 10.20.193.27:0/3765018041 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781803c070 con 0x7f78281090f0 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782c84a640 1 -- 10.20.193.27:0/3765018041 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f7818037440 con 0x7f78281090f0 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782c84a640 1 -- 10.20.193.27:0/3765018041 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7818035340 con 0x7f78281090f0 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 -- 10.20.193.27:0/3765018041 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 msgr2=0x7f78281094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.352 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 --2- 10.20.193.27:0/3765018041 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f78281094f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7818009920 tx=0x7f781802ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 -- 10.20.193.27:0/3765018041 shutdown_connections 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 --2- 10.20.193.27:0/3765018041 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f78281094f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 -- 10.20.193.27:0/3765018041 >> 10.20.193.27:0/3765018041 conn(0x7f782807c610 msgr2=0x7f782807ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 -- 10.20.193.27:0/3765018041 shutdown_connections 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 -- 10.20.193.27:0/3765018041 wait complete. 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 Processor -- start 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 -- start start 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f782819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782fad7640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f782810d520 con 0x7f78281090f0 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782d84c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f782819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782d84c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f782819ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39266/0 (socket says 10.20.193.27:39266) 2026-02-19T08:23:39.353 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.223+0000 7f782d84c640 1 -- 10.20.193.27:0/3448510835 learned_addr learned my addr 10.20.193.27:0/3448510835 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f782d84c640 1 -- 10.20.193.27:0/3448510835 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782819f3a0 con 0x7f78281090f0 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f782d84c640 1 --2- 10.20.193.27:0/3448510835 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f782819ee60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7818006fd0 tx=0x7f7818035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f7816ffd640 1 -- 10.20.193.27:0/3448510835 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7818045070 con 0x7f78281090f0 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f782fad7640 1 -- 10.20.193.27:0/3448510835 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782819f630 con 0x7f78281090f0 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f7816ffd640 1 -- 10.20.193.27:0/3448510835 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f7818040450 con 0x7f78281090f0 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f7816ffd640 1 -- 10.20.193.27:0/3448510835 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781803c070 con 0x7f78281090f0 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f782fad7640 1 -- 10.20.193.27:0/3448510835 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78281a2320 con 0x7f78281090f0 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f7816ffd640 1 -- 10.20.193.27:0/3448510835 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7f781802fae0 con 0x7f78281090f0 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f7816ffd640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f782fad7640 1 -- 10.20.193.27:0/3448510835 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7828109570 con 0x7f78281090f0 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f7816ffd640 4 mgrc handle_mgr_map Got map version 7 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f7816ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:39.354 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f7816ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f7816ffd640 1 --2- 10.20.193.27:0/3448510835 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f780403dc70 0x7f7804040130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.224+0000 7f7816ffd640 1 -- 10.20.193.27:0/3448510835 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7818076670 con 0x7f78281090f0 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.225+0000 7f782d04b640 1 --2- 10.20.193.27:0/3448510835 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f780403dc70 0x7f7804040130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.225+0000 7f782d04b640 1 --2- 10.20.193.27:0/3448510835 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f780403dc70 0x7f7804040130 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f781c0099c0 tx=0x7f781c006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.228+0000 7f7816ffd640 1 -- 10.20.193.27:0/3448510835 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7818033200 con 0x7f78281090f0 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.318+0000 7f782fad7640 20 mgrc start_command cmd: [{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.318+0000 7f782fad7640 1 -- 10.20.193.27:0/3448510835 --> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f78281a24f0 con 0x7f780403dc70 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.322+0000 7f7816ffd640 1 -- 10.20.193.27:0/3448510835 <== mgr.14118 v2:10.20.193.27:6800/2519751978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f78281a24f0 con 0x7f780403dc70 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.322+0000 7f7816ffd640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 10 mgrc shutdown 2026-02-19T08:23:39.355 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 1 -- 10.20.193.27:0/3448510835 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f780403dc70 msgr2=0x7f7804040130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.356 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 1 --2- 10.20.193.27:0/3448510835 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f780403dc70 0x7f7804040130 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f781c0099c0 tx=0x7f781c006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.356 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 1 -- 10.20.193.27:0/3448510835 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 msgr2=0x7f782819ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.356 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 1 --2- 10.20.193.27:0/3448510835 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f782819ee60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7818006fd0 tx=0x7f7818035570 comp rx=0 tx=0).stop 2026-02-19T08:23:39.356 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 1 -- 10.20.193.27:0/3448510835 shutdown_connections 2026-02-19T08:23:39.356 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 1 --2- 10.20.193.27:0/3448510835 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f780403dc70 0x7f7804040130 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.356 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 1 --2- 10.20.193.27:0/3448510835 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f78281090f0 0x7f782819ee60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.356 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 1 -- 10.20.193.27:0/3448510835 >> 10.20.193.27:0/3448510835 conn(0x7f782807c610 msgr2=0x7f7828106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:39.356 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 1 -- 10.20.193.27:0/3448510835 shutdown_connections 2026-02-19T08:23:39.356 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.323+0000 7f782fad7640 1 -- 10.20.193.27:0/3448510835 wait complete. 2026-02-19T08:23:39.369 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-mon[21739]: Found migration_current of "None". Setting to last migration. 2026-02-19T08:23:39.369 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:39.369 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:39.369 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-mon[21739]: mgrmap e7: a(active, since 1.00305s) 2026-02-19T08:23:39.560 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-19T08:23:39.560 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.441+0000 7fcb02223640 1 Processor -- start 2026-02-19T08:23:39.560 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.442+0000 7fcb02223640 1 -- start start 2026-02-19T08:23:39.560 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.442+0000 7fcb02223640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc107070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.442+0000 7fcb02223640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc107640 con 0x7fcafc106c70 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.442+0000 7fcb01221640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc107070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.442+0000 7fcb01221640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc107070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39278/0 (socket says 10.20.193.27:39278) 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.442+0000 7fcb01221640 1 -- 10.20.193.27:0/3920415195 learned_addr learned my addr 10.20.193.27:0/3920415195 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.442+0000 7fcb01221640 1 -- 10.20.193.27:0/3920415195 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc107e70 con 0x7fcafc106c70 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.442+0000 7fcb01221640 1 --2- 10.20.193.27:0/3920415195 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc107070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009920 tx=0x7fcaec02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a6ff5174eed9c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.442+0000 7fcaebfff640 1 -- 10.20.193.27:0/3920415195 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaec03c070 con 0x7fcafc106c70 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcaebfff640 1 -- 10.20.193.27:0/3920415195 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fcaec037440 con 0x7fcafc106c70 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcaebfff640 1 -- 10.20.193.27:0/3920415195 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaec035340 con 0x7fcafc106c70 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 -- 10.20.193.27:0/3920415195 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 msgr2=0x7fcafc107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 --2- 10.20.193.27:0/3920415195 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc107070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009920 tx=0x7fcaec02ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:39.561 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 -- 10.20.193.27:0/3920415195 shutdown_connections 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 --2- 10.20.193.27:0/3920415195 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc107070 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 -- 10.20.193.27:0/3920415195 >> 10.20.193.27:0/3920415195 conn(0x7fcafc102400 msgr2=0x7fcafc104840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 -- 10.20.193.27:0/3920415195 shutdown_connections 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 -- 10.20.193.27:0/3920415195 wait complete. 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 Processor -- start 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 -- start start 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb02223640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc10b0a0 con 0x7fcafc106c70 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb01221640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb01221640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc19ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39288/0 (socket says 10.20.193.27:39288) 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.443+0000 7fcb01221640 1 -- 10.20.193.27:0/2769100829 learned_addr learned my addr 10.20.193.27:0/2769100829 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcb01221640 1 -- 10.20.193.27:0/2769100829 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc19cf70 con 0x7fcafc106c70 2026-02-19T08:23:39.562 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcb01221640 1 --2- 10.20.193.27:0/2769100829 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc19ca30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcaec006fd0 tx=0x7fcaec035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcaea7fc640 1 -- 10.20.193.27:0/2769100829 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaec045070 con 0x7fcafc106c70 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcaea7fc640 1 -- 10.20.193.27:0/2769100829 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fcaec040450 con 0x7fcafc106c70 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcb02223640 1 -- 10.20.193.27:0/2769100829 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc19d200 con 0x7fcafc106c70 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcaea7fc640 1 -- 10.20.193.27:0/2769100829 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcaec03c070 con 0x7fcafc106c70 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcb02223640 1 -- 10.20.193.27:0/2769100829 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc19fef0 con 0x7fcafc106c70 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcb02223640 1 -- 10.20.193.27:0/2769100829 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcafc19d6e0 con 0x7fcafc106c70 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcaea7fc640 1 -- 10.20.193.27:0/2769100829 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7fcaec0493b0 con 0x7fcafc106c70 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcaea7fc640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcaea7fc640 4 mgrc handle_mgr_map Got map version 7 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcaea7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcaea7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:39.563 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.444+0000 7fcaea7fc640 1 --2- 10.20.193.27:0/2769100829 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcad803dc70 0x7fcad8040130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.445+0000 7fcaea7fc640 1 -- 10.20.193.27:0/2769100829 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcaec076690 con 0x7fcafc106c70 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.445+0000 7fcb00a20640 1 --2- 10.20.193.27:0/2769100829 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcad803dc70 0x7fcad8040130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.445+0000 7fcb00a20640 1 --2- 10.20.193.27:0/2769100829 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcad803dc70 0x7fcad8040130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00099c0 tx=0x7fcaf0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.447+0000 7fcaea7fc640 1 -- 10.20.193.27:0/2769100829 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcafc19d6e0 con 0x7fcafc106c70 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.531+0000 7fcb02223640 20 mgrc start_command cmd: [{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.531+0000 7fcb02223640 1 -- 10.20.193.27:0/2769100829 --> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fcafc1a00c0 con 0x7fcad803dc70 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.531+0000 7fcaea7fc640 1 -- 10.20.193.27:0/2769100829 <== mgr.14118 v2:10.20.193.27:6800/2519751978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fcafc1a00c0 con 0x7fcad803dc70 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.531+0000 7fcaea7fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 10 mgrc shutdown 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 1 -- 10.20.193.27:0/2769100829 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcad803dc70 msgr2=0x7fcad8040130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 1 --2- 10.20.193.27:0/2769100829 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcad803dc70 0x7fcad8040130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00099c0 tx=0x7fcaf0006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 1 -- 10.20.193.27:0/2769100829 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 msgr2=0x7fcafc19ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 1 --2- 10.20.193.27:0/2769100829 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc19ca30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcaec006fd0 tx=0x7fcaec035570 comp rx=0 tx=0).stop 2026-02-19T08:23:39.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 1 -- 10.20.193.27:0/2769100829 shutdown_connections 2026-02-19T08:23:39.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 1 --2- 10.20.193.27:0/2769100829 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcad803dc70 0x7fcad8040130 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 1 --2- 10.20.193.27:0/2769100829 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcafc106c70 0x7fcafc19ca30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 1 -- 10.20.193.27:0/2769100829 >> 10.20.193.27:0/2769100829 conn(0x7fcafc102400 msgr2=0x7fcafc102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:39.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 1 -- 10.20.193.27:0/2769100829 shutdown_connections 2026-02-19T08:23:39.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.532+0000 7fcb02223640 1 -- 10.20.193.27:0/2769100829 wait complete. 2026-02-19T08:23:39.565 INFO:teuthology.orchestra.run.trial027.stdout:Generating ssh key... 2026-02-19T08:23:39.785 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.646+0000 7fa13b9d2640 1 Processor -- start 2026-02-19T08:23:39.785 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.646+0000 7fa13b9d2640 1 -- start start 2026-02-19T08:23:39.785 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.646+0000 7fa13b9d2640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa134108870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.785 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.646+0000 7fa13b9d2640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa134108e40 con 0x7fa134108470 2026-02-19T08:23:39.785 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.647+0000 7fa139747640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa134108870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.785 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.647+0000 7fa139747640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa134108870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39302/0 (socket says 10.20.193.27:39302) 2026-02-19T08:23:39.785 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.647+0000 7fa139747640 1 -- 10.20.193.27:0/2870185544 learned_addr learned my addr 10.20.193.27:0/2870185544 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:39.785 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.647+0000 7fa139747640 1 -- 10.20.193.27:0/2870185544 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa134108fc0 con 0x7fa134108470 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.647+0000 7fa139747640 1 --2- 10.20.193.27:0/2870185544 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa134108870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa124009920 tx=0x7fa12402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5501084a19bff18 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.647+0000 7fa123fff640 1 -- 10.20.193.27:0/2870185544 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa12403c070 con 0x7fa134108470 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.647+0000 7fa123fff640 1 -- 10.20.193.27:0/2870185544 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa124037440 con 0x7fa134108470 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.647+0000 7fa123fff640 1 -- 10.20.193.27:0/2870185544 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa124035340 con 0x7fa134108470 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 -- 10.20.193.27:0/2870185544 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 msgr2=0x7fa134108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 --2- 10.20.193.27:0/2870185544 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa134108870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa124009920 tx=0x7fa12402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 -- 10.20.193.27:0/2870185544 shutdown_connections 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 --2- 10.20.193.27:0/2870185544 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa134108870 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 -- 10.20.193.27:0/2870185544 >> 10.20.193.27:0/2870185544 conn(0x7fa134100b80 msgr2=0x7fa134103000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 -- 10.20.193.27:0/2870185544 shutdown_connections 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 -- 10.20.193.27:0/2870185544 wait complete. 2026-02-19T08:23:39.786 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 Processor -- start 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 -- start start 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa13419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa134105a80 con 0x7fa134108470 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa139747640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa13419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa139747640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa13419ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39310/0 (socket says 10.20.193.27:39310) 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa139747640 1 -- 10.20.193.27:0/3005547007 learned_addr learned my addr 10.20.193.27:0/3005547007 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa139747640 1 -- 10.20.193.27:0/3005547007 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13419f3d0 con 0x7fa134108470 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa139747640 1 --2- 10.20.193.27:0/3005547007 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa13419ee90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa124006fd0 tx=0x7fa124035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa1227fc640 1 -- 10.20.193.27:0/3005547007 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa124045070 con 0x7fa134108470 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa1227fc640 1 -- 10.20.193.27:0/3005547007 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa124040450 con 0x7fa134108470 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa13b9d2640 1 -- 10.20.193.27:0/3005547007 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13419f660 con 0x7fa134108470 2026-02-19T08:23:39.787 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.648+0000 7fa1227fc640 1 -- 10.20.193.27:0/3005547007 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa12403c070 con 0x7fa134108470 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa13b9d2640 1 -- 10.20.193.27:0/3005547007 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1341a2350 con 0x7fa134108470 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa13b9d2640 1 -- 10.20.193.27:0/3005547007 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1341088f0 con 0x7fa134108470 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa1227fc640 1 -- 10.20.193.27:0/3005547007 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7fa1240493b0 con 0x7fa134108470 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa1227fc640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa1227fc640 4 mgrc handle_mgr_map Got map version 7 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa1227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa1227fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa1227fc640 1 --2- 10.20.193.27:0/3005547007 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa11003dc70 0x7fa110040130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa1227fc640 1 -- 10.20.193.27:0/3005547007 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa1240767a0 con 0x7fa134108470 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa138f46640 1 --2- 10.20.193.27:0/3005547007 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa11003dc70 0x7fa110040130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.649+0000 7fa138f46640 1 --2- 10.20.193.27:0/3005547007 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa11003dc70 0x7fa110040130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa1280099c0 tx=0x7fa128006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.788 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.652+0000 7fa1227fc640 1 -- 10.20.193.27:0/3005547007 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa124047d40 con 0x7fa134108470 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.737+0000 7fa13b9d2640 20 mgrc start_command cmd: [{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.737+0000 7fa13b9d2640 1 -- 10.20.193.27:0/3005547007 --> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fa134101eb0 con 0x7fa11003dc70 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.756+0000 7fa1227fc640 1 -- 10.20.193.27:0/3005547007 <== mgr.14118 v2:10.20.193.27:6800/2519751978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa134101eb0 con 0x7fa11003dc70 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.756+0000 7fa1227fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 10 mgrc shutdown 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 1 -- 10.20.193.27:0/3005547007 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa11003dc70 msgr2=0x7fa110040130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 1 --2- 10.20.193.27:0/3005547007 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa11003dc70 0x7fa110040130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa1280099c0 tx=0x7fa128006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 1 -- 10.20.193.27:0/3005547007 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 msgr2=0x7fa13419ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 1 --2- 10.20.193.27:0/3005547007 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa13419ee90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa124006fd0 tx=0x7fa124035570 comp rx=0 tx=0).stop 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 1 -- 10.20.193.27:0/3005547007 shutdown_connections 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 1 --2- 10.20.193.27:0/3005547007 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa11003dc70 0x7fa110040130 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.789 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 1 --2- 10.20.193.27:0/3005547007 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa134108470 0x7fa13419ee90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.790 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 1 -- 10.20.193.27:0/3005547007 >> 10.20.193.27:0/3005547007 conn(0x7fa134100b80 msgr2=0x7fa1341017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:39.790 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 1 -- 10.20.193.27:0/3005547007 shutdown_connections 2026-02-19T08:23:39.790 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.757+0000 7fa13b9d2640 1 -- 10.20.193.27:0/3005547007 wait complete. 2026-02-19T08:23:39.967 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: Generating public/private ed25519 key pair. 2026-02-19T08:23:39.967 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: Your identification has been saved in /tmp/tmpftbt3l9g/key 2026-02-19T08:23:39.967 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: Your public key has been saved in /tmp/tmpftbt3l9g/key.pub 2026-02-19T08:23:39.967 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: The key fingerprint is: 2026-02-19T08:23:39.967 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: SHA256:Fn2u24wn5LWKXu+Aj9O9I8Ykqjhchbt1I25t2UxfO0o ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:39.967 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: The key's randomart image is: 2026-02-19T08:23:39.967 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: +--[ED25519 256]--+ 2026-02-19T08:23:39.967 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: | | 2026-02-19T08:23:39.968 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: | . | 2026-02-19T08:23:39.968 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: | . . . . | 2026-02-19T08:23:39.968 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: | . . . o | 2026-02-19T08:23:39.968 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: | o S . | 2026-02-19T08:23:39.968 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: | o o.+.+.. . | 2026-02-19T08:23:39.968 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: | . . + =.&++Eo . | 2026-02-19T08:23:39.968 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: | o.. + ==XO* o | 2026-02-19T08:23:39.968 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: | ...o o+o=*B+ . | 2026-02-19T08:23:39.968 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:39 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: +----[SHA256]-----+ 2026-02-19T08:23:39.991 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPtme7b9HvWjw9hUJqtvZdDmuY5InxeZPDkGL6ouUBTE ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:39.992 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.875+0000 7fc90e40c640 1 Processor -- start 2026-02-19T08:23:39.992 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.875+0000 7fc90e40c640 1 -- start start 2026-02-19T08:23:39.992 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.875+0000 7fc90e40c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc9081094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.992 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.875+0000 7fc90e40c640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc908109ac0 con 0x7fc9081090f0 2026-02-19T08:23:39.992 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.875+0000 7fc907fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc9081094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.992 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.875+0000 7fc907fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc9081094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39326/0 (socket says 10.20.193.27:39326) 2026-02-19T08:23:39.992 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.875+0000 7fc907fff640 1 -- 10.20.193.27:0/2634536329 learned_addr learned my addr 10.20.193.27:0/2634536329 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:39.992 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.875+0000 7fc907fff640 1 -- 10.20.193.27:0/2634536329 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90810a2f0 con 0x7fc9081090f0 2026-02-19T08:23:39.992 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc907fff640 1 --2- 10.20.193.27:0/2634536329 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc9081094f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009920 tx=0x7fc8f402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c562aec68e1253c server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc906ffd640 1 -- 10.20.193.27:0/2634536329 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f403c070 con 0x7fc9081090f0 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc906ffd640 1 -- 10.20.193.27:0/2634536329 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fc8f4037440 con 0x7fc9081090f0 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc906ffd640 1 -- 10.20.193.27:0/2634536329 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f4035340 con 0x7fc9081090f0 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc90e40c640 1 -- 10.20.193.27:0/2634536329 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 msgr2=0x7fc9081094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc90e40c640 1 --2- 10.20.193.27:0/2634536329 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc9081094f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009920 tx=0x7fc8f402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc90e40c640 1 -- 10.20.193.27:0/2634536329 shutdown_connections 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc90e40c640 1 --2- 10.20.193.27:0/2634536329 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc9081094f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc90e40c640 1 -- 10.20.193.27:0/2634536329 >> 10.20.193.27:0/2634536329 conn(0x7fc90807c610 msgr2=0x7fc90807ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc90e40c640 1 -- 10.20.193.27:0/2634536329 shutdown_connections 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.876+0000 7fc90e40c640 1 -- 10.20.193.27:0/2634536329 wait complete. 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc90e40c640 1 Processor -- start 2026-02-19T08:23:39.993 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc90e40c640 1 -- start start 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc90e40c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc90819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc90e40c640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc90810d520 con 0x7fc9081090f0 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc907fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc90819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc907fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc90819ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39328/0 (socket says 10.20.193.27:39328) 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc907fff640 1 -- 10.20.193.27:0/804200905 learned_addr learned my addr 10.20.193.27:0/804200905 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc907fff640 1 -- 10.20.193.27:0/804200905 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90819f3a0 con 0x7fc9081090f0 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc907fff640 1 --2- 10.20.193.27:0/804200905 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc90819ee60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4006fd0 tx=0x7fc8f4035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc9057fa640 1 -- 10.20.193.27:0/804200905 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f4045070 con 0x7fc9081090f0 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc9057fa640 1 -- 10.20.193.27:0/804200905 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fc8f4040450 con 0x7fc9081090f0 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc90e40c640 1 -- 10.20.193.27:0/804200905 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc90819f630 con 0x7fc9081090f0 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc9057fa640 1 -- 10.20.193.27:0/804200905 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f403c070 con 0x7fc9081090f0 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc90e40c640 1 -- 10.20.193.27:0/804200905 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9081a2320 con 0x7fc9081090f0 2026-02-19T08:23:39.994 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.877+0000 7fc90e40c640 1 -- 10.20.193.27:0/804200905 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc908109570 con 0x7fc9081090f0 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.878+0000 7fc9057fa640 1 -- 10.20.193.27:0/804200905 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7fc8f40493b0 con 0x7fc9081090f0 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.878+0000 7fc9057fa640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.878+0000 7fc9057fa640 4 mgrc handle_mgr_map Got map version 7 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.878+0000 7fc9057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.878+0000 7fc9057fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.878+0000 7fc9057fa640 1 --2- 10.20.193.27:0/804200905 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fc8dc03dc70 0x7fc8dc040130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.878+0000 7fc9057fa640 1 -- 10.20.193.27:0/804200905 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc8f40766f0 con 0x7fc9081090f0 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.878+0000 7fc9077fe640 1 --2- 10.20.193.27:0/804200905 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fc8dc03dc70 0x7fc8dc040130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.878+0000 7fc9077fe640 1 --2- 10.20.193.27:0/804200905 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fc8dc03dc70 0x7fc8dc040130 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80099c0 tx=0x7fc8f8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.880+0000 7fc9057fa640 1 -- 10.20.193.27:0/804200905 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc8f403fe80 con 0x7fc9081090f0 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.963+0000 7fc90e40c640 20 mgrc start_command cmd: [{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:39.995 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.963+0000 7fc90e40c640 1 -- 10.20.193.27:0/804200905 --> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fc908106da0 con 0x7fc8dc03dc70 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.964+0000 7fc9057fa640 1 -- 10.20.193.27:0/804200905 <== mgr.14118 v2:10.20.193.27:6800/2519751978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+123 (secure 0 0 0) 0x7fc908106da0 con 0x7fc8dc03dc70 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.964+0000 7fc9057fa640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 10 mgrc shutdown 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 1 -- 10.20.193.27:0/804200905 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fc8dc03dc70 msgr2=0x7fc8dc040130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 1 --2- 10.20.193.27:0/804200905 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fc8dc03dc70 0x7fc8dc040130 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80099c0 tx=0x7fc8f8006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 1 -- 10.20.193.27:0/804200905 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 msgr2=0x7fc90819ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 1 --2- 10.20.193.27:0/804200905 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc90819ee60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4006fd0 tx=0x7fc8f4035570 comp rx=0 tx=0).stop 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 1 -- 10.20.193.27:0/804200905 shutdown_connections 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 1 --2- 10.20.193.27:0/804200905 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fc8dc03dc70 0x7fc8dc040130 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 1 --2- 10.20.193.27:0/804200905 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc9081090f0 0x7fc90819ee60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 1 -- 10.20.193.27:0/804200905 >> 10.20.193.27:0/804200905 conn(0x7fc90807c610 msgr2=0x7fc908106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 1 -- 10.20.193.27:0/804200905 shutdown_connections 2026-02-19T08:23:39.996 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:39.965+0000 7fc90e40c640 1 -- 10.20.193.27:0/804200905 wait complete. 2026-02-19T08:23:39.997 INFO:teuthology.orchestra.run.trial027.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-19T08:23:39.997 INFO:teuthology.orchestra.run.trial027.stdout:Adding key to root@localhost authorized_keys... 2026-02-19T08:23:39.997 INFO:teuthology.orchestra.run.trial027.stdout:Adding host trial027... 2026-02-19T08:23:40.495 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-19T08:23:40.496 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-19T08:23:40.496 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:40.496 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:40.496 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:40.496 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: [19/Feb/2026:08:23:39] ENGINE Bus STARTING 2026-02-19T08:23:40.496 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: [19/Feb/2026:08:23:39] ENGINE Serving on http://10.20.193.27:8765 2026-02-19T08:23:40.496 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:40.496 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: [19/Feb/2026:08:23:39] ENGINE Serving on https://10.20.193.27:7150 2026-02-19T08:23:40.496 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: [19/Feb/2026:08:23:39] ENGINE Bus STARTED 2026-02-19T08:23:40.496 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: [19/Feb/2026:08:23:39] ENGINE Client ('10.20.193.27', 57974) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-19T08:23:40.497 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:40.497 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:40.497 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:40 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:41.597 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:41 trial027 ceph-mon[21739]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:41.597 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:41 trial027 ceph-mon[21739]: Generating ssh key... 2026-02-19T08:23:41.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:41 trial027 ceph-mon[21739]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:41.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:41 trial027 ceph-mon[21739]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial027", "addr": "10.20.193.27", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:41.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:41 trial027 ceph-mon[21739]: mgrmap e8: a(active, since 2s) 2026-02-19T08:23:41.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout Added host 'trial027' with addr '10.20.193.27' 2026-02-19T08:23:41.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.087+0000 7fa68a951640 1 Processor -- start 2026-02-19T08:23:41.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.087+0000 7fa68a951640 1 -- start start 2026-02-19T08:23:41.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.087+0000 7fa68a951640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa6841094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:41.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.087+0000 7fa68a951640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa684109aa0 con 0x7fa6841090d0 2026-02-19T08:23:41.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.088+0000 7fa683fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa6841094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:41.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.088+0000 7fa683fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa6841094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39338/0 (socket says 10.20.193.27:39338) 2026-02-19T08:23:41.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.088+0000 7fa683fff640 1 -- 10.20.193.27:0/601722555 learned_addr learned my addr 10.20.193.27:0/601722555 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:41.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.088+0000 7fa683fff640 1 -- 10.20.193.27:0/601722555 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68410a2d0 con 0x7fa6841090d0 2026-02-19T08:23:41.699 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.088+0000 7fa683fff640 1 --2- 10.20.193.27:0/601722555 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa6841094d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa670009920 tx=0x7fa67002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17da6f4eac19f3f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.088+0000 7fa682ffd640 1 -- 10.20.193.27:0/601722555 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa67003c070 con 0x7fa6841090d0 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.088+0000 7fa682ffd640 1 -- 10.20.193.27:0/601722555 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa670037440 con 0x7fa6841090d0 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.088+0000 7fa682ffd640 1 -- 10.20.193.27:0/601722555 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa670035340 con 0x7fa6841090d0 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 -- 10.20.193.27:0/601722555 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 msgr2=0x7fa6841094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 --2- 10.20.193.27:0/601722555 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa6841094d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa670009920 tx=0x7fa67002ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 -- 10.20.193.27:0/601722555 shutdown_connections 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 --2- 10.20.193.27:0/601722555 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa6841094d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 -- 10.20.193.27:0/601722555 >> 10.20.193.27:0/601722555 conn(0x7fa68407c550 msgr2=0x7fa68407c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 -- 10.20.193.27:0/601722555 shutdown_connections 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 -- 10.20.193.27:0/601722555 wait complete. 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 Processor -- start 2026-02-19T08:23:41.700 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 -- start start 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa68419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa68a951640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa68410d500 con 0x7fa6841090d0 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa683fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa68419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa683fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa68419ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39348/0 (socket says 10.20.193.27:39348) 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.089+0000 7fa683fff640 1 -- 10.20.193.27:0/472284087 learned_addr learned my addr 10.20.193.27:0/472284087 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa683fff640 1 -- 10.20.193.27:0/472284087 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68419f350 con 0x7fa6841090d0 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa683fff640 1 --2- 10.20.193.27:0/472284087 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa68419ee10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa670006fd0 tx=0x7fa670037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa6817fa640 1 -- 10.20.193.27:0/472284087 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa670045070 con 0x7fa6841090d0 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa6817fa640 1 -- 10.20.193.27:0/472284087 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa670040450 con 0x7fa6841090d0 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa68a951640 1 -- 10.20.193.27:0/472284087 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68419f5e0 con 0x7fa6841090d0 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa6817fa640 1 -- 10.20.193.27:0/472284087 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa67003c070 con 0x7fa6841090d0 2026-02-19T08:23:41.701 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa68a951640 1 -- 10.20.193.27:0/472284087 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6841a22d0 con 0x7fa6841090d0 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa68a951640 1 -- 10.20.193.27:0/472284087 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa684109550 con 0x7fa6841090d0 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa6817fa640 1 -- 10.20.193.27:0/472284087 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7fa6700493b0 con 0x7fa6841090d0 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa6817fa640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa6817fa640 4 mgrc handle_mgr_map Got map version 7 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa6817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa6817fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.090+0000 7fa6817fa640 1 --2- 10.20.193.27:0/472284087 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa65803dc20 0x7fa6580400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.091+0000 7fa6817fa640 1 -- 10.20.193.27:0/472284087 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa6700767e0 con 0x7fa6841090d0 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.091+0000 7fa6837fe640 1 --2- 10.20.193.27:0/472284087 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa65803dc20 0x7fa6580400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.091+0000 7fa6837fe640 1 --2- 10.20.193.27:0/472284087 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa65803dc20 0x7fa6580400e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa6740099c0 tx=0x7fa674006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.093+0000 7fa6817fa640 1 -- 10.20.193.27:0/472284087 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa67003c210 con 0x7fa6841090d0 2026-02-19T08:23:41.702 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.178+0000 7fa68a951640 20 mgrc start_command cmd: [{"prefix": "orch host add", "hostname": "trial027", "addr": "10.20.193.27", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.178+0000 7fa68a951640 1 -- 10.20.193.27:0/472284087 --> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial027", "addr": "10.20.193.27", "target": ["mon-mgr", ""]}) -- 0x7fa684106d00 con 0x7fa65803dc20 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.757+0000 7fa6817fa640 1 -- 10.20.193.27:0/472284087 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7fa670078c70 con 0x7fa6841090d0 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.757+0000 7fa6817fa640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.758+0000 7fa6817fa640 4 mgrc handle_mgr_map Got map version 8 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:40.758+0000 7fa6817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.645+0000 7fa6817fa640 1 -- 10.20.193.27:0/472284087 <== mgr.14118 v2:10.20.193.27:6800/2519751978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fa684106d00 con 0x7fa65803dc20 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.645+0000 7fa6817fa640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.647+0000 7fa68a951640 10 mgrc shutdown 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.647+0000 7fa68a951640 1 -- 10.20.193.27:0/472284087 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa65803dc20 msgr2=0x7fa6580400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.647+0000 7fa68a951640 1 --2- 10.20.193.27:0/472284087 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa65803dc20 0x7fa6580400e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa6740099c0 tx=0x7fa674006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.647+0000 7fa68a951640 1 -- 10.20.193.27:0/472284087 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 msgr2=0x7fa68419ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.647+0000 7fa68a951640 1 --2- 10.20.193.27:0/472284087 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa68419ee10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa670006fd0 tx=0x7fa670037b70 comp rx=0 tx=0).stop 2026-02-19T08:23:41.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.648+0000 7fa68a951640 1 -- 10.20.193.27:0/472284087 shutdown_connections 2026-02-19T08:23:41.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.648+0000 7fa68a951640 1 --2- 10.20.193.27:0/472284087 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fa65803dc20 0x7fa6580400e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:41.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.648+0000 7fa68a951640 1 --2- 10.20.193.27:0/472284087 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa6841090d0 0x7fa68419ee10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:41.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.648+0000 7fa68a951640 1 -- 10.20.193.27:0/472284087 >> 10.20.193.27:0/472284087 conn(0x7fa68407c550 msgr2=0x7fa6841065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:41.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.648+0000 7fa68a951640 1 -- 10.20.193.27:0/472284087 shutdown_connections 2026-02-19T08:23:41.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.648+0000 7fa68a951640 1 -- 10.20.193.27:0/472284087 wait complete. 2026-02-19T08:23:41.704 INFO:teuthology.orchestra.run.trial027.stdout:Deploying unmanaged mon service... 2026-02-19T08:23:41.928 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-19T08:23:41.928 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.800+0000 7f3e643d4640 1 Processor -- start 2026-02-19T08:23:41.928 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.800+0000 7f3e643d4640 1 -- start start 2026-02-19T08:23:41.928 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.800+0000 7f3e643d4640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c1094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:41.928 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.800+0000 7f3e643d4640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c109aa0 con 0x7f3e5c1090d0 2026-02-19T08:23:41.928 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.800+0000 7f3e62149640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c1094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.800+0000 7f3e62149640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c1094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39352/0 (socket says 10.20.193.27:39352) 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.800+0000 7f3e62149640 1 -- 10.20.193.27:0/3573574454 learned_addr learned my addr 10.20.193.27:0/3573574454 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.801+0000 7f3e62149640 1 -- 10.20.193.27:0/3573574454 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c10a2d0 con 0x7f3e5c1090d0 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.801+0000 7f3e62149640 1 --2- 10.20.193.27:0/3573574454 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c1094d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009920 tx=0x7f3e4c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e61b7cb294d58ad server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.801+0000 7f3e61147640 1 -- 10.20.193.27:0/3573574454 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e4c03c070 con 0x7f3e5c1090d0 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.801+0000 7f3e61147640 1 -- 10.20.193.27:0/3573574454 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f3e4c037440 con 0x7f3e5c1090d0 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.801+0000 7f3e61147640 1 -- 10.20.193.27:0/3573574454 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e4c035340 con 0x7f3e5c1090d0 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 -- 10.20.193.27:0/3573574454 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 msgr2=0x7f3e5c1094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 --2- 10.20.193.27:0/3573574454 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c1094d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009920 tx=0x7f3e4c02ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 -- 10.20.193.27:0/3573574454 shutdown_connections 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 --2- 10.20.193.27:0/3573574454 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c1094d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 -- 10.20.193.27:0/3573574454 >> 10.20.193.27:0/3573574454 conn(0x7f3e5c07c550 msgr2=0x7f3e5c07c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:41.929 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 -- 10.20.193.27:0/3573574454 shutdown_connections 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 -- 10.20.193.27:0/3573574454 wait complete. 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 Processor -- start 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 -- start start 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c19ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e643d4640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c10d500 con 0x7f3e5c1090d0 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e62149640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c19ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e62149640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c19ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39354/0 (socket says 10.20.193.27:39354) 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e62149640 1 -- 10.20.193.27:0/1316245976 learned_addr learned my addr 10.20.193.27:0/1316245976 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e62149640 1 -- 10.20.193.27:0/1316245976 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c19f350 con 0x7f3e5c1090d0 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.802+0000 7f3e62149640 1 --2- 10.20.193.27:0/1316245976 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c19ee10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c006fd0 tx=0x7f3e4c037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e437fe640 1 -- 10.20.193.27:0/1316245976 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e4c045070 con 0x7f3e5c1090d0 2026-02-19T08:23:41.930 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e437fe640 1 -- 10.20.193.27:0/1316245976 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f3e4c040450 con 0x7f3e5c1090d0 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e643d4640 1 -- 10.20.193.27:0/1316245976 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5c19f5e0 con 0x7f3e5c1090d0 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e437fe640 1 -- 10.20.193.27:0/1316245976 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e4c03c070 con 0x7f3e5c1090d0 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e643d4640 1 -- 10.20.193.27:0/1316245976 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5c1a22d0 con 0x7f3e5c1090d0 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e643d4640 1 -- 10.20.193.27:0/1316245976 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5c109550 con 0x7f3e5c1090d0 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e437fe640 1 -- 10.20.193.27:0/1316245976 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7f3e4c0493b0 con 0x7f3e5c1090d0 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e437fe640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e437fe640 4 mgrc handle_mgr_map Got map version 8 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e437fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e437fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e437fe640 1 --2- 10.20.193.27:0/1316245976 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f3e3803dcf0 0x7f3e380401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e437fe640 1 -- 10.20.193.27:0/1316245976 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3e4c076960 con 0x7f3e5c1090d0 2026-02-19T08:23:41.931 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.803+0000 7f3e61948640 1 --2- 10.20.193.27:0/1316245976 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f3e3803dcf0 0x7f3e380401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.804+0000 7f3e61948640 1 --2- 10.20.193.27:0/1316245976 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f3e3803dcf0 0x7f3e380401b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3e500099c0 tx=0x7f3e50006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.806+0000 7f3e437fe640 1 -- 10.20.193.27:0/1316245976 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3e4c03c210 con 0x7f3e5c1090d0 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.895+0000 7f3e643d4640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}] 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.895+0000 7f3e643d4640 1 -- 10.20.193.27:0/1316245976 --> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f3e5c106d60 con 0x7f3e3803dcf0 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.898+0000 7f3e437fe640 1 -- 10.20.193.27:0/1316245976 <== mgr.14118 v2:10.20.193.27:6800/2519751978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3e5c106d60 con 0x7f3e3803dcf0 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.898+0000 7f3e437fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 10 mgrc shutdown 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 1 -- 10.20.193.27:0/1316245976 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f3e3803dcf0 msgr2=0x7f3e380401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 1 --2- 10.20.193.27:0/1316245976 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f3e3803dcf0 0x7f3e380401b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3e500099c0 tx=0x7f3e50006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 1 -- 10.20.193.27:0/1316245976 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 msgr2=0x7f3e5c19ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 1 --2- 10.20.193.27:0/1316245976 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c19ee10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c006fd0 tx=0x7f3e4c037b70 comp rx=0 tx=0).stop 2026-02-19T08:23:41.932 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 1 -- 10.20.193.27:0/1316245976 shutdown_connections 2026-02-19T08:23:41.933 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 1 --2- 10.20.193.27:0/1316245976 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f3e3803dcf0 0x7f3e380401b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:41.933 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 1 --2- 10.20.193.27:0/1316245976 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f3e5c1090d0 0x7f3e5c19ee10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:41.933 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 1 -- 10.20.193.27:0/1316245976 >> 10.20.193.27:0/1316245976 conn(0x7f3e5c07c550 msgr2=0x7f3e5c106650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:41.933 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 1 -- 10.20.193.27:0/1316245976 shutdown_connections 2026-02-19T08:23:41.933 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:41.899+0000 7f3e643d4640 1 -- 10.20.193.27:0/1316245976 wait complete. 2026-02-19T08:23:41.933 INFO:teuthology.orchestra.run.trial027.stdout:Deploying unmanaged mgr service... 2026-02-19T08:23:42.153 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.025+0000 7ff99dbfe640 1 Processor -- start 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.025+0000 7ff99dbfe640 1 -- start start 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.026+0000 7ff99dbfe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.026+0000 7ff99dbfe640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff99807b830 con 0x7ff99807ce90 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.026+0000 7ff9977fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.026+0000 7ff9977fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99807b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39360/0 (socket says 10.20.193.27:39360) 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.026+0000 7ff9977fe640 1 -- 10.20.193.27:0/4082172168 learned_addr learned my addr 10.20.193.27:0/4082172168 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.026+0000 7ff9977fe640 1 -- 10.20.193.27:0/4082172168 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99807b9b0 con 0x7ff99807ce90 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.026+0000 7ff9977fe640 1 --2- 10.20.193.27:0/4082172168 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99807b2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff984009920 tx=0x7ff98402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da77ee1b05861563 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff9967fc640 1 -- 10.20.193.27:0/4082172168 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff98403c070 con 0x7ff99807ce90 2026-02-19T08:23:42.154 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff9967fc640 1 -- 10.20.193.27:0/4082172168 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7ff984037440 con 0x7ff99807ce90 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff9967fc640 1 -- 10.20.193.27:0/4082172168 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff984035340 con 0x7ff99807ce90 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4082172168 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 msgr2=0x7ff99807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 --2- 10.20.193.27:0/4082172168 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99807b2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff984009920 tx=0x7ff98402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4082172168 shutdown_connections 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 --2- 10.20.193.27:0/4082172168 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99807b2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4082172168 >> 10.20.193.27:0/4082172168 conn(0x7ff9981025a0 msgr2=0x7ff998104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4082172168 shutdown_connections 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4082172168 wait complete. 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 Processor -- start 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 -- start start 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:42.155 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff99dbfe640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7ff99810d2a0 con 0x7ff99807ce90 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.027+0000 7ff9977fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff9977fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99819ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39370/0 (socket says 10.20.193.27:39370) 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff9977fe640 1 -- 10.20.193.27:0/4226247942 learned_addr learned my addr 10.20.193.27:0/4226247942 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff9977fe640 1 -- 10.20.193.27:0/4226247942 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99819f380 con 0x7ff99807ce90 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff9977fe640 1 --2- 10.20.193.27:0/4226247942 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99819ee40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff984006fd0 tx=0x7ff984035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff994ff9640 1 -- 10.20.193.27:0/4226247942 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff984045070 con 0x7ff99807ce90 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4226247942 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99819f610 con 0x7ff99807ce90 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff994ff9640 1 -- 10.20.193.27:0/4226247942 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7ff984040450 con 0x7ff99807ce90 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff994ff9640 1 -- 10.20.193.27:0/4226247942 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff98403c070 con 0x7ff99807ce90 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4226247942 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9981a2300 con 0x7ff99807ce90 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4226247942 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99807b370 con 0x7ff99807ce90 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff994ff9640 1 -- 10.20.193.27:0/4226247942 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7ff9840493b0 con 0x7ff99807ce90 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.028+0000 7ff994ff9640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-19T08:23:42.156 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.029+0000 7ff994ff9640 4 mgrc handle_mgr_map Got map version 8 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.029+0000 7ff994ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.029+0000 7ff994ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.029+0000 7ff994ff9640 1 --2- 10.20.193.27:0/4226247942 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7ff96c03dd30 0x7ff96c0401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.029+0000 7ff994ff9640 1 -- 10.20.193.27:0/4226247942 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff984076990 con 0x7ff99807ce90 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.029+0000 7ff996ffd640 1 --2- 10.20.193.27:0/4226247942 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7ff96c03dd30 0x7ff96c0401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.029+0000 7ff996ffd640 1 --2- 10.20.193.27:0/4226247942 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7ff96c03dd30 0x7ff96c0401f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff9880099c0 tx=0x7ff988006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.031+0000 7ff994ff9640 1 -- 10.20.193.27:0/4226247942 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff98403c210 con 0x7ff99807ce90 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.120+0000 7ff99dbfe640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}] 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.120+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4226247942 --> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff9981a24d0 con 0x7ff96c03dd30 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.123+0000 7ff994ff9640 1 -- 10.20.193.27:0/4226247942 <== mgr.14118 v2:10.20.193.27:6800/2519751978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff9981a24d0 con 0x7ff96c03dd30 2026-02-19T08:23:42.157 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.123+0000 7ff994ff9640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 10 mgrc shutdown 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4226247942 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7ff96c03dd30 msgr2=0x7ff96c0401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 1 --2- 10.20.193.27:0/4226247942 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7ff96c03dd30 0x7ff96c0401f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff9880099c0 tx=0x7ff988006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4226247942 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 msgr2=0x7ff99819ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 1 --2- 10.20.193.27:0/4226247942 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99819ee40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff984006fd0 tx=0x7ff984035570 comp rx=0 tx=0).stop 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4226247942 shutdown_connections 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 1 --2- 10.20.193.27:0/4226247942 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7ff96c03dd30 0x7ff96c0401f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 1 --2- 10.20.193.27:0/4226247942 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7ff99807ce90 0x7ff99819ee40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4226247942 >> 10.20.193.27:0/4226247942 conn(0x7ff9981025a0 msgr2=0x7ff9981031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4226247942 shutdown_connections 2026-02-19T08:23:42.158 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.125+0000 7ff99dbfe640 1 -- 10.20.193.27:0/4226247942 wait complete. 2026-02-19T08:23:42.366 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.243+0000 7fb3c412f640 1 Processor -- start 2026-02-19T08:23:42.366 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.243+0000 7fb3c412f640 1 -- start start 2026-02-19T08:23:42.366 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.243+0000 7fb3c412f640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc1094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:42.366 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.243+0000 7fb3c412f640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc109ac0 con 0x7fb3bc1090f0 2026-02-19T08:23:42.366 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.243+0000 7fb3c1ea4640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc1094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:42.366 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.243+0000 7fb3c1ea4640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc1094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39386/0 (socket says 10.20.193.27:39386) 2026-02-19T08:23:42.366 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.243+0000 7fb3c1ea4640 1 -- 10.20.193.27:0/883034365 learned_addr learned my addr 10.20.193.27:0/883034365 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.244+0000 7fb3c1ea4640 1 -- 10.20.193.27:0/883034365 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc10a2f0 con 0x7fb3bc1090f0 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.244+0000 7fb3c1ea4640 1 --2- 10.20.193.27:0/883034365 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc1094f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009920 tx=0x7fb3ac02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6464db48a15f2bae server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.244+0000 7fb3c0ea2640 1 -- 10.20.193.27:0/883034365 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3ac03c070 con 0x7fb3bc1090f0 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.244+0000 7fb3c0ea2640 1 -- 10.20.193.27:0/883034365 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fb3ac037440 con 0x7fb3bc1090f0 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.244+0000 7fb3c0ea2640 1 -- 10.20.193.27:0/883034365 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3ac0354d0 con 0x7fb3bc1090f0 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.244+0000 7fb3c412f640 1 -- 10.20.193.27:0/883034365 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 msgr2=0x7fb3bc1094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.244+0000 7fb3c412f640 1 --2- 10.20.193.27:0/883034365 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc1094f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac009920 tx=0x7fb3ac02ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c412f640 1 -- 10.20.193.27:0/883034365 shutdown_connections 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c412f640 1 --2- 10.20.193.27:0/883034365 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc1094f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c412f640 1 -- 10.20.193.27:0/883034365 >> 10.20.193.27:0/883034365 conn(0x7fb3bc07c610 msgr2=0x7fb3bc07ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c412f640 1 -- 10.20.193.27:0/883034365 shutdown_connections 2026-02-19T08:23:42.367 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c412f640 1 -- 10.20.193.27:0/883034365 wait complete. 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c412f640 1 Processor -- start 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c412f640 1 -- start start 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c412f640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc19ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c412f640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc10b180 con 0x7fb3bc1090f0 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c1ea4640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc19ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c1ea4640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc19ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39390/0 (socket says 10.20.193.27:39390) 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c1ea4640 1 -- 10.20.193.27:0/2784506893 learned_addr learned my addr 10.20.193.27:0/2784506893 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c1ea4640 1 -- 10.20.193.27:0/2784506893 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc19f360 con 0x7fb3bc1090f0 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c1ea4640 1 --2- 10.20.193.27:0/2784506893 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc19ee20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac037d90 tx=0x7fb3ac02fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3aaffd640 1 -- 10.20.193.27:0/2784506893 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3ac047070 con 0x7fb3bc1090f0 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3aaffd640 1 -- 10.20.193.27:0/2784506893 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fb3ac042440 con 0x7fb3bc1090f0 2026-02-19T08:23:42.368 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3c412f640 1 -- 10.20.193.27:0/2784506893 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3bc19f5f0 con 0x7fb3bc1090f0 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.245+0000 7fb3aaffd640 1 -- 10.20.193.27:0/2784506893 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3ac03c070 con 0x7fb3bc1090f0 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.246+0000 7fb3c412f640 1 -- 10.20.193.27:0/2784506893 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3bc1a22e0 con 0x7fb3bc1090f0 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.246+0000 7fb3c412f640 1 -- 10.20.193.27:0/2784506893 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3bc109570 con 0x7fb3bc1090f0 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.246+0000 7fb3aaffd640 1 -- 10.20.193.27:0/2784506893 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7fb3ac0425f0 con 0x7fb3bc1090f0 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.246+0000 7fb3aaffd640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.246+0000 7fb3aaffd640 4 mgrc handle_mgr_map Got map version 8 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.246+0000 7fb3aaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.246+0000 7fb3aaffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.246+0000 7fb3aaffd640 1 --2- 10.20.193.27:0/2784506893 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fb39803dd90 0x7fb398040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.246+0000 7fb3aaffd640 1 -- 10.20.193.27:0/2784506893 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb3ac076b70 con 0x7fb3bc1090f0 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.246+0000 7fb3c16a3640 1 --2- 10.20.193.27:0/2784506893 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fb39803dd90 0x7fb398040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:42.369 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.247+0000 7fb3c16a3640 1 --2- 10.20.193.27:0/2784506893 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fb39803dd90 0x7fb398040250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00099c0 tx=0x7fb3b0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.249+0000 7fb3aaffd640 1 -- 10.20.193.27:0/2784506893 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb3ac0768d0 con 0x7fb3bc1090f0 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.334+0000 7fb3c412f640 1 -- 10.20.193.27:0/2784506893 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fb3bc1a2740 con 0x7fb3bc1090f0 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.336+0000 7fb3aaffd640 1 -- 10.20.193.27:0/2784506893 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fb3ac047da0 con 0x7fb3bc1090f0 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 10 mgrc shutdown 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 1 -- 10.20.193.27:0/2784506893 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fb39803dd90 msgr2=0x7fb398040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 1 --2- 10.20.193.27:0/2784506893 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fb39803dd90 0x7fb398040250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00099c0 tx=0x7fb3b0006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 1 -- 10.20.193.27:0/2784506893 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 msgr2=0x7fb3bc19ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 1 --2- 10.20.193.27:0/2784506893 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc19ee20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac037d90 tx=0x7fb3ac02fcd0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 1 -- 10.20.193.27:0/2784506893 shutdown_connections 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 1 --2- 10.20.193.27:0/2784506893 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fb39803dd90 0x7fb398040250 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 1 --2- 10.20.193.27:0/2784506893 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb3bc1090f0 0x7fb3bc19ee20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 1 -- 10.20.193.27:0/2784506893 >> 10.20.193.27:0/2784506893 conn(0x7fb3bc07c610 msgr2=0x7fb3bc106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:42.370 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 1 -- 10.20.193.27:0/2784506893 shutdown_connections 2026-02-19T08:23:42.371 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.337+0000 7fb3c412f640 1 -- 10.20.193.27:0/2784506893 wait complete. 2026-02-19T08:23:42.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:42 trial027 ceph-mon[21739]: Deploying cephadm binary to trial027 2026-02-19T08:23:42.423 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:42 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:42.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:42 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:42.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:42 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:42.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:42 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:42.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:42 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:42.424 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:42 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:42.595 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.466+0000 7fcb3b936640 1 Processor -- start 2026-02-19T08:23:42.596 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.466+0000 7fcb3b936640 1 -- start start 2026-02-19T08:23:42.596 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.466+0000 7fcb3b936640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb34107230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:42.596 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.466+0000 7fcb3b936640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34107770 con 0x7fcb34106e30 2026-02-19T08:23:42.596 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.466+0000 7fcb396ab640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb34107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:42.596 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.466+0000 7fcb396ab640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb34107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39402/0 (socket says 10.20.193.27:39402) 2026-02-19T08:23:42.596 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.466+0000 7fcb396ab640 1 -- 10.20.193.27:0/16735873 learned_addr learned my addr 10.20.193.27:0/16735873 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:42.596 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb396ab640 1 -- 10.20.193.27:0/16735873 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb34107f90 con 0x7fcb34106e30 2026-02-19T08:23:42.596 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb396ab640 1 --2- 10.20.193.27:0/16735873 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb34107230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009920 tx=0x7fcb2402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2aecbaa78c1d2d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:42.596 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb23fff640 1 -- 10.20.193.27:0/16735873 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb2403c070 con 0x7fcb34106e30 2026-02-19T08:23:42.596 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb23fff640 1 -- 10.20.193.27:0/16735873 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fcb24037440 con 0x7fcb34106e30 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb23fff640 1 -- 10.20.193.27:0/16735873 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb240354d0 con 0x7fcb34106e30 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb3b936640 1 -- 10.20.193.27:0/16735873 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 msgr2=0x7fcb34107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb3b936640 1 --2- 10.20.193.27:0/16735873 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb34107230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009920 tx=0x7fcb2402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb3b936640 1 -- 10.20.193.27:0/16735873 shutdown_connections 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb3b936640 1 --2- 10.20.193.27:0/16735873 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb34107230 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb3b936640 1 -- 10.20.193.27:0/16735873 >> 10.20.193.27:0/16735873 conn(0x7fcb341025a0 msgr2=0x7fcb34104a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb3b936640 1 -- 10.20.193.27:0/16735873 shutdown_connections 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.467+0000 7fcb3b936640 1 -- 10.20.193.27:0/16735873 wait complete. 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb3b936640 1 Processor -- start 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb3b936640 1 -- start start 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb3b936640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb3419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:42.597 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb3b936640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34108c90 con 0x7fcb34106e30 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb396ab640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb3419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb396ab640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb3419cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39414/0 (socket says 10.20.193.27:39414) 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb396ab640 1 -- 10.20.193.27:0/1954064657 learned_addr learned my addr 10.20.193.27:0/1954064657 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb396ab640 1 -- 10.20.193.27:0/1954064657 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3419d0e0 con 0x7fcb34106e30 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb396ab640 1 --2- 10.20.193.27:0/1954064657 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb3419cba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcb24002410 tx=0x7fcb2402fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb227fc640 1 -- 10.20.193.27:0/1954064657 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb24047070 con 0x7fcb34106e30 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb227fc640 1 -- 10.20.193.27:0/1954064657 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fcb24042440 con 0x7fcb34106e30 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb3b936640 1 -- 10.20.193.27:0/1954064657 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3419d370 con 0x7fcb34106e30 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb227fc640 1 -- 10.20.193.27:0/1954064657 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb2403c070 con 0x7fcb34106e30 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.468+0000 7fcb3b936640 1 -- 10.20.193.27:0/1954064657 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb341a0060 con 0x7fcb34106e30 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.469+0000 7fcb3b936640 1 -- 10.20.193.27:0/1954064657 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb341072b0 con 0x7fcb34106e30 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.469+0000 7fcb227fc640 1 -- 10.20.193.27:0/1954064657 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7fcb24035b10 con 0x7fcb34106e30 2026-02-19T08:23:42.598 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.469+0000 7fcb227fc640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.469+0000 7fcb227fc640 4 mgrc handle_mgr_map Got map version 8 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.469+0000 7fcb227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.469+0000 7fcb227fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.469+0000 7fcb227fc640 1 --2- 10.20.193.27:0/1954064657 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcb1003dd90 0x7fcb10040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.469+0000 7fcb227fc640 1 -- 10.20.193.27:0/1954064657 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcb24076a80 con 0x7fcb34106e30 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.469+0000 7fcb38eaa640 1 --2- 10.20.193.27:0/1954064657 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcb1003dd90 0x7fcb10040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.469+0000 7fcb38eaa640 1 --2- 10.20.193.27:0/1954064657 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcb1003dd90 0x7fcb10040250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcb280099c0 tx=0x7fcb28006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.471+0000 7fcb227fc640 1 -- 10.20.193.27:0/1954064657 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcb2404f120 con 0x7fcb34106e30 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.562+0000 7fcb3b936640 1 -- 10.20.193.27:0/1954064657 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fcb341a0530 con 0x7fcb34106e30 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.564+0000 7fcb227fc640 1 -- 10.20.193.27:0/1954064657 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fcb24035e30 con 0x7fcb34106e30 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 10 mgrc shutdown 2026-02-19T08:23:42.599 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 1 -- 10.20.193.27:0/1954064657 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcb1003dd90 msgr2=0x7fcb10040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:42.600 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 1 --2- 10.20.193.27:0/1954064657 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcb1003dd90 0x7fcb10040250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcb280099c0 tx=0x7fcb28006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.600 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 1 -- 10.20.193.27:0/1954064657 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 msgr2=0x7fcb3419cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:42.600 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 1 --2- 10.20.193.27:0/1954064657 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb3419cba0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcb24002410 tx=0x7fcb2402fcb0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.600 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 1 -- 10.20.193.27:0/1954064657 shutdown_connections 2026-02-19T08:23:42.600 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 1 --2- 10.20.193.27:0/1954064657 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7fcb1003dd90 0x7fcb10040250 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.600 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 1 --2- 10.20.193.27:0/1954064657 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcb34106e30 0x7fcb3419cba0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:42.600 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 1 -- 10.20.193.27:0/1954064657 >> 10.20.193.27:0/1954064657 conn(0x7fcb341025a0 msgr2=0x7fcb34103150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:42.600 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 1 -- 10.20.193.27:0/1954064657 shutdown_connections 2026-02-19T08:23:42.600 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.566+0000 7fcb3b936640 1 -- 10.20.193.27:0/1954064657 wait complete. 2026-02-19T08:23:42.600 INFO:teuthology.orchestra.run.trial027.stdout:Enabling the dashboard module... 2026-02-19T08:23:43.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-mon[21739]: Added host trial027 2026-02-19T08:23:43.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-mon[21739]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:43.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-mon[21739]: Saving service mon spec with placement count:5 2026-02-19T08:23:43.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-mon[21739]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:43.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-mon[21739]: Saving service mgr spec with placement count:2 2026-02-19T08:23:43.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2784506893' entity='client.admin' 2026-02-19T08:23:43.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1954064657' entity='client.admin' 2026-02-19T08:23:43.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:43.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2536534499' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-19T08:23:43.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-mon[21739]: from='mgr.14118 10.20.193.27:0/3871843597' entity='mgr.a' 2026-02-19T08:23:43.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.695+0000 7f497e01b640 1 Processor -- start 2026-02-19T08:23:43.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.695+0000 7f497e01b640 1 -- start start 2026-02-19T08:23:43.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.695+0000 7f497e01b640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f49781094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:43.703 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.695+0000 7f497e01b640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4978109aa0 con 0x7f49781090d0 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.695+0000 7f49777fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f49781094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.695+0000 7f49777fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f49781094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39422/0 (socket says 10.20.193.27:39422) 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.695+0000 7f49777fe640 1 -- 10.20.193.27:0/2302922520 learned_addr learned my addr 10.20.193.27:0/2302922520 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.695+0000 7f49777fe640 1 -- 10.20.193.27:0/2302922520 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497810a2d0 con 0x7f49781090d0 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f49777fe640 1 --2- 10.20.193.27:0/2302922520 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f49781094d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4964009920 tx=0x7f496402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2647a0fdb816ec57 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f49767fc640 1 -- 10.20.193.27:0/2302922520 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496403c070 con 0x7f49781090d0 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f49767fc640 1 -- 10.20.193.27:0/2302922520 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f4964037440 con 0x7f49781090d0 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f49767fc640 1 -- 10.20.193.27:0/2302922520 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49640354d0 con 0x7f49781090d0 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f497e01b640 1 -- 10.20.193.27:0/2302922520 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 msgr2=0x7f49781094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f497e01b640 1 --2- 10.20.193.27:0/2302922520 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f49781094d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4964009920 tx=0x7f496402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:43.704 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f497e01b640 1 -- 10.20.193.27:0/2302922520 shutdown_connections 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f497e01b640 1 --2- 10.20.193.27:0/2302922520 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f49781094d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f497e01b640 1 -- 10.20.193.27:0/2302922520 >> 10.20.193.27:0/2302922520 conn(0x7f497807c550 msgr2=0x7f497807c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f497e01b640 1 -- 10.20.193.27:0/2302922520 shutdown_connections 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.696+0000 7f497e01b640 1 -- 10.20.193.27:0/2302922520 wait complete. 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f497e01b640 1 Processor -- start 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f497e01b640 1 -- start start 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f497e01b640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f497819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f497e01b640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f497810b160 con 0x7f49781090d0 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f49777fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f497819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f49777fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f497819edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39424/0 (socket says 10.20.193.27:39424) 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f49777fe640 1 -- 10.20.193.27:0/2536534499 learned_addr learned my addr 10.20.193.27:0/2536534499 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:43.705 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f49777fe640 1 -- 10.20.193.27:0/2536534499 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497819f310 con 0x7f49781090d0 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f49777fe640 1 --2- 10.20.193.27:0/2536534499 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f497819edd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4964037d90 tx=0x7f496402fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f4974ff9640 1 -- 10.20.193.27:0/2536534499 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4964047070 con 0x7f49781090d0 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f4974ff9640 1 -- 10.20.193.27:0/2536534499 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f4964035c20 con 0x7f49781090d0 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f497e01b640 1 -- 10.20.193.27:0/2536534499 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497819f5a0 con 0x7f49781090d0 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f4974ff9640 1 -- 10.20.193.27:0/2536534499 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496403c070 con 0x7f49781090d0 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.697+0000 7f497e01b640 1 -- 10.20.193.27:0/2536534499 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49781a2290 con 0x7f49781090d0 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.698+0000 7f4974ff9640 1 -- 10.20.193.27:0/2536534499 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7f4964042440 con 0x7f49781090d0 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.698+0000 7f4974ff9640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.698+0000 7f497e01b640 1 -- 10.20.193.27:0/2536534499 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4978109550 con 0x7f49781090d0 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.698+0000 7f4974ff9640 4 mgrc handle_mgr_map Got map version 8 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.698+0000 7f4974ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:43.706 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.698+0000 7f4974ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.698+0000 7f4974ff9640 1 --2- 10.20.193.27:0/2536534499 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f494c03dd90 0x7f494c040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.698+0000 7f4974ff9640 1 -- 10.20.193.27:0/2536534499 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4964076bd0 con 0x7f49781090d0 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.698+0000 7f4976ffd640 1 --2- 10.20.193.27:0/2536534499 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f494c03dd90 0x7f494c040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.698+0000 7f4976ffd640 1 --2- 10.20.193.27:0/2536534499 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f494c03dd90 0x7f494c040250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f49680099c0 tx=0x7f4968006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.701+0000 7f4974ff9640 1 -- 10.20.193.27:0/2536534499 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4964045120 con 0x7f49781090d0 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:42.808+0000 7f497e01b640 1 -- 10.20.193.27:0/2536534499 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f49781a26f0 con 0x7f49781090d0 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.650+0000 7f4974ff9640 1 -- 10.20.193.27:0/2536534499 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f4964035dd0 con 0x7f49781090d0 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.651+0000 7f4974ff9640 1 -- 10.20.193.27:0/2536534499 <== mon.0 v2:10.20.193.27:3300/0 8 ==== mgrmap(e 9) ==== 50338+0+0 (secure 0 0 0) 0x7f496403e310 con 0x7f49781090d0 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.651+0000 7f4974ff9640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.651+0000 7f4974ff9640 4 mgrc handle_mgr_map Got map version 9 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.651+0000 7f4974ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:43.707 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 10 mgrc shutdown 2026-02-19T08:23:43.708 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 1 -- 10.20.193.27:0/2536534499 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f494c03dd90 msgr2=0x7f494c040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:43.708 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 1 --2- 10.20.193.27:0/2536534499 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f494c03dd90 0x7f494c040250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f49680099c0 tx=0x7f4968006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:43.708 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 1 -- 10.20.193.27:0/2536534499 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 msgr2=0x7f497819edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:43.708 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 1 --2- 10.20.193.27:0/2536534499 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f497819edd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4964037d90 tx=0x7f496402fd40 comp rx=0 tx=0).stop 2026-02-19T08:23:43.708 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 1 -- 10.20.193.27:0/2536534499 shutdown_connections 2026-02-19T08:23:43.708 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 1 --2- 10.20.193.27:0/2536534499 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f494c03dd90 0x7f494c040250 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:43.708 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 1 --2- 10.20.193.27:0/2536534499 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f49781090d0 0x7f497819edd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:43.708 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 1 -- 10.20.193.27:0/2536534499 >> 10.20.193.27:0/2536534499 conn(0x7f497807c550 msgr2=0x7f4978106670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:43.708 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 1 -- 10.20.193.27:0/2536534499 shutdown_connections 2026-02-19T08:23:43.708 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.652+0000 7f497e01b640 1 -- 10.20.193.27:0/2536534499 wait complete. 2026-02-19T08:23:43.918 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: ignoring --setuser ceph since I am not root 2026-02-19T08:23:43.918 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:43 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: ignoring --setgroup ceph since I am not root 2026-02-19T08:23:43.946 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout { 2026-02-19T08:23:43.946 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-19T08:23:43.946 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-19T08:23:43.946 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-19T08:23:43.946 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-19T08:23:43.946 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout } 2026-02-19T08:23:43.946 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.800+0000 7f231dc0b640 1 Processor -- start 2026-02-19T08:23:43.946 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.800+0000 7f231dc0b640 1 -- start start 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.800+0000 7f231dc0b640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f23181094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.800+0000 7f231dc0b640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2318109a80 con 0x7f23181090b0 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.801+0000 7f23177fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f23181094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.801+0000 7f23177fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f23181094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39456/0 (socket says 10.20.193.27:39456) 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.801+0000 7f23177fe640 1 -- 10.20.193.27:0/393905917 learned_addr learned my addr 10.20.193.27:0/393905917 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.801+0000 7f23177fe640 1 -- 10.20.193.27:0/393905917 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231810a2b0 con 0x7f23181090b0 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.801+0000 7f23177fe640 1 --2- 10.20.193.27:0/393905917 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f23181094b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2304009920 tx=0x7f230402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44814a0376407c61 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.801+0000 7f23167fc640 1 -- 10.20.193.27:0/393905917 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f230403c070 con 0x7f23181090b0 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.801+0000 7f23167fc640 1 -- 10.20.193.27:0/393905917 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f2304037440 con 0x7f23181090b0 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.801+0000 7f23167fc640 1 -- 10.20.193.27:0/393905917 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23040354d0 con 0x7f23181090b0 2026-02-19T08:23:43.947 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 -- 10.20.193.27:0/393905917 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 msgr2=0x7f23181094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 --2- 10.20.193.27:0/393905917 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f23181094b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2304009920 tx=0x7f230402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 -- 10.20.193.27:0/393905917 shutdown_connections 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 --2- 10.20.193.27:0/393905917 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f23181094b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 -- 10.20.193.27:0/393905917 >> 10.20.193.27:0/393905917 conn(0x7f231807c530 msgr2=0x7f231807c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 -- 10.20.193.27:0/393905917 shutdown_connections 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 -- 10.20.193.27:0/393905917 wait complete. 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 Processor -- start 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 -- start start 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f231819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f231dc0b640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f231810b140 con 0x7f23181090b0 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f23177fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f231819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:43.948 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f23177fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f231819edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39460/0 (socket says 10.20.193.27:39460) 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.802+0000 7f23177fe640 1 -- 10.20.193.27:0/3808050712 learned_addr learned my addr 10.20.193.27:0/3808050712 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.803+0000 7f23177fe640 1 -- 10.20.193.27:0/3808050712 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231819f300 con 0x7f23181090b0 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.803+0000 7f23177fe640 1 --2- 10.20.193.27:0/3808050712 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f231819edc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2304037d90 tx=0x7f230402fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.803+0000 7f2314ff9640 1 -- 10.20.193.27:0/3808050712 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2304047070 con 0x7f23181090b0 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.803+0000 7f2314ff9640 1 -- 10.20.193.27:0/3808050712 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f2304035c20 con 0x7f23181090b0 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.803+0000 7f2314ff9640 1 -- 10.20.193.27:0/3808050712 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f230403c070 con 0x7f23181090b0 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.803+0000 7f231dc0b640 1 -- 10.20.193.27:0/3808050712 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231819f590 con 0x7f23181090b0 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.803+0000 7f231dc0b640 1 -- 10.20.193.27:0/3808050712 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23181a2280 con 0x7f23181090b0 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.803+0000 7f2314ff9640 1 -- 10.20.193.27:0/3808050712 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 9) ==== 50338+0+0 (secure 0 0 0) 0x7f230404c440 con 0x7f23181090b0 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.803+0000 7f2314ff9640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.803+0000 7f231dc0b640 1 -- 10.20.193.27:0/3808050712 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2318109530 con 0x7f23181090b0 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.804+0000 7f2314ff9640 4 mgrc handle_mgr_map Got map version 9 2026-02-19T08:23:43.949 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.804+0000 7f2314ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.804+0000 7f2314ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.804+0000 7f2314ff9640 1 --2- 10.20.193.27:0/3808050712 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f22ec03dde0 0x7f22ec0402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.804+0000 7f2314ff9640 1 -- 10.20.193.27:0/3808050712 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2304076d30 con 0x7f23181090b0 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.804+0000 7f2316ffd640 1 -- 10.20.193.27:0/3808050712 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f22ec03dde0 msgr2=0x7f22ec0402a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.27:6800/2519751978 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.804+0000 7f2316ffd640 1 --2- 10.20.193.27:0/3808050712 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f22ec03dde0 0x7f22ec0402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.806+0000 7f2314ff9640 1 -- 10.20.193.27:0/3808050712 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2304035e40 con 0x7f23181090b0 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.915+0000 7f231dc0b640 1 -- 10.20.193.27:0/3808050712 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f23181a26e0 con 0x7f23181090b0 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.915+0000 7f2314ff9640 1 -- 10.20.193.27:0/3808050712 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f230404c900 con 0x7f23181090b0 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 10 mgrc shutdown 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 1 -- 10.20.193.27:0/3808050712 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f22ec03dde0 msgr2=0x7f22ec0402a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 1 --2- 10.20.193.27:0/3808050712 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f22ec03dde0 0x7f22ec0402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:43.950 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 1 -- 10.20.193.27:0/3808050712 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 msgr2=0x7f231819edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:43.951 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 1 --2- 10.20.193.27:0/3808050712 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f231819edc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2304037d90 tx=0x7f230402fd40 comp rx=0 tx=0).stop 2026-02-19T08:23:43.951 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 1 -- 10.20.193.27:0/3808050712 shutdown_connections 2026-02-19T08:23:43.951 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 1 --2- 10.20.193.27:0/3808050712 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f22ec03dde0 0x7f22ec0402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:43.951 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 1 --2- 10.20.193.27:0/3808050712 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f23181090b0 0x7f231819edc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:43.951 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 1 -- 10.20.193.27:0/3808050712 >> 10.20.193.27:0/3808050712 conn(0x7f231807c530 msgr2=0x7f2318106640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:43.951 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 1 -- 10.20.193.27:0/3808050712 shutdown_connections 2026-02-19T08:23:43.951 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:43.917+0000 7f231dc0b640 1 -- 10.20.193.27:0/3808050712 wait complete. 2026-02-19T08:23:43.951 INFO:teuthology.orchestra.run.trial027.stdout:Waiting for the mgr to restart... 2026-02-19T08:23:43.951 INFO:teuthology.orchestra.run.trial027.stdout:Waiting for mgr epoch 9... 2026-02-19T08:23:44.202 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.056+0000 7f3993462140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-19T08:23:44.202 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.199+0000 7f3993462140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-19T08:23:44.471 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.232+0000 7f3993462140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-19T08:23:44.471 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.272+0000 7f3993462140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-19T08:23:44.471 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.302+0000 7f3993462140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-19T08:23:44.471 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.335+0000 7f3993462140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-19T08:23:44.471 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.400+0000 7f3993462140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-19T08:23:44.471 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-19T08:23:44.471 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-19T08:23:44.471 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: from numpy import show_config as show_numpy_config 2026-02-19T08:23:44.722 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2536534499' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-19T08:23:44.723 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-mon[21739]: mgrmap e9: a(active, since 5s) 2026-02-19T08:23:44.723 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/3808050712' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-19T08:23:44.723 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.471+0000 7f3993462140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-19T08:23:44.723 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.504+0000 7f3993462140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-19T08:23:44.723 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.598+0000 7f3993462140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-19T08:23:44.723 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.654+0000 7f3993462140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-19T08:23:44.723 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.687+0000 7f3993462140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-19T08:23:44.723 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.719+0000 7f3993462140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-19T08:23:45.018 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.752+0000 7f3993462140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-19T08:23:45.019 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:44 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:44.782+0000 7f3993462140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-19T08:23:45.019 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:45 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:45.015+0000 7f3993462140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-19T08:23:45.295 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:45 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:45.113+0000 7f3993462140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-19T08:23:45.295 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:45 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:45.142+0000 7f3993462140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-19T08:23:45.295 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:45 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:45.172+0000 7f3993462140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-19T08:23:45.295 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:45 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:45.264+0000 7f3993462140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-19T08:23:45.295 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:45 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:45.291+0000 7f3993462140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-19T08:23:45.597 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:45 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:45.382+0000 7f3993462140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-19T08:23:46.097 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:45 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:45.840+0000 7f3993462140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-19T08:23:46.098 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:45 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:45.869+0000 7f3993462140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-19T08:23:46.598 INFO:journalctl@ceph.mgr.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-mgr-a[22007]: 2026-02-19T08:23:46.262+0000 7f3993462140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-19T08:23:46.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: Active manager daemon a restarted 2026-02-19T08:23:46.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: Activating manager daemon a 2026-02-19T08:23:46.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: osdmap e3: 0 total, 0 up, 0 in 2026-02-19T08:23:46.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: mgrmap e10: a(active, starting, since 0.00247554s) 2026-02-19T08:23:46.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-19T08:23:46.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-19T08:23:46.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-19T08:23:46.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-19T08:23:46.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-19T08:23:46.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: Manager daemon a is now available 2026-02-19T08:23:46.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:46.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-19T08:23:46.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:46 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-19T08:23:47.321 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout { 2026-02-19T08:23:47.321 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-19T08:23:47.321 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-19T08:23:47.321 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout } 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.039+0000 7f0fcbc34640 1 Processor -- start 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.039+0000 7f0fcbc34640 1 -- start start 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.039+0000 7f0fcbc34640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc4111f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.039+0000 7f0fcbc34640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc41124e0 con 0x7f0fc4111b10 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.039+0000 7f0fc99a9640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc4111f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.039+0000 7f0fc99a9640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc4111f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39468/0 (socket says 10.20.193.27:39468) 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.039+0000 7f0fc99a9640 1 -- 10.20.193.27:0/2022534038 learned_addr learned my addr 10.20.193.27:0/2022534038 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fc99a9640 1 -- 10.20.193.27:0/2022534038 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc4112d10 con 0x7f0fc4111b10 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fc99a9640 1 --2- 10.20.193.27:0/2022534038 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc4111f10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009920 tx=0x7f0fb402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38958971608f8ca6 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fc89a7640 1 -- 10.20.193.27:0/2022534038 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fb403c070 con 0x7f0fc4111b10 2026-02-19T08:23:47.322 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fc89a7640 1 -- 10.20.193.27:0/2022534038 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0fb4037440 con 0x7f0fc4111b10 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fc89a7640 1 -- 10.20.193.27:0/2022534038 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fb40354d0 con 0x7f0fc4111b10 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fcbc34640 1 -- 10.20.193.27:0/2022534038 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 msgr2=0x7f0fc4111f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fcbc34640 1 --2- 10.20.193.27:0/2022534038 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc4111f10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4009920 tx=0x7f0fb402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fcbc34640 1 -- 10.20.193.27:0/2022534038 shutdown_connections 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fcbc34640 1 --2- 10.20.193.27:0/2022534038 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc4111f10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fcbc34640 1 -- 10.20.193.27:0/2022534038 >> 10.20.193.27:0/2022534038 conn(0x7f0fc406de70 msgr2=0x7f0fc406e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fcbc34640 1 -- 10.20.193.27:0/2022534038 shutdown_connections 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.040+0000 7f0fcbc34640 1 -- 10.20.193.27:0/2022534038 wait complete. 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fcbc34640 1 Processor -- start 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fcbc34640 1 -- start start 2026-02-19T08:23:47.323 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fcbc34640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc41a7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fcbc34640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc4113ba0 con 0x7f0fc4111b10 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fc99a9640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc41a7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fc99a9640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc41a7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39482/0 (socket says 10.20.193.27:39482) 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fc99a9640 1 -- 10.20.193.27:0/1884112724 learned_addr learned my addr 10.20.193.27:0/1884112724 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fc99a9640 1 -- 10.20.193.27:0/1884112724 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc41a7d50 con 0x7f0fc4111b10 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fc99a9640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc41a7810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4002410 tx=0x7f0fb402fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fb4047070 con 0x7f0fc4111b10 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0fb4042440 con 0x7f0fc4111b10 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fcbc34640 1 -- 10.20.193.27:0/1884112724 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc41a7fe0 con 0x7f0fc4111b10 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fb403c070 con 0x7f0fc4111b10 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.041+0000 7f0fcbc34640 1 -- 10.20.193.27:0/1884112724 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc41aacd0 con 0x7f0fc4111b10 2026-02-19T08:23:47.324 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fcbc34640 20 mgrc start_tell_command target: cmd: [{"prefix": "get_command_descriptions"}] 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fcbc34640 5 mgrc start_tell_command no mgr session (no running mgr daemon?), or not active mgr, waiting 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 9) ==== 50338+0+0 (secure 0 0 0) 0x7f0fb4035b10 con 0x7f0fc4111b10 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fb2ffd640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fb2ffd640 4 mgrc handle_mgr_map Got map version 9 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fb2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fb2ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fb2ffd640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 0x7f0fa00402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fb2ffd640 10 mgrc reconnect resending 0 (tell) 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 --> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0fa00409b0 con 0x7f0fa003dde0 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0fb4076b20 con 0x7f0fc4111b10 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fc91a8640 1 -- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 msgr2=0x7f0fa00402a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.27:6800/2519751978 2026-02-19T08:23:47.325 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.042+0000 7f0fc91a8640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 0x7f0fa00402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.243+0000 7f0fc91a8640 1 -- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 msgr2=0x7f0fa00402a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.27:6800/2519751978 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.243+0000 7f0fc91a8640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 0x7f0fa00402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.644+0000 7f0fc91a8640 1 -- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 msgr2=0x7f0fa00402a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.27:6800/2519751978 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:44.644+0000 7f0fc91a8640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 0x7f0fa00402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:45.445+0000 7f0fc91a8640 1 -- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 msgr2=0x7f0fa00402a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.27:6800/2519751978 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:45.445+0000 7f0fc91a8640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 0x7f0fa00402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:46.265+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mgrmap(e 10) ==== 50105+0+0 (secure 0 0 0) 0x7f0fb4075920 con 0x7f0fc4111b10 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:46.265+0000 7f0fb2ffd640 20 mgrc handle_mgr_map mgrmap(e 10) 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:46.265+0000 7f0fb2ffd640 4 mgrc handle_mgr_map Got map version 10 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:46.265+0000 7f0fb2ffd640 4 mgrc handle_mgr_map Active mgr is now 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:46.265+0000 7f0fb2ffd640 4 mgrc reconnect Terminating session with v2:10.20.193.27:6800/2519751978 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:46.265+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 msgr2=0x7f0fa00402a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-19T08:23:47.326 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:46.265+0000 7f0fb2ffd640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 0x7f0fa00402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:46.265+0000 7f0fb2ffd640 4 mgrc reconnect No active mgr available yet 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.266+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mgrmap(e 11) ==== 50232+0+0 (secure 0 0 0) 0x7f0fb4076020 con 0x7f0fc4111b10 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.266+0000 7f0fb2ffd640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.266+0000 7f0fb2ffd640 4 mgrc handle_mgr_map Got map version 11 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.266+0000 7f0fb2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.266+0000 7f0fb2ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.266+0000 7f0fb2ffd640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0fa00418c0 0x7f0fa0043cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.266+0000 7f0fb2ffd640 10 mgrc reconnect resending 0 (tell) 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.266+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0fb403ce50 con 0x7f0fa00418c0 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.266+0000 7f0fc91a8640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0fa00418c0 0x7f0fa0043cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.267+0000 7f0fc91a8640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0fa00418c0 0x7f0fa0043cb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8003a80 tx=0x7f0fb80092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:47.327 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.267+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f0fb403ce50 con 0x7f0fa00418c0 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.267+0000 7f0fb2ffd640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.270+0000 7f0fcbc34640 20 mgrc start_tell_command target: cmd: [{"prefix": "mgr_status"}] 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.270+0000 7f0fcbc34640 1 -- 10.20.193.27:0/1884112724 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f0fc41a84c0 con 0x7f0fa00418c0 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.270+0000 7f0fb2ffd640 1 -- 10.20.193.27:0/1884112724 <== mgr.14150 v2:10.20.193.27:6800/111887651 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f0fc41a84c0 con 0x7f0fa00418c0 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.270+0000 7f0fb2ffd640 20 mgrc handle_command_reply tid 1 r 0 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 10 mgrc shutdown 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 -- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0fa00418c0 msgr2=0x7f0fa0043cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0fa00418c0 0x7f0fa0043cb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8003a80 tx=0x7f0fb80092b0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 -- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 msgr2=0x7f0fc41a7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc41a7810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4002410 tx=0x7f0fb402fcb0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 -- 10.20.193.27:0/1884112724 shutdown_connections 2026-02-19T08:23:47.328 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0fa00418c0 0x7f0fa0043cb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.329 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:6800/2519751978,v1:10.20.193.27:6801/2519751978] conn(0x7f0fa003dde0 0x7f0fa00402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.329 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 --2- 10.20.193.27:0/1884112724 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0fc4111b10 0x7f0fc41a7810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.329 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 -- 10.20.193.27:0/1884112724 >> 10.20.193.27:0/1884112724 conn(0x7f0fc406de70 msgr2=0x7f0fc4113f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:47.329 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 -- 10.20.193.27:0/1884112724 shutdown_connections 2026-02-19T08:23:47.329 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.271+0000 7f0fcbc34640 1 -- 10.20.193.27:0/1884112724 wait complete. 2026-02-19T08:23:47.329 INFO:teuthology.orchestra.run.trial027.stdout:mgr epoch 9 is available 2026-02-19T08:23:47.329 INFO:teuthology.orchestra.run.trial027.stdout:Generating a dashboard self-signed certificate... 2026-02-19T08:23:47.683 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-19T08:23:47.683 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.420+0000 7fa309644640 1 Processor -- start 2026-02-19T08:23:47.684 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.420+0000 7fa309644640 1 -- start start 2026-02-19T08:23:47.684 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.420+0000 7fa309644640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa3041094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:47.684 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.420+0000 7fa309644640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa304109a80 con 0x7fa3041090b0 2026-02-19T08:23:47.684 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.420+0000 7fa302ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa3041094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:47.684 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.420+0000 7fa302ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa3041094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39528/0 (socket says 10.20.193.27:39528) 2026-02-19T08:23:47.684 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.420+0000 7fa302ffd640 1 -- 10.20.193.27:0/2953162009 learned_addr learned my addr 10.20.193.27:0/2953162009 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:47.684 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa302ffd640 1 -- 10.20.193.27:0/2953162009 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30410a2b0 con 0x7fa3041090b0 2026-02-19T08:23:47.684 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa302ffd640 1 --2- 10.20.193.27:0/2953162009 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa3041094b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009920 tx=0x7fa2f802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b81ffdd39830ede server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:47.684 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa301ffb640 1 -- 10.20.193.27:0/2953162009 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f803c070 con 0x7fa3041090b0 2026-02-19T08:23:47.684 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa301ffb640 1 -- 10.20.193.27:0/2953162009 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa2f8037440 con 0x7fa3041090b0 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa301ffb640 1 -- 10.20.193.27:0/2953162009 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f80354d0 con 0x7fa3041090b0 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa309644640 1 -- 10.20.193.27:0/2953162009 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 msgr2=0x7fa3041094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa309644640 1 --2- 10.20.193.27:0/2953162009 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa3041094b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009920 tx=0x7fa2f802ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa309644640 1 -- 10.20.193.27:0/2953162009 shutdown_connections 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa309644640 1 --2- 10.20.193.27:0/2953162009 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa3041094b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa309644640 1 -- 10.20.193.27:0/2953162009 >> 10.20.193.27:0/2953162009 conn(0x7fa30407c530 msgr2=0x7fa30407c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa309644640 1 -- 10.20.193.27:0/2953162009 shutdown_connections 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.421+0000 7fa309644640 1 -- 10.20.193.27:0/2953162009 wait complete. 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa309644640 1 Processor -- start 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa309644640 1 -- start start 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa309644640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa30419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:47.685 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa309644640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa30410b140 con 0x7fa3041090b0 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa302ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa30419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa302ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa30419edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39538/0 (socket says 10.20.193.27:39538) 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa302ffd640 1 -- 10.20.193.27:0/2132275330 learned_addr learned my addr 10.20.193.27:0/2132275330 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa302ffd640 1 -- 10.20.193.27:0/2132275330 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30419f300 con 0x7fa3041090b0 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa302ffd640 1 --2- 10.20.193.27:0/2132275330 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa30419edc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8037d90 tx=0x7fa2f802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa2e3fff640 1 -- 10.20.193.27:0/2132275330 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f8047070 con 0x7fa3041090b0 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa2e3fff640 1 -- 10.20.193.27:0/2132275330 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa2f8035c20 con 0x7fa3041090b0 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa2e3fff640 1 -- 10.20.193.27:0/2132275330 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f803c070 con 0x7fa3041090b0 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa309644640 1 -- 10.20.193.27:0/2132275330 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30419f590 con 0x7fa3041090b0 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.422+0000 7fa309644640 1 -- 10.20.193.27:0/2132275330 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3041a2280 con 0x7fa3041090b0 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.423+0000 7fa2e3fff640 1 -- 10.20.193.27:0/2132275330 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 11) ==== 50232+0+0 (secure 0 0 0) 0x7fa2f8042440 con 0x7fa3041090b0 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.423+0000 7fa2e3fff640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-19T08:23:47.686 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.423+0000 7fa309644640 1 -- 10.20.193.27:0/2132275330 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa304109530 con 0x7fa3041090b0 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.423+0000 7fa2e3fff640 4 mgrc handle_mgr_map Got map version 11 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.423+0000 7fa2e3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.423+0000 7fa2e3fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.423+0000 7fa2e3fff640 1 --2- 10.20.193.27:0/2132275330 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa2d803dcc0 0x7fa2d8040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.423+0000 7fa2e3fff640 1 -- 10.20.193.27:0/2132275330 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa2f8076e90 con 0x7fa3041090b0 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.423+0000 7fa3027fc640 1 --2- 10.20.193.27:0/2132275330 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa2d803dcc0 0x7fa2d8040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.424+0000 7fa3027fc640 1 --2- 10.20.193.27:0/2132275330 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa2d803dcc0 0x7fa2d8040180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0099c0 tx=0x7fa2ec006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.426+0000 7fa2e3fff640 1 -- 10.20.193.27:0/2132275330 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa2f8045120 con 0x7fa3041090b0 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.514+0000 7fa309644640 20 mgrc start_command cmd: [{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.514+0000 7fa309644640 1 -- 10.20.193.27:0/2132275330 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fa304106d50 con 0x7fa2d803dcc0 2026-02-19T08:23:47.687 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.653+0000 7fa2e3fff640 1 -- 10.20.193.27:0/2132275330 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fa304106d50 con 0x7fa2d803dcc0 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.653+0000 7fa2e3fff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.655+0000 7fa309644640 10 mgrc shutdown 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.655+0000 7fa309644640 1 -- 10.20.193.27:0/2132275330 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa2d803dcc0 msgr2=0x7fa2d8040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.655+0000 7fa309644640 1 --2- 10.20.193.27:0/2132275330 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa2d803dcc0 0x7fa2d8040180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0099c0 tx=0x7fa2ec006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.655+0000 7fa309644640 1 -- 10.20.193.27:0/2132275330 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 msgr2=0x7fa30419edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.655+0000 7fa309644640 1 --2- 10.20.193.27:0/2132275330 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa30419edc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8037d90 tx=0x7fa2f802fd40 comp rx=0 tx=0).stop 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.656+0000 7fa309644640 1 -- 10.20.193.27:0/2132275330 shutdown_connections 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.656+0000 7fa309644640 1 --2- 10.20.193.27:0/2132275330 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa2d803dcc0 0x7fa2d8040180 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.656+0000 7fa309644640 1 --2- 10.20.193.27:0/2132275330 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa3041090b0 0x7fa30419edc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.656+0000 7fa309644640 1 -- 10.20.193.27:0/2132275330 >> 10.20.193.27:0/2132275330 conn(0x7fa30407c530 msgr2=0x7fa304106640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.656+0000 7fa309644640 1 -- 10.20.193.27:0/2132275330 shutdown_connections 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.656+0000 7fa309644640 1 -- 10.20.193.27:0/2132275330 wait complete. 2026-02-19T08:23:47.688 INFO:teuthology.orchestra.run.trial027.stdout:Creating initial admin user... 2026-02-19T08:23:48.063 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: [19/Feb/2026:08:23:46] ENGINE Bus STARTING 2026-02-19T08:23:48.063 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:48.063 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: [19/Feb/2026:08:23:47] ENGINE Serving on http://10.20.193.27:8765 2026-02-19T08:23:48.063 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: [19/Feb/2026:08:23:47] ENGINE Serving on https://10.20.193.27:7150 2026-02-19T08:23:48.063 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: [19/Feb/2026:08:23:47] ENGINE Bus STARTED 2026-02-19T08:23:48.063 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: [19/Feb/2026:08:23:47] ENGINE Client ('10.20.193.27', 57988) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-19T08:23:48.063 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-19T08:23:48.063 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: mgrmap e11: a(active, since 1.00451s) 2026-02-19T08:23:48.064 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-19T08:23:48.064 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:48.064 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:48.064 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:48.064 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:47 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:48.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$.Bcg1.EB.nx8hzLd4ULGMOVOofAZ5l94Y2uhlQsuINWSpaiK25dxm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771489428, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-19T08:23:48.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.769+0000 7f9ea2b31640 1 Processor -- start 2026-02-19T08:23:48.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.769+0000 7f9ea2b31640 1 -- start start 2026-02-19T08:23:48.089 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.769+0000 7f9ea2b31640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c1094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.769+0000 7f9ea2b31640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c109aa0 con 0x7f9e9c1090d0 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.769+0000 7f9ea08a6640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c1094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.769+0000 7f9ea08a6640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c1094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39540/0 (socket says 10.20.193.27:39540) 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.769+0000 7f9ea08a6640 1 -- 10.20.193.27:0/1942012447 learned_addr learned my addr 10.20.193.27:0/1942012447 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.770+0000 7f9ea08a6640 1 -- 10.20.193.27:0/1942012447 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9c10a2d0 con 0x7f9e9c1090d0 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.770+0000 7f9ea08a6640 1 --2- 10.20.193.27:0/1942012447 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c1094d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009920 tx=0x7f9e8c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52aeb7134e59846 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.770+0000 7f9e937fe640 1 -- 10.20.193.27:0/1942012447 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c03c070 con 0x7f9e9c1090d0 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.770+0000 7f9e937fe640 1 -- 10.20.193.27:0/1942012447 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f9e8c037440 con 0x7f9e9c1090d0 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.770+0000 7f9e937fe640 1 -- 10.20.193.27:0/1942012447 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c0354d0 con 0x7f9e9c1090d0 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 -- 10.20.193.27:0/1942012447 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 msgr2=0x7f9e9c1094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:48.090 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 --2- 10.20.193.27:0/1942012447 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c1094d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009920 tx=0x7f9e8c02ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 -- 10.20.193.27:0/1942012447 shutdown_connections 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 --2- 10.20.193.27:0/1942012447 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c1094d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 -- 10.20.193.27:0/1942012447 >> 10.20.193.27:0/1942012447 conn(0x7f9e9c07c550 msgr2=0x7f9e9c07c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 -- 10.20.193.27:0/1942012447 shutdown_connections 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 -- 10.20.193.27:0/1942012447 wait complete. 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 Processor -- start 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 -- start start 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c10b160 con 0x7f9e9c1090d0 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea08a6640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea08a6640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c19edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:39542/0 (socket says 10.20.193.27:39542) 2026-02-19T08:23:48.091 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea08a6640 1 -- 10.20.193.27:0/2456131553 learned_addr learned my addr 10.20.193.27:0/2456131553 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea08a6640 1 -- 10.20.193.27:0/2456131553 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9c19f2f0 con 0x7f9e9c1090d0 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea08a6640 1 --2- 10.20.193.27:0/2456131553 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c19edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c037d90 tx=0x7f9e8c02fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9e91ffb640 1 -- 10.20.193.27:0/2456131553 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c047070 con 0x7f9e9c1090d0 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9ea2b31640 1 -- 10.20.193.27:0/2456131553 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9c19f580 con 0x7f9e9c1090d0 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.771+0000 7f9e91ffb640 1 -- 10.20.193.27:0/2456131553 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f9e8c035c20 con 0x7f9e9c1090d0 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9e91ffb640 1 -- 10.20.193.27:0/2456131553 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e8c03c070 con 0x7f9e9c1090d0 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9ea2b31640 1 -- 10.20.193.27:0/2456131553 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9c1a2270 con 0x7f9e9c1090d0 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9ea2b31640 1 -- 10.20.193.27:0/2456131553 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e9c109550 con 0x7f9e9c1090d0 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9e91ffb640 1 -- 10.20.193.27:0/2456131553 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 11) ==== 50232+0+0 (secure 0 0 0) 0x7f9e8c042440 con 0x7f9e9c1090d0 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9e91ffb640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9e91ffb640 4 mgrc handle_mgr_map Got map version 11 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9e91ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:48.092 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9e91ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9e91ffb640 1 --2- 10.20.193.27:0/2456131553 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9e7803dcc0 0x7f9e78040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9e91ffb640 1 -- 10.20.193.27:0/2456131553 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9e8c076e70 con 0x7f9e9c1090d0 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.772+0000 7f9e93fff640 1 --2- 10.20.193.27:0/2456131553 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9e7803dcc0 0x7f9e78040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.773+0000 7f9e93fff640 1 --2- 10.20.193.27:0/2456131553 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9e7803dcc0 0x7f9e78040180 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9e840099c0 tx=0x7f9e84006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.775+0000 7f9e91ffb640 1 -- 10.20.193.27:0/2456131553 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9e8c045120 con 0x7f9e9c1090d0 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.865+0000 7f9ea2b31640 20 mgrc start_command cmd: [{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}] 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:47.865+0000 7f9ea2b31640 1 -- 10.20.193.27:0/2456131553 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f9e9c106d20 con 0x7f9e7803dcc0 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.059+0000 7f9e91ffb640 1 -- 10.20.193.27:0/2456131553 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f9e9c106d20 con 0x7f9e7803dcc0 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.059+0000 7f9e91ffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 10 mgrc shutdown 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 1 -- 10.20.193.27:0/2456131553 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9e7803dcc0 msgr2=0x7f9e78040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:48.093 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 1 --2- 10.20.193.27:0/2456131553 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9e7803dcc0 0x7f9e78040180 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9e840099c0 tx=0x7f9e84006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.094 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 1 -- 10.20.193.27:0/2456131553 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 msgr2=0x7f9e9c19edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:48.094 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 1 --2- 10.20.193.27:0/2456131553 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c19edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c037d90 tx=0x7f9e8c02fd40 comp rx=0 tx=0).stop 2026-02-19T08:23:48.094 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 1 -- 10.20.193.27:0/2456131553 shutdown_connections 2026-02-19T08:23:48.094 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 1 --2- 10.20.193.27:0/2456131553 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9e7803dcc0 0x7f9e78040180 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.094 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 1 --2- 10.20.193.27:0/2456131553 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9e9c1090d0 0x7f9e9c19edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.094 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 1 -- 10.20.193.27:0/2456131553 >> 10.20.193.27:0/2456131553 conn(0x7f9e9c07c550 msgr2=0x7f9e9c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:48.094 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 1 -- 10.20.193.27:0/2456131553 shutdown_connections 2026-02-19T08:23:48.094 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.061+0000 7f9ea2b31640 1 -- 10.20.193.27:0/2456131553 wait complete. 2026-02-19T08:23:48.094 INFO:teuthology.orchestra.run.trial027.stdout:Fetching dashboard port number... 2026-02-19T08:23:48.298 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stdout 8443 2026-02-19T08:23:48.298 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.181+0000 7f65a6931640 1 Processor -- start 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.182+0000 7f65a6931640 1 -- start start 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.182+0000 7f65a6931640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a01094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.182+0000 7f65a6931640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0109aa0 con 0x7f65a01090d0 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.182+0000 7f659ffff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a01094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.182+0000 7f659ffff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a01094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41180/0 (socket says 10.20.193.27:41180) 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.182+0000 7f659ffff640 1 -- 10.20.193.27:0/715271595 learned_addr learned my addr 10.20.193.27:0/715271595 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.182+0000 7f659ffff640 1 -- 10.20.193.27:0/715271595 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a010a2d0 con 0x7f65a01090d0 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.182+0000 7f659ffff640 1 --2- 10.20.193.27:0/715271595 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a01094d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f658c009920 tx=0x7f658c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa01563e7388bc25 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.182+0000 7f659effd640 1 -- 10.20.193.27:0/715271595 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658c03c070 con 0x7f65a01090d0 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f659effd640 1 -- 10.20.193.27:0/715271595 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f658c037440 con 0x7f65a01090d0 2026-02-19T08:23:48.299 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f659effd640 1 -- 10.20.193.27:0/715271595 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658c0354d0 con 0x7f65a01090d0 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 -- 10.20.193.27:0/715271595 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 msgr2=0x7f65a01094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 --2- 10.20.193.27:0/715271595 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a01094d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f658c009920 tx=0x7f658c02ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 -- 10.20.193.27:0/715271595 shutdown_connections 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 --2- 10.20.193.27:0/715271595 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a01094d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 -- 10.20.193.27:0/715271595 >> 10.20.193.27:0/715271595 conn(0x7f65a007c550 msgr2=0x7f65a007c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 -- 10.20.193.27:0/715271595 shutdown_connections 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 -- 10.20.193.27:0/715271595 wait complete. 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 Processor -- start 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 -- start start 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.183+0000 7f65a6931640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f65a010b160 con 0x7f65a01090d0 2026-02-19T08:23:48.300 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f659ffff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f659ffff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a019edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41190/0 (socket says 10.20.193.27:41190) 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f659ffff640 1 -- 10.20.193.27:0/421942781 learned_addr learned my addr 10.20.193.27:0/421942781 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f659ffff640 1 -- 10.20.193.27:0/421942781 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a019f310 con 0x7f65a01090d0 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f659ffff640 1 --2- 10.20.193.27:0/421942781 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a019edd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f658c002410 tx=0x7f658c02fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f659d7fa640 1 -- 10.20.193.27:0/421942781 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658c047070 con 0x7f65a01090d0 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f659d7fa640 1 -- 10.20.193.27:0/421942781 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f658c042440 con 0x7f65a01090d0 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f65a6931640 1 -- 10.20.193.27:0/421942781 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a019f5a0 con 0x7f65a01090d0 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f659d7fa640 1 -- 10.20.193.27:0/421942781 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658c03c070 con 0x7f65a01090d0 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f65a6931640 1 -- 10.20.193.27:0/421942781 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a01a2290 con 0x7f65a01090d0 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.184+0000 7f65a6931640 1 -- 10.20.193.27:0/421942781 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a0109550 con 0x7f65a01090d0 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.185+0000 7f659d7fa640 1 -- 10.20.193.27:0/421942781 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 11) ==== 50232+0+0 (secure 0 0 0) 0x7f658c035b10 con 0x7f65a01090d0 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.185+0000 7f659d7fa640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.185+0000 7f659d7fa640 4 mgrc handle_mgr_map Got map version 11 2026-02-19T08:23:48.301 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.185+0000 7f659d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.185+0000 7f659d7fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.185+0000 7f659d7fa640 1 --2- 10.20.193.27:0/421942781 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f657403dcc0 0x7f6574040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.185+0000 7f659d7fa640 1 -- 10.20.193.27:0/421942781 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f658c076f20 con 0x7f65a01090d0 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.185+0000 7f659f7fe640 1 --2- 10.20.193.27:0/421942781 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f657403dcc0 0x7f6574040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.185+0000 7f659f7fe640 1 --2- 10.20.193.27:0/421942781 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f657403dcc0 0x7f6574040180 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f65900099c0 tx=0x7f6590006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.187+0000 7f659d7fa640 1 -- 10.20.193.27:0/421942781 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f658c0425f0 con 0x7f65a01090d0 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.270+0000 7f65a6931640 1 -- 10.20.193.27:0/421942781 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f65a01a26f0 con 0x7f65a01090d0 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.270+0000 7f659d7fa640 1 -- 10.20.193.27:0/421942781 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f658c035e30 con 0x7f65a01090d0 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 10 mgrc shutdown 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 1 -- 10.20.193.27:0/421942781 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f657403dcc0 msgr2=0x7f6574040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:48.302 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 1 --2- 10.20.193.27:0/421942781 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f657403dcc0 0x7f6574040180 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f65900099c0 tx=0x7f6590006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.303 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 1 -- 10.20.193.27:0/421942781 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 msgr2=0x7f65a019edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:48.303 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 1 --2- 10.20.193.27:0/421942781 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a019edd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f658c002410 tx=0x7f658c02fd20 comp rx=0 tx=0).stop 2026-02-19T08:23:48.303 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 1 -- 10.20.193.27:0/421942781 shutdown_connections 2026-02-19T08:23:48.303 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 1 --2- 10.20.193.27:0/421942781 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f657403dcc0 0x7f6574040180 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.303 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 1 --2- 10.20.193.27:0/421942781 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65a01090d0 0x7f65a019edd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.303 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 1 -- 10.20.193.27:0/421942781 >> 10.20.193.27:0/421942781 conn(0x7f65a007c550 msgr2=0x7f65a0106670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:48.303 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 1 -- 10.20.193.27:0/421942781 shutdown_connections 2026-02-19T08:23:48.303 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.271+0000 7f65a6931640 1 -- 10.20.193.27:0/421942781 wait complete. 2026-02-19T08:23:48.304 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-19T08:23:48.304 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout disabled 2026-02-19T08:23:48.308 INFO:teuthology.orchestra.run.trial027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-19T08:23:48.308 INFO:teuthology.orchestra.run.trial027.stdout:systemctl: stdout inactive 2026-02-19T08:23:48.308 INFO:teuthology.orchestra.run.trial027.stdout:firewalld.service is not enabled 2026-02-19T08:23:48.308 INFO:teuthology.orchestra.run.trial027.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-19T08:23:48.309 INFO:teuthology.orchestra.run.trial027.stdout:Ceph Dashboard is now available at: 2026-02-19T08:23:48.309 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:48.309 INFO:teuthology.orchestra.run.trial027.stdout: URL: https://trial027:8443/ 2026-02-19T08:23:48.309 INFO:teuthology.orchestra.run.trial027.stdout: User: admin 2026-02-19T08:23:48.309 INFO:teuthology.orchestra.run.trial027.stdout: Password: 64l1pyoeux 2026-02-19T08:23:48.309 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:48.309 INFO:teuthology.orchestra.run.trial027.stdout:Saving cluster configuration to /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/config directory 2026-02-19T08:23:48.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.403+0000 7f9c5ad5c640 1 Processor -- start 2026-02-19T08:23:48.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.403+0000 7f9c5ad5c640 1 -- start start 2026-02-19T08:23:48.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.403+0000 7f9c5ad5c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c541094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:48.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.403+0000 7f9c5ad5c640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9c54109aa0 con 0x7f9c541090d0 2026-02-19T08:23:48.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.403+0000 7f9c58ad1640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c541094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:48.564 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.403+0000 7f9c58ad1640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c541094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41194/0 (socket says 10.20.193.27:41194) 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.403+0000 7f9c58ad1640 1 -- 10.20.193.27:0/4250155803 learned_addr learned my addr 10.20.193.27:0/4250155803 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.403+0000 7f9c58ad1640 1 -- 10.20.193.27:0/4250155803 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5410a2d0 con 0x7f9c541090d0 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c58ad1640 1 --2- 10.20.193.27:0/4250155803 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c541094d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009920 tx=0x7f9c4402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac5a676e1536db3 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c4b7fe640 1 -- 10.20.193.27:0/4250155803 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c4403c070 con 0x7f9c541090d0 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c4b7fe640 1 -- 10.20.193.27:0/4250155803 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f9c44037440 con 0x7f9c541090d0 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c4b7fe640 1 -- 10.20.193.27:0/4250155803 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c440354d0 con 0x7f9c541090d0 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/4250155803 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 msgr2=0x7f9c541094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c5ad5c640 1 --2- 10.20.193.27:0/4250155803 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c541094d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009920 tx=0x7f9c4402ef20 comp rx=0 tx=0).stop 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/4250155803 shutdown_connections 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c5ad5c640 1 --2- 10.20.193.27:0/4250155803 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c541094d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/4250155803 >> 10.20.193.27:0/4250155803 conn(0x7f9c5407c550 msgr2=0x7f9c5407c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:48.565 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/4250155803 shutdown_connections 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.404+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/4250155803 wait complete. 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c5ad5c640 1 Processor -- start 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c5ad5c640 1 -- start start 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c5ad5c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c5419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c5ad5c640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5410b160 con 0x7f9c541090d0 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c58ad1640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c5419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c58ad1640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c5419edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41206/0 (socket says 10.20.193.27:41206) 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c58ad1640 1 -- 10.20.193.27:0/3517769789 learned_addr learned my addr 10.20.193.27:0/3517769789 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c58ad1640 1 -- 10.20.193.27:0/3517769789 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5419f310 con 0x7f9c541090d0 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c58ad1640 1 --2- 10.20.193.27:0/3517769789 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c5419edd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c44002410 tx=0x7f9c4402fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c49ffb640 1 -- 10.20.193.27:0/3517769789 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c44047070 con 0x7f9c541090d0 2026-02-19T08:23:48.566 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/3517769789 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5419f5a0 con 0x7f9c541090d0 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c49ffb640 1 -- 10.20.193.27:0/3517769789 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f9c44042440 con 0x7f9c541090d0 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c49ffb640 1 -- 10.20.193.27:0/3517769789 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c4403c070 con 0x7f9c541090d0 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.405+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/3517769789 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c541a2290 con 0x7f9c541090d0 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.406+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/3517769789 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c54109550 con 0x7f9c541090d0 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.406+0000 7f9c49ffb640 1 -- 10.20.193.27:0/3517769789 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 11) ==== 50232+0+0 (secure 0 0 0) 0x7f9c44035b10 con 0x7f9c541090d0 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.406+0000 7f9c49ffb640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.406+0000 7f9c49ffb640 4 mgrc handle_mgr_map Got map version 11 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.406+0000 7f9c49ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.406+0000 7f9c49ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.406+0000 7f9c49ffb640 1 --2- 10.20.193.27:0/3517769789 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9c3003dcc0 0x7f9c30040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.406+0000 7f9c49ffb640 1 -- 10.20.193.27:0/3517769789 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9c44076ec0 con 0x7f9c541090d0 2026-02-19T08:23:48.567 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.406+0000 7f9c4bfff640 1 --2- 10.20.193.27:0/3517769789 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9c3003dcc0 0x7f9c30040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.407+0000 7f9c4bfff640 1 --2- 10.20.193.27:0/3517769789 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9c3003dcc0 0x7f9c30040180 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0099c0 tx=0x7f9c3c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.408+0000 7f9c49ffb640 1 -- 10.20.193.27:0/3517769789 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9c4404a360 con 0x7f9c541090d0 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.533+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/3517769789 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f9c541a26f0 con 0x7f9c541090d0 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.535+0000 7f9c49ffb640 1 -- 10.20.193.27:0/3517769789 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f9c4404f120 con 0x7f9c541090d0 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.535+0000 7f9c5ad5c640 10 mgrc shutdown 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.535+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/3517769789 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9c3003dcc0 msgr2=0x7f9c30040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.535+0000 7f9c5ad5c640 1 --2- 10.20.193.27:0/3517769789 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9c3003dcc0 0x7f9c30040180 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0099c0 tx=0x7f9c3c006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.536+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/3517769789 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 msgr2=0x7f9c5419edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.536+0000 7f9c5ad5c640 1 --2- 10.20.193.27:0/3517769789 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c5419edd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c44002410 tx=0x7f9c4402fd20 comp rx=0 tx=0).stop 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.536+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/3517769789 shutdown_connections 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.536+0000 7f9c5ad5c640 1 --2- 10.20.193.27:0/3517769789 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f9c3003dcc0 0x7f9c30040180 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.568 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.536+0000 7f9c5ad5c640 1 --2- 10.20.193.27:0/3517769789 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f9c541090d0 0x7f9c5419edd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.536+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/3517769789 >> 10.20.193.27:0/3517769789 conn(0x7f9c5407c550 msgr2=0x7f9c54106670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.536+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/3517769789 shutdown_connections 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout:/usr/bin/ceph: stderr 2026-02-19T08:23:48.536+0000 7f9c5ad5c640 1 -- 10.20.193.27:0/3517769789 wait complete. 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout:Or, if you are only running a single cluster on this host: 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:48.569 INFO:teuthology.orchestra.run.trial027.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-19T08:23:48.570 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:48.570 INFO:teuthology.orchestra.run.trial027.stdout: ceph telemetry on 2026-02-19T08:23:48.570 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:48.570 INFO:teuthology.orchestra.run.trial027.stdout:For more information see: 2026-02-19T08:23:48.570 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:48.570 INFO:teuthology.orchestra.run.trial027.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-19T08:23:48.570 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:48.570 INFO:teuthology.orchestra.run.trial027.stdout:Bootstrap complete. 2026-02-19T08:23:48.588 INFO:tasks.cephadm:Fetching config... 2026-02-19T08:23:48.588 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:48.588 DEBUG:teuthology.orchestra.run.trial027:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-19T08:23:48.606 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-19T08:23:48.606 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:48.606 DEBUG:teuthology.orchestra.run.trial027:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-19T08:23:48.664 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-19T08:23:48.664 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:48.664 DEBUG:teuthology.orchestra.run.trial027:> sudo dd if=/var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-19T08:23:48.730 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-19T08:23:48.730 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:48.731 DEBUG:teuthology.orchestra.run.trial027:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-19T08:23:48.788 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-19T08:23:48.788 DEBUG:teuthology.orchestra.run.trial027:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPtme7b9HvWjw9hUJqtvZdDmuY5InxeZPDkGL6ouUBTE ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-19T08:23:48.861 INFO:teuthology.orchestra.run.trial027.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPtme7b9HvWjw9hUJqtvZdDmuY5InxeZPDkGL6ouUBTE ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:48.871 DEBUG:teuthology.orchestra.run.trial116:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPtme7b9HvWjw9hUJqtvZdDmuY5InxeZPDkGL6ouUBTE ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-19T08:23:48.906 INFO:teuthology.orchestra.run.trial116.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPtme7b9HvWjw9hUJqtvZdDmuY5InxeZPDkGL6ouUBTE ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:48.916 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-19T08:23:49.069 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:23:49.101 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:49 trial027 ceph-mon[21739]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:49.101 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:49 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:49.101 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:49 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/421942781' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-19T08:23:49.101 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:49 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/3517769789' entity='client.admin' 2026-02-19T08:23:49.184 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.178+0000 7fba43677640 1 -- 10.20.193.27:0/2121971457 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fba3c1045e0 msgr2=0x7fba3c1049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:49.184 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.178+0000 7fba43677640 1 --2- 10.20.193.27:0/2121971457 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fba3c1045e0 0x7fba3c1049e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0099b0 tx=0x7fba2c02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:23:49.184 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.178+0000 7fba43677640 1 -- 10.20.193.27:0/2121971457 shutdown_connections 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.178+0000 7fba43677640 1 --2- 10.20.193.27:0/2121971457 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fba3c1045e0 0x7fba3c1049e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.178+0000 7fba43677640 1 -- 10.20.193.27:0/2121971457 >> 10.20.193.27:0/2121971457 conn(0x7fba3c0ffd70 msgr2=0x7fba3c1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.178+0000 7fba43677640 1 -- 10.20.193.27:0/2121971457 shutdown_connections 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.178+0000 7fba43677640 1 -- 10.20.193.27:0/2121971457 wait complete. 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba43677640 1 Processor -- start 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba43677640 1 -- start start 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba43677640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fba3c1045e0 0x7fba3c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba43677640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c109a60 con 0x7fba3c1045e0 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba413ec640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fba3c1045e0 0x7fba3c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba413ec640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fba3c1045e0 0x7fba3c19b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41218/0 (socket says 10.20.193.27:41218) 2026-02-19T08:23:49.185 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba413ec640 1 -- 10.20.193.27:0/1930793691 learned_addr learned my addr 10.20.193.27:0/1930793691 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba413ec640 1 -- 10.20.193.27:0/1930793691 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c19b6e0 con 0x7fba3c1045e0 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba413ec640 1 --2- 10.20.193.27:0/1930793691 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fba3c1045e0 0x7fba3c19b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba2c005ec0 tx=0x7fba2c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba2a7fc640 1 -- 10.20.193.27:0/1930793691 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba2c038510 con 0x7fba3c1045e0 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba2a7fc640 1 -- 10.20.193.27:0/1930793691 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fba2c046070 con 0x7fba3c1045e0 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba43677640 1 -- 10.20.193.27:0/1930793691 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c19b970 con 0x7fba3c1045e0 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba2a7fc640 1 -- 10.20.193.27:0/1930793691 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba2c041810 con 0x7fba3c1045e0 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.179+0000 7fba43677640 1 -- 10.20.193.27:0/1930793691 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3c19e660 con 0x7fba3c1045e0 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.180+0000 7fba2a7fc640 1 -- 10.20.193.27:0/1930793691 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7fba2c0419b0 con 0x7fba3c1045e0 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.180+0000 7fba2a7fc640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.180+0000 7fba43677640 1 -- 10.20.193.27:0/1930793691 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c10a200 con 0x7fba3c1045e0 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.180+0000 7fba2a7fc640 4 mgrc handle_mgr_map Got map version 12 2026-02-19T08:23:49.186 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.180+0000 7fba2a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:49.187 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.180+0000 7fba2a7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:49.187 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.180+0000 7fba2a7fc640 1 --2- 10.20.193.27:0/1930793691 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fba1803dde0 0x7fba180402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:49.187 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.180+0000 7fba2a7fc640 1 -- 10.20.193.27:0/1930793691 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fba2c0771e0 con 0x7fba3c1045e0 2026-02-19T08:23:49.187 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.180+0000 7fba40beb640 1 --2- 10.20.193.27:0/1930793691 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fba1803dde0 0x7fba180402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:49.187 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.180+0000 7fba40beb640 1 --2- 10.20.193.27:0/1930793691 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fba1803dde0 0x7fba180402a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fba300099c0 tx=0x7fba30006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:49.187 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.183+0000 7fba2a7fc640 1 -- 10.20.193.27:0/1930793691 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fba2c041cd0 con 0x7fba3c1045e0 2026-02-19T08:23:49.272 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.268+0000 7fba43677640 1 -- 10.20.193.27:0/1930793691 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fba3c194830 con 0x7fba3c1045e0 2026-02-19T08:23:49.273 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.270+0000 7fba2a7fc640 1 -- 10.20.193.27:0/1930793691 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fba2c047de0 con 0x7fba3c1045e0 2026-02-19T08:23:49.275 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 10 mgrc shutdown 2026-02-19T08:23:49.275 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 1 -- 10.20.193.27:0/1930793691 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fba1803dde0 msgr2=0x7fba180402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:49.276 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 1 --2- 10.20.193.27:0/1930793691 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fba1803dde0 0x7fba180402a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fba300099c0 tx=0x7fba30006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:49.276 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 1 -- 10.20.193.27:0/1930793691 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fba3c1045e0 msgr2=0x7fba3c19b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:49.276 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 1 --2- 10.20.193.27:0/1930793691 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fba3c1045e0 0x7fba3c19b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba2c005ec0 tx=0x7fba2c004290 comp rx=0 tx=0).stop 2026-02-19T08:23:49.276 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 1 -- 10.20.193.27:0/1930793691 shutdown_connections 2026-02-19T08:23:49.276 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 1 --2- 10.20.193.27:0/1930793691 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fba1803dde0 0x7fba180402a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:49.276 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 1 --2- 10.20.193.27:0/1930793691 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fba3c1045e0 0x7fba3c19b1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:49.276 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 1 -- 10.20.193.27:0/1930793691 >> 10.20.193.27:0/1930793691 conn(0x7fba3c0ffd70 msgr2=0x7fba3c1003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:49.276 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 1 -- 10.20.193.27:0/1930793691 shutdown_connections 2026-02-19T08:23:49.276 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.271+0000 7fba43677640 1 -- 10.20.193.27:0/1930793691 wait complete. 2026-02-19T08:23:49.327 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-19T08:23:49.327 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-19T08:23:49.482 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:23:49.603 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.599+0000 7f65c2621640 1 -- 10.20.193.27:0/1788942410 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65bc102160 msgr2=0x7f65bc102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:49.603 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.599+0000 7f65c2621640 1 --2- 10.20.193.27:0/1788942410 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65bc102160 0x7f65bc102560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0099b0 tx=0x7f65ac02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:23:49.603 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.599+0000 7f65c2621640 1 -- 10.20.193.27:0/1788942410 shutdown_connections 2026-02-19T08:23:49.604 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.599+0000 7f65c2621640 1 --2- 10.20.193.27:0/1788942410 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65bc102160 0x7f65bc102560 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:49.604 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.599+0000 7f65c2621640 1 -- 10.20.193.27:0/1788942410 >> 10.20.193.27:0/1788942410 conn(0x7f65bc0fd930 msgr2=0x7f65bc0ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:49.604 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.599+0000 7f65c2621640 1 -- 10.20.193.27:0/1788942410 shutdown_connections 2026-02-19T08:23:49.604 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.599+0000 7f65c2621640 1 -- 10.20.193.27:0/1788942410 wait complete. 2026-02-19T08:23:49.606 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c2621640 1 Processor -- start 2026-02-19T08:23:49.606 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c2621640 1 -- start start 2026-02-19T08:23:49.606 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c2621640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65bc102160 0x7f65bc19b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:49.606 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c2621640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1075e0 con 0x7f65bc102160 2026-02-19T08:23:49.606 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c161f640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65bc102160 0x7f65bc19b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:49.606 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c161f640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65bc102160 0x7f65bc19b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41232/0 (socket says 10.20.193.27:41232) 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c161f640 1 -- 10.20.193.27:0/443298280 learned_addr learned my addr 10.20.193.27:0/443298280 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c161f640 1 -- 10.20.193.27:0/443298280 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc19b5b0 con 0x7f65bc102160 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c161f640 1 --2- 10.20.193.27:0/443298280 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65bc102160 0x7f65bc19b070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005ec0 tx=0x7f65ac004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65aa7fc640 1 -- 10.20.193.27:0/443298280 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65ac038510 con 0x7f65bc102160 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c2621640 1 -- 10.20.193.27:0/443298280 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65bc19b840 con 0x7f65bc102160 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65aa7fc640 1 -- 10.20.193.27:0/443298280 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f65ac046070 con 0x7f65bc102160 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65aa7fc640 1 -- 10.20.193.27:0/443298280 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65ac041810 con 0x7f65bc102160 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.600+0000 7f65c2621640 1 -- 10.20.193.27:0/443298280 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65bc19bca0 con 0x7f65bc102160 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.601+0000 7f65aa7fc640 1 -- 10.20.193.27:0/443298280 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7f65ac0419b0 con 0x7f65bc102160 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.601+0000 7f65aa7fc640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.601+0000 7f65c2621640 1 -- 10.20.193.27:0/443298280 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65bc107d80 con 0x7f65bc102160 2026-02-19T08:23:49.607 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.601+0000 7f65aa7fc640 4 mgrc handle_mgr_map Got map version 12 2026-02-19T08:23:49.608 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.601+0000 7f65aa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:49.608 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.601+0000 7f65aa7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:49.608 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.601+0000 7f65aa7fc640 1 --2- 10.20.193.27:0/443298280 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f659803dde0 0x7f65980402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:49.608 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.601+0000 7f65aa7fc640 1 -- 10.20.193.27:0/443298280 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f65ac0771e0 con 0x7f65bc102160 2026-02-19T08:23:49.608 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.601+0000 7f65c0e1e640 1 --2- 10.20.193.27:0/443298280 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f659803dde0 0x7f65980402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:49.608 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.601+0000 7f65c0e1e640 1 --2- 10.20.193.27:0/443298280 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f659803dde0 0x7f65980402a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f65b00099c0 tx=0x7f65b0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:49.608 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.604+0000 7f65aa7fc640 1 -- 10.20.193.27:0/443298280 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f65ac04ac70 con 0x7f65bc102160 2026-02-19T08:23:49.691 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.688+0000 7f65c2621640 20 mgrc start_command cmd: [{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:49.691 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.688+0000 7f65c2621640 1 -- 10.20.193.27:0/443298280 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f65bc076ce0 con 0x7f659803dde0 2026-02-19T08:23:49.694 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.690+0000 7f65aa7fc640 1 -- 10.20.193.27:0/443298280 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f65bc076ce0 con 0x7f659803dde0 2026-02-19T08:23:49.694 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.690+0000 7f65aa7fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:49.695 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 10 mgrc shutdown 2026-02-19T08:23:49.695 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 1 -- 10.20.193.27:0/443298280 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f659803dde0 msgr2=0x7f65980402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:49.695 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 1 --2- 10.20.193.27:0/443298280 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f659803dde0 0x7f65980402a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f65b00099c0 tx=0x7f65b0006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:49.695 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 1 -- 10.20.193.27:0/443298280 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65bc102160 msgr2=0x7f65bc19b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:49.696 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 1 --2- 10.20.193.27:0/443298280 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65bc102160 0x7f65bc19b070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005ec0 tx=0x7f65ac004290 comp rx=0 tx=0).stop 2026-02-19T08:23:49.696 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 1 -- 10.20.193.27:0/443298280 shutdown_connections 2026-02-19T08:23:49.696 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 1 --2- 10.20.193.27:0/443298280 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f659803dde0 0x7f65980402a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:49.696 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 1 --2- 10.20.193.27:0/443298280 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f65bc102160 0x7f65bc19b070 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:49.696 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 1 -- 10.20.193.27:0/443298280 >> 10.20.193.27:0/443298280 conn(0x7f65bc0fd930 msgr2=0x7f65bc0ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:49.696 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 1 -- 10.20.193.27:0/443298280 shutdown_connections 2026-02-19T08:23:49.696 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:49.691+0000 7f65c2621640 1 -- 10.20.193.27:0/443298280 wait complete. 2026-02-19T08:23:49.730 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial116 2026-02-19T08:23:49.730 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:23:49.730 DEBUG:teuthology.orchestra.run.trial116:> dd of=/etc/ceph/ceph.conf 2026-02-19T08:23:49.748 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:23:49.749 DEBUG:teuthology.orchestra.run.trial116:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-19T08:23:49.804 INFO:tasks.cephadm:Adding host trial116 to orchestrator... 2026-02-19T08:23:49.805 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph orch host add trial116 2026-02-19T08:23:49.956 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:23:50.070 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 -- 10.20.193.27:0/2782723350 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc918102330 msgr2=0x7fc918102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:50.071 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 --2- 10.20.193.27:0/2782723350 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc918102330 0x7fc918102730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc9080099b0 tx=0x7fc90802f2b0 comp rx=0 tx=0).stop 2026-02-19T08:23:50.071 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 -- 10.20.193.27:0/2782723350 shutdown_connections 2026-02-19T08:23:50.071 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 --2- 10.20.193.27:0/2782723350 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc918102330 0x7fc918102730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:50.071 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 -- 10.20.193.27:0/2782723350 >> 10.20.193.27:0/2782723350 conn(0x7fc9180fdae0 msgr2=0x7fc9180fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:50.071 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 -- 10.20.193.27:0/2782723350 shutdown_connections 2026-02-19T08:23:50.071 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 -- 10.20.193.27:0/2782723350 wait complete. 2026-02-19T08:23:50.071 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 Processor -- start 2026-02-19T08:23:50.071 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 -- start start 2026-02-19T08:23:50.071 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc918102330 0x7fc918198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91f803640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc9181077b0 con 0x7fc918102330 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91d578640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc918102330 0x7fc918198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91d578640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc918102330 0x7fc918198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41262/0 (socket says 10.20.193.27:41262) 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.065+0000 7fc91d578640 1 -- 10.20.193.27:0/1885313928 learned_addr learned my addr 10.20.193.27:0/1885313928 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.066+0000 7fc91d578640 1 -- 10.20.193.27:0/1885313928 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9181994d0 con 0x7fc918102330 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.066+0000 7fc91d578640 1 --2- 10.20.193.27:0/1885313928 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc918102330 0x7fc918198f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc908005ec0 tx=0x7fc908004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.066+0000 7fc9067fc640 1 -- 10.20.193.27:0/1885313928 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc908038510 con 0x7fc918102330 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.066+0000 7fc91f803640 1 -- 10.20.193.27:0/1885313928 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc918199760 con 0x7fc918102330 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.066+0000 7fc9067fc640 1 -- 10.20.193.27:0/1885313928 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc908046070 con 0x7fc918102330 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.066+0000 7fc9067fc640 1 -- 10.20.193.27:0/1885313928 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc908041730 con 0x7fc918102330 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.066+0000 7fc91f803640 1 -- 10.20.193.27:0/1885313928 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc91819c450 con 0x7fc918102330 2026-02-19T08:23:50.072 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.066+0000 7fc91f803640 1 -- 10.20.193.27:0/1885313928 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc918107f50 con 0x7fc918102330 2026-02-19T08:23:50.073 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.067+0000 7fc9067fc640 1 -- 10.20.193.27:0/1885313928 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7fc9080419f0 con 0x7fc918102330 2026-02-19T08:23:50.073 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.067+0000 7fc9067fc640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-19T08:23:50.073 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.067+0000 7fc9067fc640 4 mgrc handle_mgr_map Got map version 12 2026-02-19T08:23:50.073 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.067+0000 7fc9067fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:50.073 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.067+0000 7fc9067fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:50.073 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.067+0000 7fc9067fc640 1 --2- 10.20.193.27:0/1885313928 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc8f403dd90 0x7fc8f4040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:50.073 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.067+0000 7fc9067fc640 1 -- 10.20.193.27:0/1885313928 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc908077250 con 0x7fc918102330 2026-02-19T08:23:50.073 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.067+0000 7fc91cd77640 1 --2- 10.20.193.27:0/1885313928 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc8f403dd90 0x7fc8f4040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:50.073 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.067+0000 7fc91cd77640 1 --2- 10.20.193.27:0/1885313928 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc8f403dd90 0x7fc8f4040250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc90c0099c0 tx=0x7fc90c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:50.074 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.069+0000 7fc9067fc640 1 -- 10.20.193.27:0/1885313928 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc908041d10 con 0x7fc918102330 2026-02-19T08:23:50.161 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.158+0000 7fc91f803640 20 mgrc start_command cmd: [{"prefix": "orch host add", "hostname": "trial116", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:50.161 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:50.158+0000 7fc91f803640 1 -- 10.20.193.27:0/1885313928 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial116", "target": ["mon-mgr", ""]}) -- 0x7fc918192540 con 0x7fc8f403dd90 2026-02-19T08:23:50.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: mgrmap e12: a(active, since 2s) 2026-02-19T08:23:50.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1930793691' entity='client.admin' 2026-02-19T08:23:50.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:50.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:50.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial027", "name": "osd_memory_target"}]: dispatch 2026-02-19T08:23:50.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:50.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:50.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:50.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:50.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:50.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:50.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:23:50.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-19T08:23:50.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:50 trial027 ceph-mon[21739]: Updating trial027:/etc/ceph/ceph.conf 2026-02-19T08:23:51.597 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:51 trial027 ceph-mon[21739]: Updating trial027:/var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/config/ceph.conf 2026-02-19T08:23:51.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:51 trial027 ceph-mon[21739]: Updating trial027:/etc/ceph/ceph.client.admin.keyring 2026-02-19T08:23:51.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:51 trial027 ceph-mon[21739]: Updating trial027:/var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-19T08:23:51.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:51 trial027 ceph-mon[21739]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial116", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:51.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:51 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:51.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:51 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:51.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:51 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:51.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:51 trial027 ceph-mon[21739]: Deploying cephadm binary to trial116 2026-02-19T08:23:51.675 INFO:teuthology.orchestra.run.trial027.stdout:Added host 'trial116' with addr '10.20.193.116' 2026-02-19T08:23:51.676 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.671+0000 7fc9067fc640 1 -- 10.20.193.27:0/1885313928 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fc918192540 con 0x7fc8f403dd90 2026-02-19T08:23:51.676 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.672+0000 7fc9067fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:51.678 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 10 mgrc shutdown 2026-02-19T08:23:51.678 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 1 -- 10.20.193.27:0/1885313928 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc8f403dd90 msgr2=0x7fc8f4040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:51.678 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 1 --2- 10.20.193.27:0/1885313928 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc8f403dd90 0x7fc8f4040250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc90c0099c0 tx=0x7fc90c006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:51.678 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 1 -- 10.20.193.27:0/1885313928 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc918102330 msgr2=0x7fc918198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:51.678 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 1 --2- 10.20.193.27:0/1885313928 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc918102330 0x7fc918198f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc908005ec0 tx=0x7fc908004290 comp rx=0 tx=0).stop 2026-02-19T08:23:51.678 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 1 -- 10.20.193.27:0/1885313928 shutdown_connections 2026-02-19T08:23:51.679 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 1 --2- 10.20.193.27:0/1885313928 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc8f403dd90 0x7fc8f4040250 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:51.679 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 1 --2- 10.20.193.27:0/1885313928 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc918102330 0x7fc918198f90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:51.679 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 1 -- 10.20.193.27:0/1885313928 >> 10.20.193.27:0/1885313928 conn(0x7fc9180fdae0 msgr2=0x7fc9180fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:51.679 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 1 -- 10.20.193.27:0/1885313928 shutdown_connections 2026-02-19T08:23:51.679 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.674+0000 7fc91f803640 1 -- 10.20.193.27:0/1885313928 wait complete. 2026-02-19T08:23:51.716 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-19T08:23:51.867 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:23:51.977 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.971+0000 7fd745341640 1 -- 10.20.193.27:0/2156383220 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fd74010a620 msgr2=0x7fd74010aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:51.977 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.971+0000 7fd745341640 1 --2- 10.20.193.27:0/2156383220 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fd74010a620 0x7fd74010aa00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7340099b0 tx=0x7fd73402f2b0 comp rx=0 tx=0).stop 2026-02-19T08:23:51.977 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.971+0000 7fd745341640 1 -- 10.20.193.27:0/2156383220 shutdown_connections 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.971+0000 7fd745341640 1 --2- 10.20.193.27:0/2156383220 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fd74010a620 0x7fd74010aa00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.971+0000 7fd745341640 1 -- 10.20.193.27:0/2156383220 >> 10.20.193.27:0/2156383220 conn(0x7fd740100290 msgr2=0x7fd7401026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.971+0000 7fd745341640 1 -- 10.20.193.27:0/2156383220 shutdown_connections 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.971+0000 7fd745341640 1 -- 10.20.193.27:0/2156383220 wait complete. 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd745341640 1 Processor -- start 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd745341640 1 -- start start 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd745341640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fd74010a620 0x7fd74019b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd745341640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fd74010dfb0 con 0x7fd74010a620 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd73effd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fd74010a620 0x7fd74019b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd73effd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fd74010a620 0x7fd74019b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41276/0 (socket says 10.20.193.27:41276) 2026-02-19T08:23:51.978 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd73effd640 1 -- 10.20.193.27:0/837482949 learned_addr learned my addr 10.20.193.27:0/837482949 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd73effd640 1 -- 10.20.193.27:0/837482949 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74019bb20 con 0x7fd74010a620 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd73effd640 1 --2- 10.20.193.27:0/837482949 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fd74010a620 0x7fd74019b5e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd734004290 tx=0x7fd7340042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd71ffff640 1 -- 10.20.193.27:0/837482949 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd734038510 con 0x7fd74010a620 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd71ffff640 1 -- 10.20.193.27:0/837482949 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fd734046070 con 0x7fd74010a620 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd745341640 1 -- 10.20.193.27:0/837482949 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74019bdb0 con 0x7fd74010a620 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd71ffff640 1 -- 10.20.193.27:0/837482949 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd734041610 con 0x7fd74010a620 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.972+0000 7fd745341640 1 -- 10.20.193.27:0/837482949 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74019c210 con 0x7fd74010a620 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.973+0000 7fd745341640 1 -- 10.20.193.27:0/837482949 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd740105c90 con 0x7fd74010a620 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.973+0000 7fd71ffff640 1 -- 10.20.193.27:0/837482949 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7fd7340386b0 con 0x7fd74010a620 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.973+0000 7fd71ffff640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.973+0000 7fd71ffff640 4 mgrc handle_mgr_map Got map version 12 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.973+0000 7fd71ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:51.979 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.973+0000 7fd71ffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:51.980 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.973+0000 7fd71ffff640 1 --2- 10.20.193.27:0/837482949 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fd71003dde0 0x7fd7100402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:51.980 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.973+0000 7fd71ffff640 1 -- 10.20.193.27:0/837482949 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd734077180 con 0x7fd74010a620 2026-02-19T08:23:51.980 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.973+0000 7fd73e7fc640 1 --2- 10.20.193.27:0/837482949 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fd71003dde0 0x7fd7100402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:51.980 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.974+0000 7fd73e7fc640 1 --2- 10.20.193.27:0/837482949 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fd71003dde0 0x7fd7100402a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7280099c0 tx=0x7fd728006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:51.980 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:51.976+0000 7fd71ffff640 1 -- 10.20.193.27:0/837482949 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd734040360 con 0x7fd74010a620 2026-02-19T08:23:52.065 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.062+0000 7fd745341640 20 mgrc start_command cmd: [{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-19T08:23:52.065 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.062+0000 7fd745341640 1 -- 10.20.193.27:0/837482949 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd74010aab0 con 0x7fd71003dde0 2026-02-19T08:23:52.066 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.063+0000 7fd71ffff640 1 -- 10.20.193.27:0/837482949 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7fd74010aab0 con 0x7fd71003dde0 2026-02-19T08:23:52.066 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.063+0000 7fd71ffff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:52.067 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:52.067 INFO:teuthology.orchestra.run.trial027.stdout:[{"addr": "10.20.193.27", "hostname": "trial027", "labels": [], "status": ""}, {"addr": "10.20.193.116", "hostname": "trial116", "labels": [], "status": ""}] 2026-02-19T08:23:52.068 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 10 mgrc shutdown 2026-02-19T08:23:52.068 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 1 -- 10.20.193.27:0/837482949 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fd71003dde0 msgr2=0x7fd7100402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:52.068 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 1 --2- 10.20.193.27:0/837482949 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fd71003dde0 0x7fd7100402a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7280099c0 tx=0x7fd728006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:52.068 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 1 -- 10.20.193.27:0/837482949 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fd74010a620 msgr2=0x7fd74019b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:52.068 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 1 --2- 10.20.193.27:0/837482949 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fd74010a620 0x7fd74019b5e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd734004290 tx=0x7fd7340042c0 comp rx=0 tx=0).stop 2026-02-19T08:23:52.068 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 1 -- 10.20.193.27:0/837482949 shutdown_connections 2026-02-19T08:23:52.069 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 1 --2- 10.20.193.27:0/837482949 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fd71003dde0 0x7fd7100402a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:52.069 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 1 --2- 10.20.193.27:0/837482949 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fd74010a620 0x7fd74019b5e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:52.069 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 1 -- 10.20.193.27:0/837482949 >> 10.20.193.27:0/837482949 conn(0x7fd740100290 msgr2=0x7fd740109790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:52.069 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 1 -- 10.20.193.27:0/837482949 shutdown_connections 2026-02-19T08:23:52.069 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.064+0000 7fd745341640 1 -- 10.20.193.27:0/837482949 wait complete. 2026-02-19T08:23:52.103 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-19T08:23:52.104 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd crush tunables default 2026-02-19T08:23:52.251 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:23:52.359 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 -- 10.20.193.27:0/4102335830 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8b0010a600 msgr2=0x7f8b0010a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:52.360 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 --2- 10.20.193.27:0/4102335830 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8b0010a600 0x7f8b0010a9e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8af40099b0 tx=0x7f8af402f2b0 comp rx=0 tx=0).stop 2026-02-19T08:23:52.360 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 -- 10.20.193.27:0/4102335830 shutdown_connections 2026-02-19T08:23:52.360 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 --2- 10.20.193.27:0/4102335830 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8b0010a600 0x7f8b0010a9e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:52.360 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 -- 10.20.193.27:0/4102335830 >> 10.20.193.27:0/4102335830 conn(0x7f8b00100290 msgr2=0x7f8b001026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:52.360 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 -- 10.20.193.27:0/4102335830 shutdown_connections 2026-02-19T08:23:52.360 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 -- 10.20.193.27:0/4102335830 wait complete. 2026-02-19T08:23:52.360 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 Processor -- start 2026-02-19T08:23:52.360 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 -- start start 2026-02-19T08:23:52.360 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8b0010a600 0x7f8b0019b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:52.360 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8b056ae640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0010df90 con 0x7f8b0010a600 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8afeffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8b0010a600 0x7f8b0019b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8afeffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8b0010a600 0x7f8b0019b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41286/0 (socket says 10.20.193.27:41286) 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.354+0000 7f8afeffd640 1 -- 10.20.193.27:0/526776072 learned_addr learned my addr 10.20.193.27:0/526776072 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8afeffd640 1 -- 10.20.193.27:0/526776072 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0019ba60 con 0x7f8b0010a600 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8afeffd640 1 --2- 10.20.193.27:0/526776072 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8b0010a600 0x7f8b0019b520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8af4004290 tx=0x7f8af40042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8adffff640 1 -- 10.20.193.27:0/526776072 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af4038510 con 0x7f8b0010a600 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8adffff640 1 -- 10.20.193.27:0/526776072 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8af4046070 con 0x7f8b0010a600 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8b056ae640 1 -- 10.20.193.27:0/526776072 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0019bcf0 con 0x7f8b0010a600 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8adffff640 1 -- 10.20.193.27:0/526776072 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af4041610 con 0x7f8b0010a600 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8b056ae640 1 -- 10.20.193.27:0/526776072 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0019fdf0 con 0x7f8b0010a600 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8b056ae640 1 -- 10.20.193.27:0/526776072 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b00105c70 con 0x7f8b0010a600 2026-02-19T08:23:52.361 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8adffff640 1 -- 10.20.193.27:0/526776072 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7f8af40386b0 con 0x7f8b0010a600 2026-02-19T08:23:52.362 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8adffff640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-19T08:23:52.362 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8adffff640 4 mgrc handle_mgr_map Got map version 12 2026-02-19T08:23:52.362 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8adffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:52.362 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8adffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:52.362 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8adffff640 1 --2- 10.20.193.27:0/526776072 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8ad403dde0 0x7f8ad40402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:52.362 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.355+0000 7f8adffff640 1 -- 10.20.193.27:0/526776072 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8af40770f0 con 0x7f8b0010a600 2026-02-19T08:23:52.362 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.356+0000 7f8afe7fc640 1 --2- 10.20.193.27:0/526776072 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8ad403dde0 0x7f8ad40402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:52.362 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.356+0000 7f8afe7fc640 1 --2- 10.20.193.27:0/526776072 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8ad403dde0 0x7f8ad40402a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80099c0 tx=0x7f8ae8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:52.363 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.358+0000 7f8adffff640 1 -- 10.20.193.27:0/526776072 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8af404ade0 con 0x7f8b0010a600 2026-02-19T08:23:52.446 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.443+0000 7f8b056ae640 1 -- 10.20.193.27:0/526776072 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8b0010aa60 con 0x7f8b0010a600 2026-02-19T08:23:52.996 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.992+0000 7f8adffff640 1 -- 10.20.193.27:0/526776072 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f8af40389d0 con 0x7f8b0010a600 2026-02-19T08:23:52.996 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:52 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:52.997 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:52 trial027 ceph-mon[21739]: Added host trial116 2026-02-19T08:23:52.997 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:52 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:52.997 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:52 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:52.997 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:52 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:52.997 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:52 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/526776072' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-19T08:23:52.997 INFO:teuthology.orchestra.run.trial027.stderr:adjusted tunables profile to default 2026-02-19T08:23:52.998 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.994+0000 7f8b056ae640 10 mgrc shutdown 2026-02-19T08:23:52.998 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.994+0000 7f8b056ae640 1 -- 10.20.193.27:0/526776072 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8ad403dde0 msgr2=0x7f8ad40402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:52.999 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.994+0000 7f8b056ae640 1 --2- 10.20.193.27:0/526776072 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8ad403dde0 0x7f8ad40402a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80099c0 tx=0x7f8ae8006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:52.999 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.995+0000 7f8b056ae640 1 -- 10.20.193.27:0/526776072 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8b0010a600 msgr2=0x7f8b0019b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:52.999 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.995+0000 7f8b056ae640 1 --2- 10.20.193.27:0/526776072 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8b0010a600 0x7f8b0019b520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8af4004290 tx=0x7f8af40042c0 comp rx=0 tx=0).stop 2026-02-19T08:23:52.999 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.995+0000 7f8b056ae640 1 -- 10.20.193.27:0/526776072 shutdown_connections 2026-02-19T08:23:52.999 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.995+0000 7f8b056ae640 1 --2- 10.20.193.27:0/526776072 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8ad403dde0 0x7f8ad40402a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:52.999 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.995+0000 7f8b056ae640 1 --2- 10.20.193.27:0/526776072 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8b0010a600 0x7f8b0019b520 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:52.999 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.995+0000 7f8b056ae640 1 -- 10.20.193.27:0/526776072 >> 10.20.193.27:0/526776072 conn(0x7f8b00100290 msgr2=0x7f8b00109760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:52.999 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.995+0000 7f8b056ae640 1 -- 10.20.193.27:0/526776072 shutdown_connections 2026-02-19T08:23:52.999 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:52.995+0000 7f8b056ae640 1 -- 10.20.193.27:0/526776072 wait complete. 2026-02-19T08:23:53.037 INFO:tasks.cephadm:Adding mon.a on trial027 2026-02-19T08:23:53.037 DEBUG:teuthology.orchestra.run.trial116:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph orch apply mon '1;trial027:10.20.193.27=a' 2026-02-19T08:23:53.256 INFO:teuthology.orchestra.run.trial116.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-19T08:23:53.291 INFO:teuthology.orchestra.run.trial116.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-19T08:23:53.402 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.397+0000 7f702d1d4640 1 -- 10.20.193.116:0/3010663581 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7018002d10 con 0x7f70281045e0 2026-02-19T08:23:53.402 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.397+0000 7f7030461640 1 -- 10.20.193.116:0/3010663581 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f70281045e0 msgr2=0x7f70281049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:53.402 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.397+0000 7f7030461640 1 --2- 10.20.193.116:0/3010663581 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f70281045e0 0x7f70281049e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70180099b0 tx=0x7f701802f2b0 comp rx=0 tx=0).stop 2026-02-19T08:23:53.402 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.397+0000 7f7030461640 1 -- 10.20.193.116:0/3010663581 shutdown_connections 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.397+0000 7f7030461640 1 --2- 10.20.193.116:0/3010663581 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f70281045e0 0x7f70281049e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.397+0000 7f7030461640 1 -- 10.20.193.116:0/3010663581 >> 10.20.193.116:0/3010663581 conn(0x7f70280ffd70 msgr2=0x7f70281021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.397+0000 7f7030461640 1 -- 10.20.193.116:0/3010663581 shutdown_connections 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.397+0000 7f7030461640 1 -- 10.20.193.116:0/3010663581 wait complete. 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.398+0000 7f7030461640 1 Processor -- start 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.398+0000 7f7030461640 1 -- start start 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.398+0000 7f7030461640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f70281045e0 0x7f702819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.398+0000 7f7030461640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7028109a60 con 0x7f70281045e0 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.398+0000 7f702e1d6640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f70281045e0 0x7f702819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.398+0000 7f702e1d6640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f70281045e0 0x7f702819b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.116:53138/0 (socket says 10.20.193.116:53138) 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.398+0000 7f702e1d6640 1 -- 10.20.193.116:0/4027694819 learned_addr learned my addr 10.20.193.116:0/4027694819 (peer_addr_for_me v2:10.20.193.116:0/0) 2026-02-19T08:23:53.403 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.398+0000 7f702e1d6640 1 -- 10.20.193.116:0/4027694819 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702819b6e0 con 0x7f70281045e0 2026-02-19T08:23:53.405 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.399+0000 7f702e1d6640 1 --2- 10.20.193.116:0/4027694819 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f70281045e0 0x7f702819b1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7018005ec0 tx=0x7f7018004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:53.405 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.399+0000 7f700f7fe640 1 -- 10.20.193.116:0/4027694819 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7018038510 con 0x7f70281045e0 2026-02-19T08:23:53.405 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.399+0000 7f7030461640 1 -- 10.20.193.116:0/4027694819 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702819b970 con 0x7f70281045e0 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.399+0000 7f700f7fe640 1 -- 10.20.193.116:0/4027694819 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7018046070 con 0x7f70281045e0 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.399+0000 7f700f7fe640 1 -- 10.20.193.116:0/4027694819 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7018041810 con 0x7f70281045e0 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.399+0000 7f7030461640 1 -- 10.20.193.116:0/4027694819 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702819e660 con 0x7f70281045e0 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.400+0000 7f7030461640 1 -- 10.20.193.116:0/4027694819 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f702810a200 con 0x7f70281045e0 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.400+0000 7f700f7fe640 1 -- 10.20.193.116:0/4027694819 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f70180386b0 con 0x7f70281045e0 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.400+0000 7f700f7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.400+0000 7f700f7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.400+0000 7f700f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.400+0000 7f700f7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.400+0000 7f700f7fe640 1 --2- 10.20.193.116:0/4027694819 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f700403de30 0x7f70040402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.401+0000 7f700f7fe640 1 -- 10.20.193.116:0/4027694819 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7018077cf0 con 0x7f70281045e0 2026-02-19T08:23:53.406 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.401+0000 7f702d9d5640 1 --2- 10.20.193.116:0/4027694819 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f700403de30 0x7f70040402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:53.407 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.401+0000 7f702d9d5640 1 --2- 10.20.193.116:0/4027694819 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f700403de30 0x7f70040402f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f701c0099c0 tx=0x7f701c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:53.407 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.403+0000 7f700f7fe640 1 -- 10.20.193.116:0/4027694819 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7018050020 con 0x7f70281045e0 2026-02-19T08:23:53.499 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.496+0000 7f7030461640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial027:10.20.193.27=a", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:53.499 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.496+0000 7f7030461640 1 -- 10.20.193.116:0/4027694819 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "1;trial027:10.20.193.27=a", "target": ["mon-mgr", ""]}) -- 0x7f70281947f0 con 0x7f700403de30 2026-02-19T08:23:53.505 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.502+0000 7f700f7fe640 1 -- 10.20.193.116:0/4027694819 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f70281947f0 con 0x7f700403de30 2026-02-19T08:23:53.505 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.502+0000 7f700f7fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:53.506 INFO:teuthology.orchestra.run.trial116.stdout:Scheduled mon update... 2026-02-19T08:23:53.507 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 10 mgrc shutdown 2026-02-19T08:23:53.507 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 1 -- 10.20.193.116:0/4027694819 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f700403de30 msgr2=0x7f70040402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:53.508 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 1 --2- 10.20.193.116:0/4027694819 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f700403de30 0x7f70040402f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f701c0099c0 tx=0x7f701c006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:53.508 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 1 -- 10.20.193.116:0/4027694819 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f70281045e0 msgr2=0x7f702819b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:53.508 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 1 --2- 10.20.193.116:0/4027694819 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f70281045e0 0x7f702819b1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7018005ec0 tx=0x7f7018004290 comp rx=0 tx=0).stop 2026-02-19T08:23:53.508 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 1 -- 10.20.193.116:0/4027694819 shutdown_connections 2026-02-19T08:23:53.508 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 1 --2- 10.20.193.116:0/4027694819 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f700403de30 0x7f70040402f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:53.508 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 1 --2- 10.20.193.116:0/4027694819 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f70281045e0 0x7f702819b1a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:53.508 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 1 -- 10.20.193.116:0/4027694819 >> 10.20.193.116:0/4027694819 conn(0x7f70280ffd70 msgr2=0x7f70281003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:53.508 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 1 -- 10.20.193.116:0/4027694819 shutdown_connections 2026-02-19T08:23:53.508 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.503+0000 7f7030461640 1 -- 10.20.193.116:0/4027694819 wait complete. 2026-02-19T08:23:53.543 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-02-19T08:23:53.544 DEBUG:teuthology.orchestra.run.trial116:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph mon dump -f json 2026-02-19T08:23:53.687 INFO:teuthology.orchestra.run.trial116.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-19T08:23:53.739 INFO:teuthology.orchestra.run.trial116.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-19T08:23:53.873 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.868+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3167408977 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f7fa81045e0 msgr2=0x7f7fa81049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:53.873 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.868+0000 7f7fad6a6640 1 --2- 10.20.193.116:0/3167408977 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f7fa81045e0 0x7f7fa81049e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0099b0 tx=0x7f7f9c02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:23:53.873 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.868+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3167408977 shutdown_connections 2026-02-19T08:23:53.873 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.868+0000 7f7fad6a6640 1 --2- 10.20.193.116:0/3167408977 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f7fa81045e0 0x7f7fa81049e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:53.873 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.868+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3167408977 >> 10.20.193.116:0/3167408977 conn(0x7f7fa80ffd70 msgr2=0x7f7fa81021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:53.873 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.868+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3167408977 shutdown_connections 2026-02-19T08:23:53.873 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.868+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3167408977 wait complete. 2026-02-19T08:23:53.873 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.869+0000 7f7fad6a6640 1 Processor -- start 2026-02-19T08:23:53.873 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.869+0000 7f7fad6a6640 1 -- start start 2026-02-19T08:23:53.874 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.869+0000 7f7fad6a6640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f7fa81045e0 0x7f7fa819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:53.874 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.869+0000 7f7fad6a6640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8109a60 con 0x7f7fa81045e0 2026-02-19T08:23:53.874 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.869+0000 7f7fa6ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f7fa81045e0 0x7f7fa819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:53.874 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.869+0000 7f7fa6ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f7fa81045e0 0x7f7fa819b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.116:53156/0 (socket says 10.20.193.116:53156) 2026-02-19T08:23:53.874 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.869+0000 7f7fa6ffd640 1 -- 10.20.193.116:0/3372312607 learned_addr learned my addr 10.20.193.116:0/3372312607 (peer_addr_for_me v2:10.20.193.116:0/0) 2026-02-19T08:23:53.876 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.869+0000 7f7fa6ffd640 1 -- 10.20.193.116:0/3372312607 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa819b6e0 con 0x7f7fa81045e0 2026-02-19T08:23:53.876 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.870+0000 7f7fa6ffd640 1 --2- 10.20.193.116:0/3372312607 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f7fa81045e0 0x7f7fa819b1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c005ec0 tx=0x7f7f9c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:53.876 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.870+0000 7f7f87fff640 1 -- 10.20.193.116:0/3372312607 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f9c038510 con 0x7f7fa81045e0 2026-02-19T08:23:53.876 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.870+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3372312607 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa819b970 con 0x7f7fa81045e0 2026-02-19T08:23:53.876 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.870+0000 7f7f87fff640 1 -- 10.20.193.116:0/3372312607 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7f9c046070 con 0x7f7fa81045e0 2026-02-19T08:23:53.876 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.870+0000 7f7f87fff640 1 -- 10.20.193.116:0/3372312607 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f9c041810 con 0x7f7fa81045e0 2026-02-19T08:23:53.876 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.870+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3372312607 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa819e660 con 0x7f7fa81045e0 2026-02-19T08:23:53.876 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.870+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3372312607 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa810a200 con 0x7f7fa81045e0 2026-02-19T08:23:53.877 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.870+0000 7f7f87fff640 1 -- 10.20.193.116:0/3372312607 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f7f9c0386b0 con 0x7f7fa81045e0 2026-02-19T08:23:53.877 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.870+0000 7f7f87fff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:23:53.877 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.871+0000 7f7f87fff640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:23:53.877 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.871+0000 7f7f87fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:53.877 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.871+0000 7f7f87fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:53.877 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.871+0000 7f7f87fff640 1 --2- 10.20.193.116:0/3372312607 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f7f7c03de80 0x7f7f7c040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:53.877 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.871+0000 7f7f87fff640 1 -- 10.20.193.116:0/3372312607 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7f9c077520 con 0x7f7fa81045e0 2026-02-19T08:23:53.877 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.871+0000 7f7fa67fc640 1 --2- 10.20.193.116:0/3372312607 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f7f7c03de80 0x7f7f7c040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:53.877 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.871+0000 7f7fa67fc640 1 --2- 10.20.193.116:0/3372312607 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f7f7c03de80 0x7f7f7c040340 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7f900099c0 tx=0x7f7f90006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:53.878 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.873+0000 7f7f87fff640 1 -- 10.20.193.116:0/3372312607 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7f9c035320 con 0x7f7fa81045e0 2026-02-19T08:23:53.991 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.987+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3372312607 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7fa81947c0 con 0x7f7fa81045e0 2026-02-19T08:23:53.991 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.987+0000 7f7f87fff640 1 -- 10.20.193.116:0/3372312607 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f7f9c036370 con 0x7f7fa81045e0 2026-02-19T08:23:53.992 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:23:53.992 INFO:teuthology.orchestra.run.trial116.stdout:{"epoch":1,"fsid":"3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460","modified":"2026-02-19T08:23:27.537335Z","created":"2026-02-19T08:23:27.537335Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:3300","nonce":0},{"type":"v1","addr":"10.20.193.27:6789","nonce":0}]},"addr":"10.20.193.27:6789/0","public_addr":"10.20.193.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-19T08:23:53.993 INFO:teuthology.orchestra.run.trial116.stderr:dumped monmap epoch 1 2026-02-19T08:23:53.993 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 10 mgrc shutdown 2026-02-19T08:23:53.993 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3372312607 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f7f7c03de80 msgr2=0x7f7f7c040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:53.993 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 1 --2- 10.20.193.116:0/3372312607 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f7f7c03de80 0x7f7f7c040340 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7f900099c0 tx=0x7f7f90006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:53.993 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3372312607 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f7fa81045e0 msgr2=0x7f7fa819b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:53.993 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 1 --2- 10.20.193.116:0/3372312607 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f7fa81045e0 0x7f7fa819b1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c005ec0 tx=0x7f7f9c004290 comp rx=0 tx=0).stop 2026-02-19T08:23:53.993 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3372312607 shutdown_connections 2026-02-19T08:23:53.994 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 1 --2- 10.20.193.116:0/3372312607 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f7f7c03de80 0x7f7f7c040340 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:53.994 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 1 --2- 10.20.193.116:0/3372312607 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f7fa81045e0 0x7f7fa819b1a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:53.994 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3372312607 >> 10.20.193.116:0/3372312607 conn(0x7f7fa80ffd70 msgr2=0x7f7fa81003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:53.994 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3372312607 shutdown_connections 2026-02-19T08:23:53.994 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:53.988+0000 7f7fad6a6640 1 -- 10.20.193.116:0/3372312607 wait complete. 2026-02-19T08:23:54.030 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-19T08:23:54.031 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-19T08:23:54.053 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T08:23:54.053 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:54.053 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/526776072' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-19T08:23:54.054 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: osdmap e4: 0 total, 0 up, 0 in 2026-02-19T08:23:54.054 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: mgrmap e13: a(active, since 6s) 2026-02-19T08:23:54.054 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:54.054 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:54.054 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:54.054 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:54.054 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:54.054 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial116", "name": "osd_memory_target"}]: dispatch 2026-02-19T08:23:54.054 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:23:54.054 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:53 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-19T08:23:54.178 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:23:54.294 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.288+0000 7f04fcc16640 1 -- 10.20.193.27:0/3901816003 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f04f810a650 msgr2=0x7f04f810aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:54.295 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.288+0000 7f04fcc16640 1 --2- 10.20.193.27:0/3901816003 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f04f810a650 0x7f04f810aa30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0099b0 tx=0x7f04ec02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:23:54.295 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.288+0000 7f04fcc16640 1 -- 10.20.193.27:0/3901816003 shutdown_connections 2026-02-19T08:23:54.295 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.288+0000 7f04fcc16640 1 --2- 10.20.193.27:0/3901816003 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f04f810a650 0x7f04f810aa30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:54.295 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.288+0000 7f04fcc16640 1 -- 10.20.193.27:0/3901816003 >> 10.20.193.27:0/3901816003 conn(0x7f04f8100260 msgr2=0x7f04f8102680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:54.295 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.288+0000 7f04fcc16640 1 -- 10.20.193.27:0/3901816003 shutdown_connections 2026-02-19T08:23:54.295 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.289+0000 7f04fcc16640 1 -- 10.20.193.27:0/3901816003 wait complete. 2026-02-19T08:23:54.295 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.289+0000 7f04fcc16640 1 Processor -- start 2026-02-19T08:23:54.295 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.289+0000 7f04fcc16640 1 -- start start 2026-02-19T08:23:54.295 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.289+0000 7f04fcc16640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f04f810a650 0x7f04f819b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:54.295 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.289+0000 7f04fcc16640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f04f810dfe0 con 0x7f04f810a650 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.289+0000 7f04f6575640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f04f810a650 0x7f04f819b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.289+0000 7f04f6575640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f04f810a650 0x7f04f819b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41296/0 (socket says 10.20.193.27:41296) 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.289+0000 7f04f6575640 1 -- 10.20.193.27:0/54305289 learned_addr learned my addr 10.20.193.27:0/54305289 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.289+0000 7f04f6575640 1 -- 10.20.193.27:0/54305289 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f819ba90 con 0x7f04f810a650 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.289+0000 7f04f6575640 1 --2- 10.20.193.27:0/54305289 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f04f810a650 0x7f04f819b550 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f04ec004290 tx=0x7f04ec0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04df7fe640 1 -- 10.20.193.27:0/54305289 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ec038510 con 0x7f04f810a650 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04df7fe640 1 -- 10.20.193.27:0/54305289 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f04ec046070 con 0x7f04f810a650 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04fcc16640 1 -- 10.20.193.27:0/54305289 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f819bd20 con 0x7f04f810a650 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04df7fe640 1 -- 10.20.193.27:0/54305289 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ec041610 con 0x7f04f810a650 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04fcc16640 1 -- 10.20.193.27:0/54305289 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f819fe20 con 0x7f04f810a650 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04fcc16640 1 -- 10.20.193.27:0/54305289 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f8105cc0 con 0x7f04f810a650 2026-02-19T08:23:54.296 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04df7fe640 1 -- 10.20.193.27:0/54305289 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f04ec0418c0 con 0x7f04f810a650 2026-02-19T08:23:54.297 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04df7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:23:54.297 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04df7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:23:54.297 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04df7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:54.297 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04df7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:54.297 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04df7fe640 1 --2- 10.20.193.27:0/54305289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f04d003de80 0x7f04d0040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:54.297 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04df7fe640 1 -- 10.20.193.27:0/54305289 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f04ec077470 con 0x7f04f810a650 2026-02-19T08:23:54.297 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.290+0000 7f04f5d74640 1 --2- 10.20.193.27:0/54305289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f04d003de80 0x7f04d0040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:54.297 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.291+0000 7f04f5d74640 1 --2- 10.20.193.27:0/54305289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f04d003de80 0x7f04d0040340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f04e00099c0 tx=0x7f04e0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:54.298 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.293+0000 7f04df7fe640 1 -- 10.20.193.27:0/54305289 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f04ec035320 con 0x7f04f810a650 2026-02-19T08:23:54.385 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.381+0000 7f04fcc16640 1 -- 10.20.193.27:0/54305289 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f04f810aab0 con 0x7f04f810a650 2026-02-19T08:23:54.385 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.381+0000 7f04df7fe640 1 -- 10.20.193.27:0/54305289 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+175 (secure 0 0 0) 0x7f04ec040360 con 0x7f04f810a650 2026-02-19T08:23:54.385 INFO:teuthology.orchestra.run.trial027.stdout:# minimal ceph.conf for 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:54.385 INFO:teuthology.orchestra.run.trial027.stdout:[global] 2026-02-19T08:23:54.385 INFO:teuthology.orchestra.run.trial027.stdout: fsid = 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 2026-02-19T08:23:54.386 INFO:teuthology.orchestra.run.trial027.stdout: mon_host = [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] 2026-02-19T08:23:54.387 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 10 mgrc shutdown 2026-02-19T08:23:54.387 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 1 -- 10.20.193.27:0/54305289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f04d003de80 msgr2=0x7f04d0040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:54.387 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 1 --2- 10.20.193.27:0/54305289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f04d003de80 0x7f04d0040340 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f04e00099c0 tx=0x7f04e0006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:54.387 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 1 -- 10.20.193.27:0/54305289 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f04f810a650 msgr2=0x7f04f819b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:54.387 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 1 --2- 10.20.193.27:0/54305289 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f04f810a650 0x7f04f819b550 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f04ec004290 tx=0x7f04ec0042c0 comp rx=0 tx=0).stop 2026-02-19T08:23:54.388 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 1 -- 10.20.193.27:0/54305289 shutdown_connections 2026-02-19T08:23:54.388 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 1 --2- 10.20.193.27:0/54305289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f04d003de80 0x7f04d0040340 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:54.388 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 1 --2- 10.20.193.27:0/54305289 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f04f810a650 0x7f04f819b550 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:54.388 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 1 -- 10.20.193.27:0/54305289 >> 10.20.193.27:0/54305289 conn(0x7f04f8100260 msgr2=0x7f04f81097f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:54.388 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 1 -- 10.20.193.27:0/54305289 shutdown_connections 2026-02-19T08:23:54.388 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:54.383+0000 7f04fcc16640 1 -- 10.20.193.27:0/54305289 wait complete. 2026-02-19T08:23:54.422 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-19T08:23:54.423 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:54.423 DEBUG:teuthology.orchestra.run.trial027:> sudo dd of=/etc/ceph/ceph.conf 2026-02-19T08:23:54.489 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:54.489 DEBUG:teuthology.orchestra.run.trial027:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-19T08:23:54.553 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:23:54.553 DEBUG:teuthology.orchestra.run.trial116:> sudo dd of=/etc/ceph/ceph.conf 2026-02-19T08:23:54.580 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:23:54.581 DEBUG:teuthology.orchestra.run.trial116:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-19T08:23:54.645 INFO:tasks.cephadm:Adding mgr.a on trial027 2026-02-19T08:23:54.646 DEBUG:teuthology.orchestra.run.trial116:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph orch apply mgr '1;trial027=a' 2026-02-19T08:23:54.829 INFO:teuthology.orchestra.run.trial116.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/config/ceph.conf 2026-02-19T08:23:54.950 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.944+0000 7f72fb7fe640 1 -- 10.20.193.116:0/2128362098 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f4002d10 con 0x7f73041045e0 2026-02-19T08:23:54.950 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.944+0000 7f730ada6640 1 -- 10.20.193.116:0/2128362098 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f73041045e0 msgr2=0x7f73041049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:54.950 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.944+0000 7f730ada6640 1 --2- 10.20.193.116:0/2128362098 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f73041045e0 0x7f73041049e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f72f40099b0 tx=0x7f72f402f2b0 comp rx=0 tx=0).stop 2026-02-19T08:23:54.950 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.944+0000 7f730ada6640 1 -- 10.20.193.116:0/2128362098 shutdown_connections 2026-02-19T08:23:54.950 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.944+0000 7f730ada6640 1 --2- 10.20.193.116:0/2128362098 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f73041045e0 0x7f73041049e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:54.950 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.944+0000 7f730ada6640 1 -- 10.20.193.116:0/2128362098 >> 10.20.193.116:0/2128362098 conn(0x7f73040ffd70 msgr2=0x7f73041021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:54.950 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.944+0000 7f730ada6640 1 -- 10.20.193.116:0/2128362098 shutdown_connections 2026-02-19T08:23:54.950 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.944+0000 7f730ada6640 1 -- 10.20.193.116:0/2128362098 wait complete. 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.945+0000 7f730ada6640 1 Processor -- start 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.945+0000 7f730ada6640 1 -- start start 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.945+0000 7f730ada6640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f73041045e0 0x7f730419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.945+0000 7f730ada6640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f7304109a60 con 0x7f73041045e0 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.945+0000 7f7308b1b640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f73041045e0 0x7f730419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.945+0000 7f7308b1b640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f73041045e0 0x7f730419b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.116:53864/0 (socket says 10.20.193.116:53864) 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.945+0000 7f7308b1b640 1 -- 10.20.193.116:0/2734508947 learned_addr learned my addr 10.20.193.116:0/2734508947 (peer_addr_for_me v2:10.20.193.116:0/0) 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.945+0000 7f7308b1b640 1 -- 10.20.193.116:0/2734508947 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730419b6e0 con 0x7f73041045e0 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.946+0000 7f7308b1b640 1 --2- 10.20.193.116:0/2734508947 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f73041045e0 0x7f730419b1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72f4005ec0 tx=0x7f72f4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.946+0000 7f72f9ffb640 1 -- 10.20.193.116:0/2734508947 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f4038510 con 0x7f73041045e0 2026-02-19T08:23:54.951 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.946+0000 7f730ada6640 1 -- 10.20.193.116:0/2734508947 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730419b970 con 0x7f73041045e0 2026-02-19T08:23:54.952 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.946+0000 7f730ada6640 1 -- 10.20.193.116:0/2734508947 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730419e660 con 0x7f73041045e0 2026-02-19T08:23:54.952 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.946+0000 7f72f9ffb640 1 -- 10.20.193.116:0/2734508947 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f72f4046070 con 0x7f73041045e0 2026-02-19T08:23:54.952 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.946+0000 7f72f9ffb640 1 -- 10.20.193.116:0/2734508947 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f404b630 con 0x7f73041045e0 2026-02-19T08:23:54.952 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.946+0000 7f730ada6640 1 -- 10.20.193.116:0/2734508947 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730410a200 con 0x7f73041045e0 2026-02-19T08:23:54.953 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.947+0000 7f72f9ffb640 1 -- 10.20.193.116:0/2734508947 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f72f40386b0 con 0x7f73041045e0 2026-02-19T08:23:54.953 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.947+0000 7f72f9ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:23:54.953 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.947+0000 7f72f9ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:23:54.953 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.947+0000 7f72f9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:54.953 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.947+0000 7f72f9ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:54.953 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.947+0000 7f72f9ffb640 1 --2- 10.20.193.116:0/2734508947 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f72e003de30 0x7f72e00402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:54.953 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.947+0000 7f72f9ffb640 1 -- 10.20.193.116:0/2734508947 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f72f4077a70 con 0x7f73041045e0 2026-02-19T08:23:54.954 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.947+0000 7f72fbfff640 1 --2- 10.20.193.116:0/2734508947 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f72e003de30 0x7f72e00402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:54.954 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.948+0000 7f72fbfff640 1 --2- 10.20.193.116:0/2734508947 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f72e003de30 0x7f72e00402f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0099c0 tx=0x7f72ec006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:54.954 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:54.950+0000 7f72f9ffb640 1 -- 10.20.193.116:0/2734508947 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f72f4035320 con 0x7f73041045e0 2026-02-19T08:23:55.041 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.037+0000 7f730ada6640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial027=a", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:55.041 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.037+0000 7f730ada6640 1 -- 10.20.193.116:0/2734508947 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial027=a", "target": ["mon-mgr", ""]}) -- 0x7f730419be50 con 0x7f72e003de30 2026-02-19T08:23:55.044 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.041+0000 7f72f9ffb640 1 -- 10.20.193.116:0/2734508947 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f730419be50 con 0x7f72e003de30 2026-02-19T08:23:55.044 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.041+0000 7f72f9ffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:23:55.045 INFO:teuthology.orchestra.run.trial116.stdout:Scheduled mgr update... 2026-02-19T08:23:55.046 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 10 mgrc shutdown 2026-02-19T08:23:55.046 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 1 -- 10.20.193.116:0/2734508947 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f72e003de30 msgr2=0x7f72e00402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:55.046 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 1 --2- 10.20.193.116:0/2734508947 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f72e003de30 0x7f72e00402f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0099c0 tx=0x7f72ec006eb0 comp rx=0 tx=0).stop 2026-02-19T08:23:55.046 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 1 -- 10.20.193.116:0/2734508947 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f73041045e0 msgr2=0x7f730419b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:55.046 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 1 --2- 10.20.193.116:0/2734508947 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f73041045e0 0x7f730419b1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f72f4005ec0 tx=0x7f72f4004290 comp rx=0 tx=0).stop 2026-02-19T08:23:55.046 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 1 -- 10.20.193.116:0/2734508947 shutdown_connections 2026-02-19T08:23:55.046 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 1 --2- 10.20.193.116:0/2734508947 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f72e003de30 0x7f72e00402f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:55.047 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 1 --2- 10.20.193.116:0/2734508947 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f73041045e0 0x7f730419b1a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:55.047 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 1 -- 10.20.193.116:0/2734508947 >> 10.20.193.116:0/2734508947 conn(0x7f73040ffd70 msgr2=0x7f73041003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:55.047 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 1 -- 10.20.193.116:0/2734508947 shutdown_connections 2026-02-19T08:23:55.047 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:23:55.042+0000 7f730ada6640 1 -- 10.20.193.116:0/2734508947 wait complete. 2026-02-19T08:23:55.081 INFO:tasks.cephadm:Deploying OSDs... 2026-02-19T08:23:55.082 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:23:55.082 DEBUG:teuthology.orchestra.run.trial027:> dd if=/scratch_devs of=/dev/stdout 2026-02-19T08:23:55.097 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial027:10.20.193.27=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:55.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: Saving service mon spec with placement trial027:10.20.193.27=a;count:1 2026-02-19T08:23:55.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: Updating trial116:/etc/ceph/ceph.conf 2026-02-19T08:23:55.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='client.? 10.20.193.116:0/3372312607' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-19T08:23:55.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/54305289' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-19T08:23:55.099 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:54 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.101 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-19T08:23:55.101 DEBUG:teuthology.orchestra.run.trial027:> stat /dev/vg_nvme/lv_1 2026-02-19T08:23:55.158 INFO:teuthology.orchestra.run.trial027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-19T08:23:55.158 INFO:teuthology.orchestra.run.trial027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:23:55.158 INFO:teuthology.orchestra.run.trial027.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-19T08:23:55.158 INFO:teuthology.orchestra.run.trial027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:23:55.158 INFO:teuthology.orchestra.run.trial027.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:23:55.158 INFO:teuthology.orchestra.run.trial027.stdout:Access: 2026-02-19 08:23:49.357512434 +0000 2026-02-19T08:23:55.158 INFO:teuthology.orchestra.run.trial027.stdout:Modify: 2026-02-19 08:21:53.142554363 +0000 2026-02-19T08:23:55.158 INFO:teuthology.orchestra.run.trial027.stdout:Change: 2026-02-19 08:21:53.142554363 +0000 2026-02-19T08:23:55.158 INFO:teuthology.orchestra.run.trial027.stdout: Birth: 2026-02-19 08:21:53.142554363 +0000 2026-02-19T08:23:55.159 DEBUG:teuthology.orchestra.run.trial027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-19T08:23:55.222 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records in 2026-02-19T08:23:55.222 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records out 2026-02-19T08:23:55.223 INFO:teuthology.orchestra.run.trial027.stderr:512 bytes copied, 0.000164674 s, 3.1 MB/s 2026-02-19T08:23:55.224 DEBUG:teuthology.orchestra.run.trial027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-19T08:23:55.283 DEBUG:teuthology.orchestra.run.trial027:> stat /dev/vg_nvme/lv_2 2026-02-19T08:23:55.340 INFO:teuthology.orchestra.run.trial027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-19T08:23:55.341 INFO:teuthology.orchestra.run.trial027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:23:55.341 INFO:teuthology.orchestra.run.trial027.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-19T08:23:55.341 INFO:teuthology.orchestra.run.trial027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:23:55.341 INFO:teuthology.orchestra.run.trial027.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:23:55.341 INFO:teuthology.orchestra.run.trial027.stdout:Access: 2026-02-19 08:23:49.357512434 +0000 2026-02-19T08:23:55.341 INFO:teuthology.orchestra.run.trial027.stdout:Modify: 2026-02-19 08:21:53.143554329 +0000 2026-02-19T08:23:55.341 INFO:teuthology.orchestra.run.trial027.stdout:Change: 2026-02-19 08:21:53.143554329 +0000 2026-02-19T08:23:55.341 INFO:teuthology.orchestra.run.trial027.stdout: Birth: 2026-02-19 08:21:53.143554329 +0000 2026-02-19T08:23:55.342 DEBUG:teuthology.orchestra.run.trial027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-19T08:23:55.404 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records in 2026-02-19T08:23:55.405 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records out 2026-02-19T08:23:55.405 INFO:teuthology.orchestra.run.trial027.stderr:512 bytes copied, 0.00015156 s, 3.4 MB/s 2026-02-19T08:23:55.406 DEBUG:teuthology.orchestra.run.trial027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-19T08:23:55.463 DEBUG:teuthology.orchestra.run.trial027:> stat /dev/vg_nvme/lv_3 2026-02-19T08:23:55.519 INFO:teuthology.orchestra.run.trial027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-19T08:23:55.520 INFO:teuthology.orchestra.run.trial027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:23:55.520 INFO:teuthology.orchestra.run.trial027.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-19T08:23:55.520 INFO:teuthology.orchestra.run.trial027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:23:55.520 INFO:teuthology.orchestra.run.trial027.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:23:55.520 INFO:teuthology.orchestra.run.trial027.stdout:Access: 2026-02-19 08:23:49.357512434 +0000 2026-02-19T08:23:55.520 INFO:teuthology.orchestra.run.trial027.stdout:Modify: 2026-02-19 08:21:53.142554363 +0000 2026-02-19T08:23:55.520 INFO:teuthology.orchestra.run.trial027.stdout:Change: 2026-02-19 08:21:53.143554329 +0000 2026-02-19T08:23:55.520 INFO:teuthology.orchestra.run.trial027.stdout: Birth: 2026-02-19 08:21:53.142554363 +0000 2026-02-19T08:23:55.521 DEBUG:teuthology.orchestra.run.trial027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-19T08:23:55.583 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records in 2026-02-19T08:23:55.583 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records out 2026-02-19T08:23:55.583 INFO:teuthology.orchestra.run.trial027.stderr:512 bytes copied, 0.000153143 s, 3.3 MB/s 2026-02-19T08:23:55.584 DEBUG:teuthology.orchestra.run.trial027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-19T08:23:55.641 DEBUG:teuthology.orchestra.run.trial027:> stat /dev/vg_nvme/lv_4 2026-02-19T08:23:55.696 INFO:teuthology.orchestra.run.trial027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-19T08:23:55.696 INFO:teuthology.orchestra.run.trial027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:23:55.697 INFO:teuthology.orchestra.run.trial027.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-19T08:23:55.697 INFO:teuthology.orchestra.run.trial027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:23:55.697 INFO:teuthology.orchestra.run.trial027.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:23:55.697 INFO:teuthology.orchestra.run.trial027.stdout:Access: 2026-02-19 08:23:49.357512434 +0000 2026-02-19T08:23:55.697 INFO:teuthology.orchestra.run.trial027.stdout:Modify: 2026-02-19 08:21:53.143554329 +0000 2026-02-19T08:23:55.697 INFO:teuthology.orchestra.run.trial027.stdout:Change: 2026-02-19 08:21:53.143554329 +0000 2026-02-19T08:23:55.697 INFO:teuthology.orchestra.run.trial027.stdout: Birth: 2026-02-19 08:21:53.143554329 +0000 2026-02-19T08:23:55.697 DEBUG:teuthology.orchestra.run.trial027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-19T08:23:55.760 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records in 2026-02-19T08:23:55.760 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records out 2026-02-19T08:23:55.760 INFO:teuthology.orchestra.run.trial027.stderr:512 bytes copied, 0.000149346 s, 3.4 MB/s 2026-02-19T08:23:55.762 DEBUG:teuthology.orchestra.run.trial027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-19T08:23:55.818 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:23:55.819 DEBUG:teuthology.orchestra.run.trial116:> dd if=/scratch_devs of=/dev/stdout 2026-02-19T08:23:55.837 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-19T08:23:55.837 DEBUG:teuthology.orchestra.run.trial116:> stat /dev/vg_nvme/lv_1 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: Updating trial116:/var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/config/ceph.conf 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: Updating trial116:/etc/ceph/ceph.client.admin.keyring 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: Updating trial116:/var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: Reconfiguring mon.a (unknown last config time)... 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: Reconfiguring daemon mon.a on trial027 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.849 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-19T08:23:55.849 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-19T08:23:55.849 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:23:55.849 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.849 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:55 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:23:55.894 INFO:teuthology.orchestra.run.trial116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-19T08:23:55.895 INFO:teuthology.orchestra.run.trial116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:23:55.895 INFO:teuthology.orchestra.run.trial116.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-19T08:23:55.895 INFO:teuthology.orchestra.run.trial116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:23:55.895 INFO:teuthology.orchestra.run.trial116.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:23:55.895 INFO:teuthology.orchestra.run.trial116.stdout:Access: 2026-02-19 08:23:53.467213721 +0000 2026-02-19T08:23:55.895 INFO:teuthology.orchestra.run.trial116.stdout:Modify: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:55.895 INFO:teuthology.orchestra.run.trial116.stdout:Change: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:55.895 INFO:teuthology.orchestra.run.trial116.stdout: Birth: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:55.896 DEBUG:teuthology.orchestra.run.trial116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-19T08:23:55.958 INFO:teuthology.orchestra.run.trial116.stderr:1+0 records in 2026-02-19T08:23:55.958 INFO:teuthology.orchestra.run.trial116.stderr:1+0 records out 2026-02-19T08:23:55.958 INFO:teuthology.orchestra.run.trial116.stderr:512 bytes copied, 0.000166049 s, 3.1 MB/s 2026-02-19T08:23:55.959 DEBUG:teuthology.orchestra.run.trial116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-19T08:23:56.018 DEBUG:teuthology.orchestra.run.trial116:> stat /dev/vg_nvme/lv_2 2026-02-19T08:23:56.074 INFO:teuthology.orchestra.run.trial116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-19T08:23:56.075 INFO:teuthology.orchestra.run.trial116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:23:56.075 INFO:teuthology.orchestra.run.trial116.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-19T08:23:56.075 INFO:teuthology.orchestra.run.trial116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:23:56.075 INFO:teuthology.orchestra.run.trial116.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:23:56.075 INFO:teuthology.orchestra.run.trial116.stdout:Access: 2026-02-19 08:23:53.467213721 +0000 2026-02-19T08:23:56.075 INFO:teuthology.orchestra.run.trial116.stdout:Modify: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:56.075 INFO:teuthology.orchestra.run.trial116.stdout:Change: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:56.075 INFO:teuthology.orchestra.run.trial116.stdout: Birth: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:56.076 DEBUG:teuthology.orchestra.run.trial116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-19T08:23:56.137 INFO:teuthology.orchestra.run.trial116.stderr:1+0 records in 2026-02-19T08:23:56.137 INFO:teuthology.orchestra.run.trial116.stderr:1+0 records out 2026-02-19T08:23:56.137 INFO:teuthology.orchestra.run.trial116.stderr:512 bytes copied, 0.000146493 s, 3.5 MB/s 2026-02-19T08:23:56.139 DEBUG:teuthology.orchestra.run.trial116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-19T08:23:56.195 DEBUG:teuthology.orchestra.run.trial116:> stat /dev/vg_nvme/lv_3 2026-02-19T08:23:56.251 INFO:teuthology.orchestra.run.trial116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-19T08:23:56.251 INFO:teuthology.orchestra.run.trial116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:23:56.251 INFO:teuthology.orchestra.run.trial116.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-19T08:23:56.251 INFO:teuthology.orchestra.run.trial116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:23:56.252 INFO:teuthology.orchestra.run.trial116.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:23:56.252 INFO:teuthology.orchestra.run.trial116.stdout:Access: 2026-02-19 08:23:53.467213721 +0000 2026-02-19T08:23:56.252 INFO:teuthology.orchestra.run.trial116.stdout:Modify: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:56.252 INFO:teuthology.orchestra.run.trial116.stdout:Change: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:56.252 INFO:teuthology.orchestra.run.trial116.stdout: Birth: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:56.252 DEBUG:teuthology.orchestra.run.trial116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-19T08:23:56.316 INFO:teuthology.orchestra.run.trial116.stderr:1+0 records in 2026-02-19T08:23:56.316 INFO:teuthology.orchestra.run.trial116.stderr:1+0 records out 2026-02-19T08:23:56.316 INFO:teuthology.orchestra.run.trial116.stderr:512 bytes copied, 0.000232403 s, 2.2 MB/s 2026-02-19T08:23:56.318 DEBUG:teuthology.orchestra.run.trial116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-19T08:23:56.374 DEBUG:teuthology.orchestra.run.trial116:> stat /dev/vg_nvme/lv_4 2026-02-19T08:23:56.432 INFO:teuthology.orchestra.run.trial116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-19T08:23:56.432 INFO:teuthology.orchestra.run.trial116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:23:56.432 INFO:teuthology.orchestra.run.trial116.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-19T08:23:56.432 INFO:teuthology.orchestra.run.trial116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:23:56.432 INFO:teuthology.orchestra.run.trial116.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:23:56.432 INFO:teuthology.orchestra.run.trial116.stdout:Access: 2026-02-19 08:23:53.467213721 +0000 2026-02-19T08:23:56.432 INFO:teuthology.orchestra.run.trial116.stdout:Modify: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:56.432 INFO:teuthology.orchestra.run.trial116.stdout:Change: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:56.432 INFO:teuthology.orchestra.run.trial116.stdout: Birth: 2026-02-19 08:21:55.255632040 +0000 2026-02-19T08:23:56.433 DEBUG:teuthology.orchestra.run.trial116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-19T08:23:56.494 INFO:teuthology.orchestra.run.trial116.stderr:1+0 records in 2026-02-19T08:23:56.494 INFO:teuthology.orchestra.run.trial116.stderr:1+0 records out 2026-02-19T08:23:56.494 INFO:teuthology.orchestra.run.trial116.stderr:512 bytes copied, 0.000227394 s, 2.3 MB/s 2026-02-19T08:23:56.496 DEBUG:teuthology.orchestra.run.trial116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-19T08:23:56.553 INFO:tasks.cephadm:Deploying osd.0 on trial027 with /dev/vg_nvme/lv_4... 2026-02-19T08:23:56.553 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-19T08:23:56.705 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:23:56.847 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:56 trial027 ceph-mon[21739]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial027=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:56.847 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:56 trial027 ceph-mon[21739]: Saving service mgr spec with placement trial027=a;count:1 2026-02-19T08:23:56.847 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:56 trial027 ceph-mon[21739]: Reconfiguring mgr.a (unknown last config time)... 2026-02-19T08:23:56.847 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:56 trial027 ceph-mon[21739]: Reconfiguring daemon mgr.a on trial027 2026-02-19T08:23:57.425 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:23:57.440 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph orch daemon add osd trial027:vg_nvme/lv_4 2026-02-19T08:23:57.590 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:23:57.705 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 -- 10.20.193.27:0/71828642 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f16fc0770a0 msgr2=0x7f16fc075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:23:57.706 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 --2- 10.20.193.27:0/71828642 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f16fc0770a0 0x7f16fc075500 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16ec0099b0 tx=0x7f16ec02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:23:57.706 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 -- 10.20.193.27:0/71828642 shutdown_connections 2026-02-19T08:23:57.706 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 --2- 10.20.193.27:0/71828642 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f16fc0770a0 0x7f16fc075500 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:23:57.706 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 -- 10.20.193.27:0/71828642 >> 10.20.193.27:0/71828642 conn(0x7f16fc0fdbb0 msgr2=0x7f16fc0ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:23:57.706 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 -- 10.20.193.27:0/71828642 shutdown_connections 2026-02-19T08:23:57.706 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 -- 10.20.193.27:0/71828642 wait complete. 2026-02-19T08:23:57.706 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 Processor -- start 2026-02-19T08:23:57.706 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 -- start start 2026-02-19T08:23:57.706 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f16fc0770a0 0x7f16fc19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1703512640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc1055f0 con 0x7f16fc0770a0 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1701287640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f16fc0770a0 0x7f16fc19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1701287640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f16fc0770a0 0x7f16fc19f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:41316/0 (socket says 10.20.193.27:41316) 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1701287640 1 -- 10.20.193.27:0/1077116652 learned_addr learned my addr 10.20.193.27:0/1077116652 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.700+0000 7f1701287640 1 -- 10.20.193.27:0/1077116652 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16fc19fcf0 con 0x7f16fc0770a0 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f1701287640 1 --2- 10.20.193.27:0/1077116652 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f16fc0770a0 0x7f16fc19f7b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009ae0 tx=0x7f16ec004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f16ea7fc640 1 -- 10.20.193.27:0/1077116652 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16ec038640 con 0x7f16fc0770a0 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f1703512640 1 -- 10.20.193.27:0/1077116652 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16fc19ff80 con 0x7f16fc0770a0 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f16ea7fc640 1 -- 10.20.193.27:0/1077116652 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f16ec046070 con 0x7f16fc0770a0 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f16ea7fc640 1 -- 10.20.193.27:0/1077116652 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16ec041870 con 0x7f16fc0770a0 2026-02-19T08:23:57.707 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f1703512640 1 -- 10.20.193.27:0/1077116652 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16fc1a2c70 con 0x7f16fc0770a0 2026-02-19T08:23:57.708 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f1703512640 1 -- 10.20.193.27:0/1077116652 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16fc105d90 con 0x7f16fc0770a0 2026-02-19T08:23:57.708 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f16ea7fc640 1 -- 10.20.193.27:0/1077116652 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f16ec0387e0 con 0x7f16fc0770a0 2026-02-19T08:23:57.708 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f16ea7fc640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:23:57.708 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f16ea7fc640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:23:57.708 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f16ea7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:57.708 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f16ea7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:23:57.708 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.701+0000 7f16ea7fc640 1 --2- 10.20.193.27:0/1077116652 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f16d803de80 0x7f16d8040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:23:57.708 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.702+0000 7f16ea7fc640 1 -- 10.20.193.27:0/1077116652 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f16ec077490 con 0x7f16fc0770a0 2026-02-19T08:23:57.708 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.702+0000 7f1700a86640 1 --2- 10.20.193.27:0/1077116652 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f16d803de80 0x7f16d8040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:23:57.708 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.702+0000 7f1700a86640 1 --2- 10.20.193.27:0/1077116652 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f16d803de80 0x7f16d8040340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16f00099c0 tx=0x7f16f0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:23:57.709 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.704+0000 7f16ea7fc640 1 -- 10.20.193.27:0/1077116652 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f16ec03e220 con 0x7f16fc0770a0 2026-02-19T08:23:57.797 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.793+0000 7f1703512640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}] 2026-02-19T08:23:57.797 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:23:57.794+0000 7f1703512640 1 -- 10.20.193.27:0/1077116652 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f16fc198dd0 con 0x7f16d803de80 2026-02-19T08:23:57.980 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:57 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-19T08:23:57.980 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:57 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-19T08:23:57.980 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:57 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:23:59.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:58 trial027 ceph-mon[21739]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:23:59.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:58 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/3764527566' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb259e05-73a1-4945-8799-66f67f314d9b"}]: dispatch 2026-02-19T08:23:59.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:58 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/3764527566' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb259e05-73a1-4945-8799-66f67f314d9b"}]': finished 2026-02-19T08:23:59.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:58 trial027 ceph-mon[21739]: osdmap e5: 1 total, 0 up, 1 in 2026-02-19T08:23:59.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:58 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-19T08:23:59.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:23:58 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/193772118' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-19T08:24:04.265 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:04 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-19T08:24:04.266 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:04 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:05.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:05 trial027 ceph-mon[21739]: Deploying daemon osd.0 on trial027 2026-02-19T08:24:07.429 INFO:teuthology.orchestra.run.trial027.stdout:Created osd(s) 0 on host 'trial027' 2026-02-19T08:24:07.430 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.425+0000 7f16ea7fc640 1 -- 10.20.193.27:0/1077116652 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f16fc198dd0 con 0x7f16d803de80 2026-02-19T08:24:07.430 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.425+0000 7f16ea7fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:24:07.431 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 10 mgrc shutdown 2026-02-19T08:24:07.431 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 1 -- 10.20.193.27:0/1077116652 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f16d803de80 msgr2=0x7f16d8040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:07.432 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 1 --2- 10.20.193.27:0/1077116652 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f16d803de80 0x7f16d8040340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f16f00099c0 tx=0x7f16f0006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:07.432 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 1 -- 10.20.193.27:0/1077116652 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f16fc0770a0 msgr2=0x7f16fc19f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:07.432 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 1 --2- 10.20.193.27:0/1077116652 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f16fc0770a0 0x7f16fc19f7b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009ae0 tx=0x7f16ec004290 comp rx=0 tx=0).stop 2026-02-19T08:24:07.432 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 1 -- 10.20.193.27:0/1077116652 shutdown_connections 2026-02-19T08:24:07.432 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 1 --2- 10.20.193.27:0/1077116652 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f16d803de80 0x7f16d8040340 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:07.432 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 1 --2- 10.20.193.27:0/1077116652 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f16fc0770a0 0x7f16fc19f7b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:07.432 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 1 -- 10.20.193.27:0/1077116652 >> 10.20.193.27:0/1077116652 conn(0x7f16fc0fdbb0 msgr2=0x7f16fc0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:07.432 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 1 -- 10.20.193.27:0/1077116652 shutdown_connections 2026-02-19T08:24:07.432 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:07.427+0000 7f1703512640 1 -- 10.20.193.27:0/1077116652 wait complete. 2026-02-19T08:24:07.467 DEBUG:teuthology.orchestra.run.trial027:osd.0> sudo journalctl -f -n 0 -u ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@osd.0.service 2026-02-19T08:24:07.469 INFO:tasks.cephadm:Deploying osd.1 on trial027 with /dev/vg_nvme/lv_3... 2026-02-19T08:24:07.469 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-19T08:24:07.531 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:07 trial027 ceph-mon[21739]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T08:24:07.531 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:07 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:24:07.531 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:07 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:07.531 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:07 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:07.531 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:07 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:07.531 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:07 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:07.531 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:07 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:07.532 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:07 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-19T08:24:07.532 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:07 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:07.673 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:08.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:08 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:24:08.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:08 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:08.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:08 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:08.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:08 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:08.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:08 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:08.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:08 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-19T08:24:08.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:08 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:08.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:08 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:08.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:08 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-19T08:24:08.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:08 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:08.762 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:08 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-0[33698]: 2026-02-19T08:24:08.396+0000 7f0b98e5f740 -1 Falling back to public interface 2026-02-19T08:24:08.832 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:08.847 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph orch daemon add osd trial027:vg_nvme/lv_3 2026-02-19T08:24:09.040 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:09.150 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 -- 10.20.193.27:0/2604927377 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb8541044d0 msgr2=0x7fb8541048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:09.150 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 --2- 10.20.193.27:0/2604927377 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb8541044d0 0x7fb8541048d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8440099b0 tx=0x7fb84402f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:09.150 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 -- 10.20.193.27:0/2604927377 shutdown_connections 2026-02-19T08:24:09.150 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 --2- 10.20.193.27:0/2604927377 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb8541044d0 0x7fb8541048d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:09.150 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 -- 10.20.193.27:0/2604927377 >> 10.20.193.27:0/2604927377 conn(0x7fb8540ffd70 msgr2=0x7fb854102160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:09.150 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 -- 10.20.193.27:0/2604927377 shutdown_connections 2026-02-19T08:24:09.150 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 -- 10.20.193.27:0/2604927377 wait complete. 2026-02-19T08:24:09.150 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 Processor -- start 2026-02-19T08:24:09.150 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 -- start start 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb8541044d0 0x7fb85419b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb85a913640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fb854109950 con 0x7fb8541044d0 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb859911640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb8541044d0 0x7fb85419b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb859911640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb8541044d0 0x7fb85419b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:52690/0 (socket says 10.20.193.27:52690) 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.144+0000 7fb859911640 1 -- 10.20.193.27:0/2817734077 learned_addr learned my addr 10.20.193.27:0/2817734077 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.145+0000 7fb859911640 1 -- 10.20.193.27:0/2817734077 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85419b640 con 0x7fb8541044d0 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.145+0000 7fb859911640 1 --2- 10.20.193.27:0/2817734077 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb8541044d0 0x7fb85419b100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb844005ec0 tx=0x7fb844004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.145+0000 7fb842ffd640 1 -- 10.20.193.27:0/2817734077 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb844038510 con 0x7fb8541044d0 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.145+0000 7fb842ffd640 1 -- 10.20.193.27:0/2817734077 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fb844046070 con 0x7fb8541044d0 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.145+0000 7fb85a913640 1 -- 10.20.193.27:0/2817734077 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85419b8d0 con 0x7fb8541044d0 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.145+0000 7fb842ffd640 1 -- 10.20.193.27:0/2817734077 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb844041810 con 0x7fb8541044d0 2026-02-19T08:24:09.151 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.145+0000 7fb85a913640 1 -- 10.20.193.27:0/2817734077 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85419e5c0 con 0x7fb8541044d0 2026-02-19T08:24:09.152 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.145+0000 7fb842ffd640 1 -- 10.20.193.27:0/2817734077 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fb8440386b0 con 0x7fb8541044d0 2026-02-19T08:24:09.152 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.145+0000 7fb842ffd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:09.152 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.145+0000 7fb85a913640 1 -- 10.20.193.27:0/2817734077 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85410a0f0 con 0x7fb8541044d0 2026-02-19T08:24:09.152 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.146+0000 7fb842ffd640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:09.152 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.146+0000 7fb842ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:09.152 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.146+0000 7fb842ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:09.152 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.146+0000 7fb842ffd640 1 --2- 10.20.193.27:0/2817734077 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fb83003de80 0x7fb830040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:09.152 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.146+0000 7fb842ffd640 1 -- 10.20.193.27:0/2817734077 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1270+0+0 (secure 0 0 0) 0x7fb844077390 con 0x7fb8541044d0 2026-02-19T08:24:09.152 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.146+0000 7fb859110640 1 --2- 10.20.193.27:0/2817734077 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fb83003de80 0x7fb830040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:09.152 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.146+0000 7fb859110640 1 --2- 10.20.193.27:0/2817734077 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fb83003de80 0x7fb830040340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb8480099c0 tx=0x7fb848006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:09.153 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.148+0000 7fb842ffd640 1 -- 10.20.193.27:0/2817734077 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb8440389d0 con 0x7fb8541044d0 2026-02-19T08:24:09.243 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.240+0000 7fb85a913640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}] 2026-02-19T08:24:09.244 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:09.240+0000 7fb85a913640 1 -- 10.20.193.27:0/2817734077 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb854194720 con 0x7fb83003de80 2026-02-19T08:24:09.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:09 trial027 ceph-mon[21739]: Detected new or changed devices on trial027 2026-02-19T08:24:09.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:09 trial027 ceph-mon[21739]: Adjusting osd_memory_target on trial027 to 84047M 2026-02-19T08:24:09.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:09 trial027 ceph-mon[21739]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T08:24:09.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:09 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-19T08:24:09.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:09 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-19T08:24:09.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:09 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:10.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:10 trial027 ceph-mon[21739]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:24:10.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:10 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2726414036' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f81b4fa6-2886-4ed5-9abc-1d372b4311be"}]: dispatch 2026-02-19T08:24:10.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:10 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2726414036' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f81b4fa6-2886-4ed5-9abc-1d372b4311be"}]': finished 2026-02-19T08:24:10.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:10 trial027 ceph-mon[21739]: osdmap e6: 2 total, 0 up, 2 in 2026-02-19T08:24:10.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:10 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-19T08:24:10.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:10 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-19T08:24:10.349 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:10 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1473509458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-19T08:24:11.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:11 trial027 ceph-mon[21739]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T08:24:13.279 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:12 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-0[33698]: 2026-02-19T08:24:12.927+0000 7f0b98e5f740 -1 osd.0 0 log_to_monitors true 2026-02-19T08:24:13.597 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:13 trial027 ceph-mon[21739]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T08:24:13.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:13 trial027 ceph-mon[21739]: from='osd.0 [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-19T08:24:14.598 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:14 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-0[33698]: 2026-02-19T08:24:14.277+0000 7f0b945bd640 -1 osd.0 0 waiting for initial osdmap 2026-02-19T08:24:14.598 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:14 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-0[33698]: 2026-02-19T08:24:14.279+0000 7f0b90bf9640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T08:24:14.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:14 trial027 ceph-mon[21739]: from='osd.0 [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-19T08:24:14.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:14 trial027 ceph-mon[21739]: osdmap e7: 2 total, 0 up, 2 in 2026-02-19T08:24:14.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:14 trial027 ceph-mon[21739]: from='osd.0 [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial027", "root=default"]}]: dispatch 2026-02-19T08:24:14.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:14 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-19T08:24:14.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:14 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-19T08:24:14.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:14 trial027 ceph-mon[21739]: from='osd.0 [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial027", "root=default"]}]': finished 2026-02-19T08:24:15.517 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:15 trial027 ceph-mon[21739]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T08:24:15.517 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:15 trial027 ceph-mon[21739]: osdmap e8: 2 total, 0 up, 2 in 2026-02-19T08:24:15.517 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:15 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-19T08:24:15.517 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:15 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-19T08:24:15.517 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:15 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-19T08:24:16.340 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:16 trial027 ceph-mon[21739]: purged_snaps scrub starts 2026-02-19T08:24:16.340 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:16 trial027 ceph-mon[21739]: purged_snaps scrub ok 2026-02-19T08:24:16.340 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:16 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-19T08:24:16.340 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:16 trial027 ceph-mon[21739]: osd.0 [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654] boot 2026-02-19T08:24:16.340 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:16 trial027 ceph-mon[21739]: osdmap e9: 2 total, 1 up, 2 in 2026-02-19T08:24:16.340 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:16 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-19T08:24:16.340 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:16 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-19T08:24:16.340 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:16 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-19T08:24:16.341 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:16 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:16.341 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:16 trial027 ceph-mon[21739]: Deploying daemon osd.1 on trial027 2026-02-19T08:24:17.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:17 trial027 ceph-mon[21739]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T08:24:17.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:17 trial027 ceph-mon[21739]: osdmap e10: 2 total, 1 up, 2 in 2026-02-19T08:24:17.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:17 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-19T08:24:18.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:18 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:24:18.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:18 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:18.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:18 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:18.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:18 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:18.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:18 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:18.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:18 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:18.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:18 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-19T08:24:18.599 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:18 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:18.839 INFO:teuthology.orchestra.run.trial027.stdout:Created osd(s) 1 on host 'trial027' 2026-02-19T08:24:18.840 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.835+0000 7fb842ffd640 1 -- 10.20.193.27:0/2817734077 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fb854194720 con 0x7fb83003de80 2026-02-19T08:24:18.840 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.835+0000 7fb842ffd640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:24:18.841 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.837+0000 7fb85a913640 10 mgrc shutdown 2026-02-19T08:24:18.842 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.837+0000 7fb85a913640 1 -- 10.20.193.27:0/2817734077 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fb83003de80 msgr2=0x7fb830040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:18.842 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.837+0000 7fb85a913640 1 --2- 10.20.193.27:0/2817734077 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fb83003de80 0x7fb830040340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb8480099c0 tx=0x7fb848006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:18.842 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.837+0000 7fb85a913640 1 -- 10.20.193.27:0/2817734077 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb8541044d0 msgr2=0x7fb85419b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:18.842 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.837+0000 7fb85a913640 1 --2- 10.20.193.27:0/2817734077 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb8541044d0 0x7fb85419b100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb844005ec0 tx=0x7fb844004290 comp rx=0 tx=0).stop 2026-02-19T08:24:18.842 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.837+0000 7fb85a913640 1 -- 10.20.193.27:0/2817734077 shutdown_connections 2026-02-19T08:24:18.842 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.837+0000 7fb85a913640 1 --2- 10.20.193.27:0/2817734077 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fb83003de80 0x7fb830040340 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:18.842 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.837+0000 7fb85a913640 1 --2- 10.20.193.27:0/2817734077 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fb8541044d0 0x7fb85419b100 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:18.842 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.837+0000 7fb85a913640 1 -- 10.20.193.27:0/2817734077 >> 10.20.193.27:0/2817734077 conn(0x7fb8540ffd70 msgr2=0x7fb854101020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:18.842 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.837+0000 7fb85a913640 1 -- 10.20.193.27:0/2817734077 shutdown_connections 2026-02-19T08:24:18.842 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:18.838+0000 7fb85a913640 1 -- 10.20.193.27:0/2817734077 wait complete. 2026-02-19T08:24:18.878 DEBUG:teuthology.orchestra.run.trial027:osd.1> sudo journalctl -f -n 0 -u ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@osd.1.service 2026-02-19T08:24:18.880 INFO:tasks.cephadm:Deploying osd.2 on trial027 with /dev/vg_nvme/lv_2... 2026-02-19T08:24:18.881 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-19T08:24:19.088 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:19.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:19 trial027 ceph-mon[21739]: pgmap v16: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T08:24:19.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:19 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:24:19.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:19 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:19.348 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:19 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:19.814 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:19 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-1[39604]: 2026-02-19T08:24:19.708+0000 7fc2c0ba7740 -1 Falling back to public interface 2026-02-19T08:24:20.246 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:20.265 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph orch daemon add osd trial027:vg_nvme/lv_2 2026-02-19T08:24:20.416 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.523+0000 7f1fabfff640 1 -- 10.20.193.27:0/4217860422 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1fac100a90 msgr2=0x7f1fac102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.523+0000 7f1fabfff640 1 --2- 10.20.193.27:0/4217860422 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1fac100a90 0x7f1fac102ea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00099b0 tx=0x7f1fa002f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.523+0000 7f1fabfff640 1 -- 10.20.193.27:0/4217860422 shutdown_connections 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.523+0000 7f1fabfff640 1 --2- 10.20.193.27:0/4217860422 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1fac100a90 0x7f1fac102ea0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.523+0000 7f1fabfff640 1 -- 10.20.193.27:0/4217860422 >> 10.20.193.27:0/4217860422 conn(0x7f1fac0fc880 msgr2=0x7f1fac0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.523+0000 7f1fabfff640 1 -- 10.20.193.27:0/4217860422 shutdown_connections 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.523+0000 7f1fabfff640 1 -- 10.20.193.27:0/4217860422 wait complete. 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1fabfff640 1 Processor -- start 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1fabfff640 1 -- start start 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1fabfff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1fac100a90 0x7f1fac19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1fabfff640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac105530 con 0x7f1fac100a90 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1faaffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1fac100a90 0x7f1fac19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1faaffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1fac100a90 0x7f1fac19f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:33124/0 (socket says 10.20.193.27:33124) 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1faaffd640 1 -- 10.20.193.27:0/4020460590 learned_addr learned my addr 10.20.193.27:0/4020460590 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1faaffd640 1 -- 10.20.193.27:0/4020460590 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fac19fb10 con 0x7f1fac100a90 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1faaffd640 1 --2- 10.20.193.27:0/4020460590 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1fac100a90 0x7f1fac19f5d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009ae0 tx=0x7f1fa0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1f8bfff640 1 -- 10.20.193.27:0/4020460590 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0038640 con 0x7f1fac100a90 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1f8bfff640 1 -- 10.20.193.27:0/4020460590 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1fa0046070 con 0x7f1fac100a90 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1f8bfff640 1 -- 10.20.193.27:0/4020460590 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fa0041870 con 0x7f1fac100a90 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.524+0000 7f1fabfff640 1 -- 10.20.193.27:0/4020460590 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fac19fda0 con 0x7f1fac100a90 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.525+0000 7f1fabfff640 1 -- 10.20.193.27:0/4020460590 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fac1a2a90 con 0x7f1fac100a90 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.525+0000 7f1fabfff640 1 -- 10.20.193.27:0/4020460590 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fac105cd0 con 0x7f1fac100a90 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.525+0000 7f1f8bfff640 1 -- 10.20.193.27:0/4020460590 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f1fa00387e0 con 0x7f1fac100a90 2026-02-19T08:24:20.528 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.525+0000 7f1f8bfff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:20.529 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.525+0000 7f1f8bfff640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:20.529 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.525+0000 7f1f8bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:20.529 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.525+0000 7f1f8bfff640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:20.529 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.525+0000 7f1f8bfff640 1 --2- 10.20.193.27:0/4020460590 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f8003de30 0x7f1f800402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:20.529 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.525+0000 7f1f8bfff640 1 -- 10.20.193.27:0/4020460590 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1880+0+0 (secure 0 0 0) 0x7f1fa00776f0 con 0x7f1fac100a90 2026-02-19T08:24:20.529 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.525+0000 7f1faa7fc640 1 --2- 10.20.193.27:0/4020460590 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f8003de30 0x7f1f800402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:20.529 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.526+0000 7f1faa7fc640 1 --2- 10.20.193.27:0/4020460590 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f8003de30 0x7f1f800402f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1f940099c0 tx=0x7f1f94006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:20.531 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.528+0000 7f1f8bfff640 1 -- 10.20.193.27:0/4020460590 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1fa0040360 con 0x7f1fac100a90 2026-02-19T08:24:20.620 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.617+0000 7f1fabfff640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}] 2026-02-19T08:24:20.620 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:20.617+0000 7f1fabfff640 1 -- 10.20.193.27:0/4020460590 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1fac198b30 con 0x7f1f8003de30 2026-02-19T08:24:20.804 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:20 trial027 ceph-mon[21739]: Detected new or changed devices on trial027 2026-02-19T08:24:20.804 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:20 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:20.804 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:20 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:20.804 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:20 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-19T08:24:20.804 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:20 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-19T08:24:20.804 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:20 trial027 ceph-mon[21739]: Adjusting osd_memory_target on trial027 to 42023M 2026-02-19T08:24:20.804 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:20 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:20.805 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:20 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:20.805 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:20 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-19T08:24:20.805 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:20 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:21.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:21 trial027 ceph-mon[21739]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T08:24:21.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:21 trial027 ceph-mon[21739]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T08:24:21.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:21 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-19T08:24:21.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:21 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-19T08:24:21.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:21 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:21.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:21 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1947575834' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8cecd57-2426-4e7f-8e64-724764783b0c"}]: dispatch 2026-02-19T08:24:21.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:21 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1947575834' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8cecd57-2426-4e7f-8e64-724764783b0c"}]': finished 2026-02-19T08:24:21.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:21 trial027 ceph-mon[21739]: osdmap e11: 3 total, 1 up, 3 in 2026-02-19T08:24:21.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:21 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-19T08:24:21.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:21 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-19T08:24:22.847 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:22 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2798452376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-19T08:24:23.847 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:23 trial027 ceph-mon[21739]: pgmap v19: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T08:24:24.566 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:24 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-1[39604]: 2026-02-19T08:24:24.255+0000 7fc2c0ba7740 -1 osd.1 0 log_to_monitors true 2026-02-19T08:24:24.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:24 trial027 ceph-mon[21739]: from='osd.1 [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-19T08:24:25.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:25 trial027 ceph-mon[21739]: pgmap v20: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T08:24:25.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:25 trial027 ceph-mon[21739]: from='osd.1 [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-19T08:24:25.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:25 trial027 ceph-mon[21739]: osdmap e12: 3 total, 1 up, 3 in 2026-02-19T08:24:25.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:25 trial027 ceph-mon[21739]: from='osd.1 [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial027", "root=default"]}]: dispatch 2026-02-19T08:24:25.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:25 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-19T08:24:25.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:25 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-19T08:24:25.849 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:25 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-1[39604]: 2026-02-19T08:24:25.568+0000 7fc2bc305640 -1 osd.1 0 waiting for initial osdmap 2026-02-19T08:24:25.849 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:25 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-1[39604]: 2026-02-19T08:24:25.571+0000 7fc2b8941640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T08:24:26.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:26 trial027 ceph-mon[21739]: from='osd.1 [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial027", "root=default"]}]': finished 2026-02-19T08:24:26.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:26 trial027 ceph-mon[21739]: osdmap e13: 3 total, 1 up, 3 in 2026-02-19T08:24:26.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:26 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-19T08:24:26.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:26 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-19T08:24:26.598 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:26 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-19T08:24:27.693 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:27 trial027 ceph-mon[21739]: purged_snaps scrub starts 2026-02-19T08:24:27.693 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:27 trial027 ceph-mon[21739]: purged_snaps scrub ok 2026-02-19T08:24:27.693 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:27 trial027 ceph-mon[21739]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T08:24:27.693 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:27 trial027 ceph-mon[21739]: osd.1 [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182] boot 2026-02-19T08:24:27.693 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:27 trial027 ceph-mon[21739]: osdmap e14: 3 total, 2 up, 3 in 2026-02-19T08:24:27.693 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:27 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-19T08:24:27.693 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:27 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-19T08:24:27.693 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:27 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-19T08:24:27.693 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:27 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:28.767 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:28 trial027 ceph-mon[21739]: Deploying daemon osd.2 on trial027 2026-02-19T08:24:28.768 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:28 trial027 ceph-mon[21739]: osdmap e15: 3 total, 2 up, 3 in 2026-02-19T08:24:28.768 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:28 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-19T08:24:29.827 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.823+0000 7f1f8bfff640 1 -- 10.20.193.27:0/4020460590 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f1fac198b30 con 0x7f1f8003de30 2026-02-19T08:24:29.827 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.823+0000 7f1f8bfff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:24:29.828 INFO:teuthology.orchestra.run.trial027.stdout:Created osd(s) 2 on host 'trial027' 2026-02-19T08:24:29.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.825+0000 7f1fabfff640 10 mgrc shutdown 2026-02-19T08:24:29.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.826+0000 7f1fabfff640 1 -- 10.20.193.27:0/4020460590 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f8003de30 msgr2=0x7f1f800402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:29.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.826+0000 7f1fabfff640 1 --2- 10.20.193.27:0/4020460590 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f8003de30 0x7f1f800402f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1f940099c0 tx=0x7f1f94006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:29.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.826+0000 7f1fabfff640 1 -- 10.20.193.27:0/4020460590 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1fac100a90 msgr2=0x7f1fac19f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:29.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.826+0000 7f1fabfff640 1 --2- 10.20.193.27:0/4020460590 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1fac100a90 0x7f1fac19f5d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009ae0 tx=0x7f1fa0004290 comp rx=0 tx=0).stop 2026-02-19T08:24:29.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.826+0000 7f1fabfff640 1 -- 10.20.193.27:0/4020460590 shutdown_connections 2026-02-19T08:24:29.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.826+0000 7f1fabfff640 1 --2- 10.20.193.27:0/4020460590 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f8003de30 0x7f1f800402f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:29.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.826+0000 7f1fabfff640 1 --2- 10.20.193.27:0/4020460590 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1fac100a90 0x7f1fac19f5d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:29.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.826+0000 7f1fabfff640 1 -- 10.20.193.27:0/4020460590 >> 10.20.193.27:0/4020460590 conn(0x7f1fac0fc880 msgr2=0x7f1fac1028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:29.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.826+0000 7f1fabfff640 1 -- 10.20.193.27:0/4020460590 shutdown_connections 2026-02-19T08:24:29.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:29.826+0000 7f1fabfff640 1 -- 10.20.193.27:0/4020460590 wait complete. 2026-02-19T08:24:29.836 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:29 trial027 ceph-mon[21739]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T08:24:29.837 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:29 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:24:29.837 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:29 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:29.837 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:29 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:29.837 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:29 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:29.837 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:29 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:29.837 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:29 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:29.837 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:29 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-19T08:24:29.837 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:29 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:29.882 DEBUG:teuthology.orchestra.run.trial027:osd.2> sudo journalctl -f -n 0 -u ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460@osd.2.service 2026-02-19T08:24:29.884 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2026-02-19T08:24:29.884 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd stat -f json 2026-02-19T08:24:30.082 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:30.201 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.195+0000 7fcc67029640 1 -- 10.20.193.27:0/3124316351 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcc601046d0 msgr2=0x7fcc60104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:30.202 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.195+0000 7fcc67029640 1 --2- 10.20.193.27:0/3124316351 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcc601046d0 0x7fcc60104ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcc500099b0 tx=0x7fcc5002f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:30.202 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.195+0000 7fcc67029640 1 -- 10.20.193.27:0/3124316351 shutdown_connections 2026-02-19T08:24:30.202 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.195+0000 7fcc67029640 1 --2- 10.20.193.27:0/3124316351 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcc601046d0 0x7fcc60104ad0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:30.202 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.195+0000 7fcc67029640 1 -- 10.20.193.27:0/3124316351 >> 10.20.193.27:0/3124316351 conn(0x7fcc600ffe60 msgr2=0x7fcc601022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:30.202 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.195+0000 7fcc67029640 1 -- 10.20.193.27:0/3124316351 shutdown_connections 2026-02-19T08:24:30.202 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.195+0000 7fcc67029640 1 -- 10.20.193.27:0/3124316351 wait complete. 2026-02-19T08:24:30.202 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc67029640 1 Processor -- start 2026-02-19T08:24:30.202 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc67029640 1 -- start start 2026-02-19T08:24:30.202 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc67029640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcc601046d0 0x7fcc6019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:30.202 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc67029640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fcc60109b50 con 0x7fcc601046d0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc64d9e640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcc601046d0 0x7fcc6019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc64d9e640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcc601046d0 0x7fcc6019b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:59356/0 (socket says 10.20.193.27:59356) 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc64d9e640 1 -- 10.20.193.27:0/2033410112 learned_addr learned my addr 10.20.193.27:0/2033410112 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc64d9e640 1 -- 10.20.193.27:0/2033410112 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6019b7f0 con 0x7fcc601046d0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc64d9e640 1 --2- 10.20.193.27:0/2033410112 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcc601046d0 0x7fcc6019b2b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc50005ec0 tx=0x7fcc50004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc55ffb640 1 -- 10.20.193.27:0/2033410112 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc50038510 con 0x7fcc601046d0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc67029640 1 -- 10.20.193.27:0/2033410112 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6019ba80 con 0x7fcc601046d0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc55ffb640 1 -- 10.20.193.27:0/2033410112 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fcc50046070 con 0x7fcc601046d0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc55ffb640 1 -- 10.20.193.27:0/2033410112 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc50041810 con 0x7fcc601046d0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.196+0000 7fcc67029640 1 -- 10.20.193.27:0/2033410112 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6019e770 con 0x7fcc601046d0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.197+0000 7fcc67029640 1 -- 10.20.193.27:0/2033410112 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6010a2f0 con 0x7fcc601046d0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.197+0000 7fcc55ffb640 1 -- 10.20.193.27:0/2033410112 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fcc500386b0 con 0x7fcc601046d0 2026-02-19T08:24:30.203 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.197+0000 7fcc55ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:30.204 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.197+0000 7fcc55ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:30.204 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.197+0000 7fcc55ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:30.204 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.197+0000 7fcc55ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:30.204 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.197+0000 7fcc55ffb640 1 --2- 10.20.193.27:0/2033410112 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc3c03de30 0x7fcc3c0402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:30.204 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.197+0000 7fcc55ffb640 1 -- 10.20.193.27:0/2033410112 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7fcc50077710 con 0x7fcc601046d0 2026-02-19T08:24:30.204 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.197+0000 7fcc57fff640 1 --2- 10.20.193.27:0/2033410112 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc3c03de30 0x7fcc3c0402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:30.204 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.198+0000 7fcc57fff640 1 --2- 10.20.193.27:0/2033410112 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc3c03de30 0x7fcc3c0402f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcc480099c0 tx=0x7fcc48006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:30.204 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.200+0000 7fcc55ffb640 1 -- 10.20.193.27:0/2033410112 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcc500389d0 con 0x7fcc601046d0 2026-02-19T08:24:30.289 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.285+0000 7fcc67029640 1 -- 10.20.193.27:0/2033410112 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fcc601948b0 con 0x7fcc601046d0 2026-02-19T08:24:30.289 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.285+0000 7fcc55ffb640 1 -- 10.20.193.27:0/2033410112 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7fcc5004a3c0 con 0x7fcc601046d0 2026-02-19T08:24:30.289 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:30.290 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 10 mgrc shutdown 2026-02-19T08:24:30.290 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 1 -- 10.20.193.27:0/2033410112 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc3c03de30 msgr2=0x7fcc3c0402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:30.290 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 1 --2- 10.20.193.27:0/2033410112 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc3c03de30 0x7fcc3c0402f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcc480099c0 tx=0x7fcc48006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:30.290 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 1 -- 10.20.193.27:0/2033410112 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcc601046d0 msgr2=0x7fcc6019b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:30.290 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 1 --2- 10.20.193.27:0/2033410112 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcc601046d0 0x7fcc6019b2b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcc50005ec0 tx=0x7fcc50004290 comp rx=0 tx=0).stop 2026-02-19T08:24:30.290 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 1 -- 10.20.193.27:0/2033410112 shutdown_connections 2026-02-19T08:24:30.291 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 1 --2- 10.20.193.27:0/2033410112 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc3c03de30 0x7fcc3c0402f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:30.291 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 1 --2- 10.20.193.27:0/2033410112 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fcc601046d0 0x7fcc6019b2b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:30.291 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 1 -- 10.20.193.27:0/2033410112 >> 10.20.193.27:0/2033410112 conn(0x7fcc600ffe60 msgr2=0x7fcc60100950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:30.291 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 1 -- 10.20.193.27:0/2033410112 shutdown_connections 2026-02-19T08:24:30.291 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:30.286+0000 7fcc67029640 1 -- 10.20.193.27:0/2033410112 wait complete. 2026-02-19T08:24:30.327 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771489466,"num_in_osds":3,"osd_in_since":1771489461,"num_remapped_pgs":0} 2026-02-19T08:24:30.843 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:30 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-19T08:24:30.843 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:30 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:30.843 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:30 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:30.843 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:30 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2033410112' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-19T08:24:31.098 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:30 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-2[45587]: 2026-02-19T08:24:30.838+0000 7f8258c02740 -1 Falling back to public interface 2026-02-19T08:24:31.328 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd stat -f json 2026-02-19T08:24:31.481 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:31.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.581+0000 7f24a9e3d640 1 -- 10.20.193.27:0/3457274270 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f24a41046d0 msgr2=0x7f24a4104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:31.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.581+0000 7f24a9e3d640 1 --2- 10.20.193.27:0/3457274270 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f24a41046d0 0x7f24a4104ad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24900099b0 tx=0x7f249002f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:31.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.581+0000 7f24a9e3d640 1 -- 10.20.193.27:0/3457274270 shutdown_connections 2026-02-19T08:24:31.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.581+0000 7f24a9e3d640 1 --2- 10.20.193.27:0/3457274270 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f24a41046d0 0x7f24a4104ad0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.581+0000 7f24a9e3d640 1 -- 10.20.193.27:0/3457274270 >> 10.20.193.27:0/3457274270 conn(0x7f24a40ffe60 msgr2=0x7f24a41022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.581+0000 7f24a9e3d640 1 -- 10.20.193.27:0/3457274270 shutdown_connections 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.581+0000 7f24a9e3d640 1 -- 10.20.193.27:0/3457274270 wait complete. 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a9e3d640 1 Processor -- start 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a9e3d640 1 -- start start 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a9e3d640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f24a41046d0 0x7f24a419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a9e3d640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4109b50 con 0x7f24a41046d0 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a37fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f24a41046d0 0x7f24a419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a37fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f24a41046d0 0x7f24a419b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:59372/0 (socket says 10.20.193.27:59372) 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a37fe640 1 -- 10.20.193.27:0/1358679472 learned_addr learned my addr 10.20.193.27:0/1358679472 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a37fe640 1 -- 10.20.193.27:0/1358679472 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a419b7f0 con 0x7f24a41046d0 2026-02-19T08:24:31.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a37fe640 1 --2- 10.20.193.27:0/1358679472 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f24a41046d0 0x7f24a419b2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2490002410 tx=0x7f2490004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a0ff9640 1 -- 10.20.193.27:0/1358679472 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2490038510 con 0x7f24a41046d0 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a0ff9640 1 -- 10.20.193.27:0/1358679472 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f2490046070 con 0x7f24a41046d0 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a9e3d640 1 -- 10.20.193.27:0/1358679472 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a419ba80 con 0x7f24a41046d0 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a0ff9640 1 -- 10.20.193.27:0/1358679472 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2490041730 con 0x7f24a41046d0 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.582+0000 7f24a9e3d640 1 -- 10.20.193.27:0/1358679472 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a419e770 con 0x7f24a41046d0 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.583+0000 7f24a9e3d640 1 -- 10.20.193.27:0/1358679472 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a410a2f0 con 0x7f24a41046d0 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.583+0000 7f24a0ff9640 1 -- 10.20.193.27:0/1358679472 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f24900386b0 con 0x7f24a41046d0 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.583+0000 7f24a0ff9640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.583+0000 7f24a0ff9640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.583+0000 7f24a0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.583+0000 7f24a0ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.583+0000 7f24a0ff9640 1 --2- 10.20.193.27:0/1358679472 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f247803de30 0x7f24780402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:31.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.583+0000 7f24a0ff9640 1 -- 10.20.193.27:0/1358679472 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7f2490077790 con 0x7f24a41046d0 2026-02-19T08:24:31.590 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.583+0000 7f24a2ffd640 1 --2- 10.20.193.27:0/1358679472 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f247803de30 0x7f24780402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:31.590 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.583+0000 7f24a2ffd640 1 --2- 10.20.193.27:0/1358679472 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f247803de30 0x7f24780402f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24940099c0 tx=0x7f2494006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:31.590 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.586+0000 7f24a0ff9640 1 -- 10.20.193.27:0/1358679472 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2490038c90 con 0x7f24a41046d0 2026-02-19T08:24:31.672 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.668+0000 7f24a9e3d640 1 -- 10.20.193.27:0/1358679472 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f24a41948b0 con 0x7f24a41046d0 2026-02-19T08:24:31.672 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: Detected new or changed devices on trial027 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: Adjusting osd_memory_target on trial027 to 28015M 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-19T08:24:31.673 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:31 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:31.674 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.668+0000 7f24a0ff9640 1 -- 10.20.193.27:0/1358679472 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7f2490037cd0 con 0x7f24a41046d0 2026-02-19T08:24:31.674 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:31.675 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.669+0000 7f24a9e3d640 10 mgrc shutdown 2026-02-19T08:24:31.675 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.669+0000 7f24a9e3d640 1 -- 10.20.193.27:0/1358679472 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f247803de30 msgr2=0x7f24780402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:31.675 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.669+0000 7f24a9e3d640 1 --2- 10.20.193.27:0/1358679472 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f247803de30 0x7f24780402f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24940099c0 tx=0x7f2494006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:31.675 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.669+0000 7f24a9e3d640 1 -- 10.20.193.27:0/1358679472 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f24a41046d0 msgr2=0x7f24a419b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:31.676 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.669+0000 7f24a9e3d640 1 --2- 10.20.193.27:0/1358679472 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f24a41046d0 0x7f24a419b2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2490002410 tx=0x7f2490004290 comp rx=0 tx=0).stop 2026-02-19T08:24:31.676 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.669+0000 7f24a9e3d640 1 -- 10.20.193.27:0/1358679472 shutdown_connections 2026-02-19T08:24:31.676 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.670+0000 7f24a9e3d640 1 --2- 10.20.193.27:0/1358679472 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f247803de30 0x7f24780402f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:31.676 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.670+0000 7f24a9e3d640 1 --2- 10.20.193.27:0/1358679472 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f24a41046d0 0x7f24a419b2b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:31.676 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.670+0000 7f24a9e3d640 1 -- 10.20.193.27:0/1358679472 >> 10.20.193.27:0/1358679472 conn(0x7f24a40ffe60 msgr2=0x7f24a4100950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:31.676 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.670+0000 7f24a9e3d640 1 -- 10.20.193.27:0/1358679472 shutdown_connections 2026-02-19T08:24:31.676 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:31.670+0000 7f24a9e3d640 1 -- 10.20.193.27:0/1358679472 wait complete. 2026-02-19T08:24:31.709 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771489466,"num_in_osds":3,"osd_in_since":1771489461,"num_remapped_pgs":0} 2026-02-19T08:24:32.710 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd stat -f json 2026-02-19T08:24:32.863 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:32.885 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:32 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1358679472' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-19T08:24:32.969 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 -- 10.20.193.27:0/369043823 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc2a00770a0 msgr2=0x7fc2a0075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:32.969 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 --2- 10.20.193.27:0/369043823 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc2a00770a0 0x7fc2a0075500 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc2900099b0 tx=0x7fc29002f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:32.969 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 -- 10.20.193.27:0/369043823 shutdown_connections 2026-02-19T08:24:32.969 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 --2- 10.20.193.27:0/369043823 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc2a00770a0 0x7fc2a0075500 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:32.969 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 -- 10.20.193.27:0/369043823 >> 10.20.193.27:0/369043823 conn(0x7fc2a00fdbb0 msgr2=0x7fc2a00ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:32.969 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 -- 10.20.193.27:0/369043823 shutdown_connections 2026-02-19T08:24:32.969 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 -- 10.20.193.27:0/369043823 wait complete. 2026-02-19T08:24:32.969 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 Processor -- start 2026-02-19T08:24:32.969 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 -- start start 2026-02-19T08:24:32.969 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc2a00770a0 0x7fc2a019b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a7def640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0109b00 con 0x7fc2a00770a0 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a5b64640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc2a00770a0 0x7fc2a019b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a5b64640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc2a00770a0 0x7fc2a019b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:59392/0 (socket says 10.20.193.27:59392) 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a5b64640 1 -- 10.20.193.27:0/1299215233 learned_addr learned my addr 10.20.193.27:0/1299215233 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.963+0000 7fc2a5b64640 1 -- 10.20.193.27:0/1299215233 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a019b7c0 con 0x7fc2a00770a0 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc2a5b64640 1 --2- 10.20.193.27:0/1299215233 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc2a00770a0 0x7fc2a019b280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc290009ae0 tx=0x7fc290004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc28effd640 1 -- 10.20.193.27:0/1299215233 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc290038640 con 0x7fc2a00770a0 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc2a7def640 1 -- 10.20.193.27:0/1299215233 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a019ba50 con 0x7fc2a00770a0 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc28effd640 1 -- 10.20.193.27:0/1299215233 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc290046070 con 0x7fc2a00770a0 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc28effd640 1 -- 10.20.193.27:0/1299215233 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc290041870 con 0x7fc2a00770a0 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc2a7def640 1 -- 10.20.193.27:0/1299215233 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a019e740 con 0x7fc2a00770a0 2026-02-19T08:24:32.970 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc2a7def640 1 -- 10.20.193.27:0/1299215233 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a010a2a0 con 0x7fc2a00770a0 2026-02-19T08:24:32.971 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc28effd640 1 -- 10.20.193.27:0/1299215233 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fc290041b30 con 0x7fc2a00770a0 2026-02-19T08:24:32.971 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc28effd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:32.971 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc28effd640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:32.971 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc28effd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:32.971 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc28effd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:32.971 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.964+0000 7fc28effd640 1 --2- 10.20.193.27:0/1299215233 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc27c03de30 0x7fc27c0402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:32.971 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.965+0000 7fc28effd640 1 -- 10.20.193.27:0/1299215233 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7fc290078180 con 0x7fc2a00770a0 2026-02-19T08:24:32.971 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.965+0000 7fc2a5363640 1 --2- 10.20.193.27:0/1299215233 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc27c03de30 0x7fc27c0402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:32.971 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.965+0000 7fc2a5363640 1 --2- 10.20.193.27:0/1299215233 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc27c03de30 0x7fc27c0402f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc2940099c0 tx=0x7fc294006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:32.972 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:32.967+0000 7fc28effd640 1 -- 10.20.193.27:0/1299215233 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc29004ac90 con 0x7fc2a00770a0 2026-02-19T08:24:33.054 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:33.056 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.051+0000 7fc2a7def640 1 -- 10.20.193.27:0/1299215233 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc2a0194890 con 0x7fc2a00770a0 2026-02-19T08:24:33.056 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.051+0000 7fc28effd640 1 -- 10.20.193.27:0/1299215233 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7fc290047d00 con 0x7fc2a00770a0 2026-02-19T08:24:33.056 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 10 mgrc shutdown 2026-02-19T08:24:33.056 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 1 -- 10.20.193.27:0/1299215233 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc27c03de30 msgr2=0x7fc27c0402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:33.056 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 1 --2- 10.20.193.27:0/1299215233 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc27c03de30 0x7fc27c0402f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc2940099c0 tx=0x7fc294006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:33.056 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 1 -- 10.20.193.27:0/1299215233 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc2a00770a0 msgr2=0x7fc2a019b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:33.056 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 1 --2- 10.20.193.27:0/1299215233 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc2a00770a0 0x7fc2a019b280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc290009ae0 tx=0x7fc290004290 comp rx=0 tx=0).stop 2026-02-19T08:24:33.056 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 1 -- 10.20.193.27:0/1299215233 shutdown_connections 2026-02-19T08:24:33.056 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 1 --2- 10.20.193.27:0/1299215233 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fc27c03de30 0x7fc27c0402f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:33.057 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 1 --2- 10.20.193.27:0/1299215233 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fc2a00770a0 0x7fc2a019b280 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:33.057 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 1 -- 10.20.193.27:0/1299215233 >> 10.20.193.27:0/1299215233 conn(0x7fc2a00fdbb0 msgr2=0x7fc2a00fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:33.057 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 1 -- 10.20.193.27:0/1299215233 shutdown_connections 2026-02-19T08:24:33.057 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:33.052+0000 7fc2a7def640 1 -- 10.20.193.27:0/1299215233 wait complete. 2026-02-19T08:24:33.090 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771489466,"num_in_osds":3,"osd_in_since":1771489461,"num_remapped_pgs":0} 2026-02-19T08:24:34.092 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd stat -f json 2026-02-19T08:24:34.097 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:33 trial027 ceph-mon[21739]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T08:24:34.098 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:33 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1299215233' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-19T08:24:34.242 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:34.349 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.343+0000 7f26b6fd1640 1 -- 10.20.193.27:0/133361878 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f26b01046a0 msgr2=0x7f26b0104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:34.349 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.343+0000 7f26b6fd1640 1 --2- 10.20.193.27:0/133361878 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f26b01046a0 0x7f26b0104aa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26a00099b0 tx=0x7f26a002f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:34.349 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.343+0000 7f26b6fd1640 1 -- 10.20.193.27:0/133361878 shutdown_connections 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.343+0000 7f26b6fd1640 1 --2- 10.20.193.27:0/133361878 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f26b01046a0 0x7f26b0104aa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.343+0000 7f26b6fd1640 1 -- 10.20.193.27:0/133361878 >> 10.20.193.27:0/133361878 conn(0x7f26b00ffe30 msgr2=0x7f26b0102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.343+0000 7f26b6fd1640 1 -- 10.20.193.27:0/133361878 shutdown_connections 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.343+0000 7f26b6fd1640 1 -- 10.20.193.27:0/133361878 wait complete. 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b6fd1640 1 Processor -- start 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b6fd1640 1 -- start start 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b6fd1640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f26b01046a0 0x7f26b019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b6fd1640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0109b20 con 0x7f26b01046a0 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b4d46640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f26b01046a0 0x7f26b019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b4d46640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f26b01046a0 0x7f26b019b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:59410/0 (socket says 10.20.193.27:59410) 2026-02-19T08:24:34.350 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b4d46640 1 -- 10.20.193.27:0/4282676849 learned_addr learned my addr 10.20.193.27:0/4282676849 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b4d46640 1 -- 10.20.193.27:0/4282676849 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b019b800 con 0x7f26b01046a0 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b4d46640 1 --2- 10.20.193.27:0/4282676849 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f26b01046a0 0x7f26b019b2c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f26a0005ec0 tx=0x7f26a0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26a5ffb640 1 -- 10.20.193.27:0/4282676849 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26a0038510 con 0x7f26b01046a0 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b6fd1640 1 -- 10.20.193.27:0/4282676849 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b019ba90 con 0x7f26b01046a0 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26a5ffb640 1 -- 10.20.193.27:0/4282676849 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f26a0046070 con 0x7f26b01046a0 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26a5ffb640 1 -- 10.20.193.27:0/4282676849 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26a0041810 con 0x7f26b01046a0 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.344+0000 7f26b6fd1640 1 -- 10.20.193.27:0/4282676849 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b019e780 con 0x7f26b01046a0 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.345+0000 7f26b6fd1640 1 -- 10.20.193.27:0/4282676849 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b010a2c0 con 0x7f26b01046a0 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.345+0000 7f26a5ffb640 1 -- 10.20.193.27:0/4282676849 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f26a00386b0 con 0x7f26b01046a0 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.345+0000 7f26a5ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.345+0000 7f26a5ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.345+0000 7f26a5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:34.351 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.345+0000 7f26a5ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:34.352 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.345+0000 7f26a5ffb640 1 --2- 10.20.193.27:0/4282676849 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f268c03de30 0x7f268c0402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:34.352 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.345+0000 7f26a5ffb640 1 -- 10.20.193.27:0/4282676849 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7f26a0077710 con 0x7f26b01046a0 2026-02-19T08:24:34.352 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.345+0000 7f26a7fff640 1 --2- 10.20.193.27:0/4282676849 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f268c03de30 0x7f268c0402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:34.352 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.346+0000 7f26a7fff640 1 --2- 10.20.193.27:0/4282676849 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f268c03de30 0x7f268c0402f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f26980099c0 tx=0x7f2698006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:34.352 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.348+0000 7f26a5ffb640 1 -- 10.20.193.27:0/4282676849 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f26a00389d0 con 0x7f26b01046a0 2026-02-19T08:24:34.437 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.433+0000 7f26b6fd1640 1 -- 10.20.193.27:0/4282676849 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f26b0194880 con 0x7f26b01046a0 2026-02-19T08:24:34.437 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.434+0000 7f26a5ffb640 1 -- 10.20.193.27:0/4282676849 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7f26a004a3c0 con 0x7f26b01046a0 2026-02-19T08:24:34.438 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:34.439 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 10 mgrc shutdown 2026-02-19T08:24:34.439 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 1 -- 10.20.193.27:0/4282676849 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f268c03de30 msgr2=0x7f268c0402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:34.439 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 1 --2- 10.20.193.27:0/4282676849 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f268c03de30 0x7f268c0402f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f26980099c0 tx=0x7f2698006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:34.439 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 1 -- 10.20.193.27:0/4282676849 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f26b01046a0 msgr2=0x7f26b019b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:34.439 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 1 --2- 10.20.193.27:0/4282676849 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f26b01046a0 0x7f26b019b2c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f26a0005ec0 tx=0x7f26a0004290 comp rx=0 tx=0).stop 2026-02-19T08:24:34.439 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 1 -- 10.20.193.27:0/4282676849 shutdown_connections 2026-02-19T08:24:34.439 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 1 --2- 10.20.193.27:0/4282676849 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f268c03de30 0x7f268c0402f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:34.439 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 1 --2- 10.20.193.27:0/4282676849 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f26b01046a0 0x7f26b019b2c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:34.439 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 1 -- 10.20.193.27:0/4282676849 >> 10.20.193.27:0/4282676849 conn(0x7f26b00ffe30 msgr2=0x7f26b01004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:34.440 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 1 -- 10.20.193.27:0/4282676849 shutdown_connections 2026-02-19T08:24:34.440 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:34.435+0000 7f26b6fd1640 1 -- 10.20.193.27:0/4282676849 wait complete. 2026-02-19T08:24:34.475 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771489466,"num_in_osds":3,"osd_in_since":1771489461,"num_remapped_pgs":0} 2026-02-19T08:24:34.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:34 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/4282676849' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-19T08:24:35.476 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd stat -f json 2026-02-19T08:24:35.502 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:35 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-2[45587]: 2026-02-19T08:24:35.136+0000 7f8258c02740 -1 osd.2 0 log_to_monitors true 2026-02-19T08:24:35.631 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:35.741 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 -- 10.20.193.27:0/845684441 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1d101046a0 msgr2=0x7f1d10104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:35.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 --2- 10.20.193.27:0/845684441 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1d101046a0 0x7f1d10104aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1d000099b0 tx=0x7f1d0002f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:35.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 -- 10.20.193.27:0/845684441 shutdown_connections 2026-02-19T08:24:35.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 --2- 10.20.193.27:0/845684441 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1d101046a0 0x7f1d10104aa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:35.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 -- 10.20.193.27:0/845684441 >> 10.20.193.27:0/845684441 conn(0x7f1d100ffe30 msgr2=0x7f1d10102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:35.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 -- 10.20.193.27:0/845684441 shutdown_connections 2026-02-19T08:24:35.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 -- 10.20.193.27:0/845684441 wait complete. 2026-02-19T08:24:35.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 Processor -- start 2026-02-19T08:24:35.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 -- start start 2026-02-19T08:24:35.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1d101046a0 0x7f1d1019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:35.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d17f1f640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10109b20 con 0x7f1d101046a0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d15c94640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1d101046a0 0x7f1d1019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d15c94640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1d101046a0 0x7f1d1019b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:59436/0 (socket says 10.20.193.27:59436) 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d15c94640 1 -- 10.20.193.27:0/2636882971 learned_addr learned my addr 10.20.193.27:0/2636882971 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.736+0000 7f1d15c94640 1 -- 10.20.193.27:0/2636882971 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1019b800 con 0x7f1d101046a0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.737+0000 7f1d15c94640 1 --2- 10.20.193.27:0/2636882971 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1d101046a0 0x7f1d1019b2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d00005ec0 tx=0x7f1d00004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.737+0000 7f1cfeffd640 1 -- 10.20.193.27:0/2636882971 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d00038510 con 0x7f1d101046a0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.737+0000 7f1cfeffd640 1 -- 10.20.193.27:0/2636882971 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1d00046070 con 0x7f1d101046a0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.737+0000 7f1d17f1f640 1 -- 10.20.193.27:0/2636882971 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1019ba90 con 0x7f1d101046a0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.737+0000 7f1cfeffd640 1 -- 10.20.193.27:0/2636882971 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d00041810 con 0x7f1d101046a0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.737+0000 7f1d17f1f640 1 -- 10.20.193.27:0/2636882971 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1019e780 con 0x7f1d101046a0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.737+0000 7f1d17f1f640 1 -- 10.20.193.27:0/2636882971 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1010a2c0 con 0x7f1d101046a0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.737+0000 7f1cfeffd640 1 -- 10.20.193.27:0/2636882971 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f1d000386b0 con 0x7f1d101046a0 2026-02-19T08:24:35.743 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.737+0000 7f1cfeffd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:35.744 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.738+0000 7f1cfeffd640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:35.744 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.738+0000 7f1cfeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:35.744 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.738+0000 7f1cfeffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:35.744 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.738+0000 7f1cfeffd640 1 --2- 10.20.193.27:0/2636882971 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1cec03de80 0x7f1cec040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:35.744 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.738+0000 7f1cfeffd640 1 -- 10.20.193.27:0/2636882971 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2333+0+0 (secure 0 0 0) 0x7f1d00077790 con 0x7f1d101046a0 2026-02-19T08:24:35.744 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.738+0000 7f1d15493640 1 --2- 10.20.193.27:0/2636882971 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1cec03de80 0x7f1cec040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:35.744 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.738+0000 7f1d15493640 1 --2- 10.20.193.27:0/2636882971 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1cec03de80 0x7f1cec040340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1d040099c0 tx=0x7f1d04006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:35.745 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.740+0000 7f1cfeffd640 1 -- 10.20.193.27:0/2636882971 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1d000389d0 con 0x7f1d101046a0 2026-02-19T08:24:35.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.825+0000 7f1d17f1f640 1 -- 10.20.193.27:0/2636882971 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1d101948b0 con 0x7f1d101046a0 2026-02-19T08:24:35.829 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:35 trial027 ceph-mon[21739]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T08:24:35.829 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:35 trial027 ceph-mon[21739]: from='osd.2 [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-19T08:24:35.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.825+0000 7f1cfeffd640 1 -- 10.20.193.27:0/2636882971 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v16) ==== 74+0+130 (secure 0 0 0) 0x7f1d00037cd0 con 0x7f1d101046a0 2026-02-19T08:24:35.830 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:35.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 10 mgrc shutdown 2026-02-19T08:24:35.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 1 -- 10.20.193.27:0/2636882971 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1cec03de80 msgr2=0x7f1cec040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:35.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 1 --2- 10.20.193.27:0/2636882971 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1cec03de80 0x7f1cec040340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1d040099c0 tx=0x7f1d04006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:35.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 1 -- 10.20.193.27:0/2636882971 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1d101046a0 msgr2=0x7f1d1019b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:35.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 1 --2- 10.20.193.27:0/2636882971 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1d101046a0 0x7f1d1019b2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d00005ec0 tx=0x7f1d00004290 comp rx=0 tx=0).stop 2026-02-19T08:24:35.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 1 -- 10.20.193.27:0/2636882971 shutdown_connections 2026-02-19T08:24:35.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 1 --2- 10.20.193.27:0/2636882971 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1cec03de80 0x7f1cec040340 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:35.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 1 --2- 10.20.193.27:0/2636882971 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1d101046a0 0x7f1d1019b2c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:35.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 1 -- 10.20.193.27:0/2636882971 >> 10.20.193.27:0/2636882971 conn(0x7f1d100ffe30 msgr2=0x7f1d101004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:35.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 1 -- 10.20.193.27:0/2636882971 shutdown_connections 2026-02-19T08:24:35.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:35.826+0000 7f1d17f1f640 1 -- 10.20.193.27:0/2636882971 wait complete. 2026-02-19T08:24:35.865 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":16,"num_osds":3,"num_up_osds":2,"osd_up_since":1771489466,"num_in_osds":3,"osd_in_since":1771489461,"num_remapped_pgs":0} 2026-02-19T08:24:36.866 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd stat -f json 2026-02-19T08:24:36.890 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:36 trial027 ceph-mon[21739]: from='osd.2 [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-19T08:24:36.890 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:36 trial027 ceph-mon[21739]: osdmap e16: 3 total, 2 up, 3 in 2026-02-19T08:24:36.890 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:36 trial027 ceph-mon[21739]: from='osd.2 [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial027", "root=default"]}]: dispatch 2026-02-19T08:24:36.890 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:36 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-19T08:24:36.890 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:36 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2636882971' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-19T08:24:36.890 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:36 trial027 ceph-mon[21739]: from='osd.2 [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial027", "root=default"]}]': finished 2026-02-19T08:24:36.890 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:36 trial027 ceph-mon[21739]: osdmap e17: 3 total, 2 up, 3 in 2026-02-19T08:24:36.891 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-2[45587]: 2026-02-19T08:24:36.610+0000 7f8254360640 -1 osd.2 0 waiting for initial osdmap 2026-02-19T08:24:36.891 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:36 trial027 ceph-3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460-osd-2[45587]: 2026-02-19T08:24:36.612+0000 7f825099c640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T08:24:37.018 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.115+0000 7f349ad0a640 1 -- 10.20.193.27:0/935845354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f34941046d0 msgr2=0x7f3494104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.115+0000 7f349ad0a640 1 --2- 10.20.193.27:0/935845354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f34941046d0 0x7f3494104ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f34840099b0 tx=0x7f348402f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.115+0000 7f349ad0a640 1 -- 10.20.193.27:0/935845354 shutdown_connections 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.115+0000 7f349ad0a640 1 --2- 10.20.193.27:0/935845354 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f34941046d0 0x7f3494104ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.115+0000 7f349ad0a640 1 -- 10.20.193.27:0/935845354 >> 10.20.193.27:0/935845354 conn(0x7f34940ffe60 msgr2=0x7f34941022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.115+0000 7f349ad0a640 1 -- 10.20.193.27:0/935845354 shutdown_connections 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.115+0000 7f349ad0a640 1 -- 10.20.193.27:0/935845354 wait complete. 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f349ad0a640 1 Processor -- start 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f349ad0a640 1 -- start start 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f349ad0a640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f34941046d0 0x7f349419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f349ad0a640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f3494109b50 con 0x7f34941046d0 2026-02-19T08:24:37.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f3498a7f640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f34941046d0 0x7f349419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f3498a7f640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f34941046d0 0x7f349419b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:59446/0 (socket says 10.20.193.27:59446) 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f3498a7f640 1 -- 10.20.193.27:0/4127971215 learned_addr learned my addr 10.20.193.27:0/4127971215 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f3498a7f640 1 -- 10.20.193.27:0/4127971215 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349419b7f0 con 0x7f34941046d0 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f3498a7f640 1 --2- 10.20.193.27:0/4127971215 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f34941046d0 0x7f349419b2b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3484005ec0 tx=0x7f3484004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f3489ffb640 1 -- 10.20.193.27:0/4127971215 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3484038510 con 0x7f34941046d0 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f349ad0a640 1 -- 10.20.193.27:0/4127971215 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349419ba80 con 0x7f34941046d0 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f3489ffb640 1 -- 10.20.193.27:0/4127971215 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3484046070 con 0x7f34941046d0 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f3489ffb640 1 -- 10.20.193.27:0/4127971215 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3484041810 con 0x7f34941046d0 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.116+0000 7f349ad0a640 1 -- 10.20.193.27:0/4127971215 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349419e770 con 0x7f34941046d0 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.117+0000 7f349ad0a640 1 -- 10.20.193.27:0/4127971215 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349410a2f0 con 0x7f34941046d0 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.117+0000 7f3489ffb640 1 -- 10.20.193.27:0/4127971215 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f34840386b0 con 0x7f34941046d0 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.117+0000 7f3489ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.117+0000 7f3489ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.117+0000 7f3489ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:37.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.117+0000 7f3489ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:37.121 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.117+0000 7f3489ffb640 1 --2- 10.20.193.27:0/4127971215 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f347003de80 0x7f3470040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:37.121 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.117+0000 7f3489ffb640 1 -- 10.20.193.27:0/4127971215 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2349+0+0 (secure 0 0 0) 0x7f34840777c0 con 0x7f34941046d0 2026-02-19T08:24:37.121 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.117+0000 7f348bfff640 1 --2- 10.20.193.27:0/4127971215 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f347003de80 0x7f3470040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:37.121 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.118+0000 7f348bfff640 1 --2- 10.20.193.27:0/4127971215 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f347003de80 0x7f3470040340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f347c0099c0 tx=0x7f347c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:37.123 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.120+0000 7f3489ffb640 1 -- 10.20.193.27:0/4127971215 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f34840389d0 con 0x7f34941046d0 2026-02-19T08:24:37.206 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.202+0000 7f349ad0a640 1 -- 10.20.193.27:0/4127971215 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f34941948b0 con 0x7f34941046d0 2026-02-19T08:24:37.206 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.202+0000 7f3489ffb640 1 -- 10.20.193.27:0/4127971215 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v17) ==== 74+0+130 (secure 0 0 0) 0x7f348404a3c0 con 0x7f34941046d0 2026-02-19T08:24:37.206 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:37.206 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 10 mgrc shutdown 2026-02-19T08:24:37.206 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 1 -- 10.20.193.27:0/4127971215 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f347003de80 msgr2=0x7f3470040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:37.207 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 1 --2- 10.20.193.27:0/4127971215 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f347003de80 0x7f3470040340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f347c0099c0 tx=0x7f347c006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:37.207 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 1 -- 10.20.193.27:0/4127971215 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f34941046d0 msgr2=0x7f349419b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:37.207 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 1 --2- 10.20.193.27:0/4127971215 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f34941046d0 0x7f349419b2b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3484005ec0 tx=0x7f3484004290 comp rx=0 tx=0).stop 2026-02-19T08:24:37.207 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 1 -- 10.20.193.27:0/4127971215 shutdown_connections 2026-02-19T08:24:37.207 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 1 --2- 10.20.193.27:0/4127971215 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f347003de80 0x7f3470040340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:37.207 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 1 --2- 10.20.193.27:0/4127971215 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f34941046d0 0x7f349419b2b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:37.207 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 1 -- 10.20.193.27:0/4127971215 >> 10.20.193.27:0/4127971215 conn(0x7f34940ffe60 msgr2=0x7f3494100950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:37.207 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 1 -- 10.20.193.27:0/4127971215 shutdown_connections 2026-02-19T08:24:37.207 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:37.203+0000 7f349ad0a640 1 -- 10.20.193.27:0/4127971215 wait complete. 2026-02-19T08:24:37.242 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":17,"num_osds":3,"num_up_osds":2,"osd_up_since":1771489466,"num_in_osds":3,"osd_in_since":1771489461,"num_remapped_pgs":0} 2026-02-19T08:24:38.097 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:37 trial027 ceph-mon[21739]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T08:24:38.097 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:37 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-19T08:24:38.097 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:37 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-19T08:24:38.097 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:37 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/4127971215' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-19T08:24:38.243 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd stat -f json 2026-02-19T08:24:38.395 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 -- 10.20.193.27:0/2154614401 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efe380770a0 msgr2=0x7efe38075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 --2- 10.20.193.27:0/2154614401 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efe380770a0 0x7efe38075500 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efe280099b0 tx=0x7efe2802f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 -- 10.20.193.27:0/2154614401 shutdown_connections 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 --2- 10.20.193.27:0/2154614401 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efe380770a0 0x7efe38075500 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 -- 10.20.193.27:0/2154614401 >> 10.20.193.27:0/2154614401 conn(0x7efe380fdbb0 msgr2=0x7efe380ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 -- 10.20.193.27:0/2154614401 shutdown_connections 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 -- 10.20.193.27:0/2154614401 wait complete. 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 Processor -- start 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 -- start start 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efe380770a0 0x7efe3819f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3fba5640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7efe381055f0 con 0x7efe380770a0 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3d91a640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efe380770a0 0x7efe3819f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3d91a640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efe380770a0 0x7efe3819f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57286/0 (socket says 10.20.193.27:57286) 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.491+0000 7efe3d91a640 1 -- 10.20.193.27:0/729250424 learned_addr learned my addr 10.20.193.27:0/729250424 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.492+0000 7efe3d91a640 1 -- 10.20.193.27:0/729250424 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3819fcf0 con 0x7efe380770a0 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.492+0000 7efe3d91a640 1 --2- 10.20.193.27:0/729250424 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efe380770a0 0x7efe3819f7b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe28009ae0 tx=0x7efe28004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.492+0000 7efe26ffd640 1 -- 10.20.193.27:0/729250424 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe28038640 con 0x7efe380770a0 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.492+0000 7efe3fba5640 1 -- 10.20.193.27:0/729250424 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3819ff80 con 0x7efe380770a0 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.492+0000 7efe26ffd640 1 -- 10.20.193.27:0/729250424 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7efe28046070 con 0x7efe380770a0 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.492+0000 7efe26ffd640 1 -- 10.20.193.27:0/729250424 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe28041870 con 0x7efe380770a0 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.492+0000 7efe3fba5640 1 -- 10.20.193.27:0/729250424 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe381a2c70 con 0x7efe380770a0 2026-02-19T08:24:38.495 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.492+0000 7efe3fba5640 1 -- 10.20.193.27:0/729250424 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe38105d90 con 0x7efe380770a0 2026-02-19T08:24:38.496 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.492+0000 7efe26ffd640 1 -- 10.20.193.27:0/729250424 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7efe28041b30 con 0x7efe380770a0 2026-02-19T08:24:38.496 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.492+0000 7efe26ffd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:38.496 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.493+0000 7efe26ffd640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:38.496 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.493+0000 7efe26ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:38.496 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.493+0000 7efe26ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:38.496 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.493+0000 7efe26ffd640 1 --2- 10.20.193.27:0/729250424 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efe1403de30 0x7efe140402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:38.496 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.493+0000 7efe26ffd640 1 -- 10.20.193.27:0/729250424 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2629+0+0 (secure 0 0 0) 0x7efe280781d0 con 0x7efe380770a0 2026-02-19T08:24:38.496 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.493+0000 7efe3d119640 1 --2- 10.20.193.27:0/729250424 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efe1403de30 0x7efe140402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:38.496 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.493+0000 7efe3d119640 1 --2- 10.20.193.27:0/729250424 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efe1403de30 0x7efe140402f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0099c0 tx=0x7efe2c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:38.498 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.495+0000 7efe26ffd640 1 -- 10.20.193.27:0/729250424 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efe280048c0 con 0x7efe380770a0 2026-02-19T08:24:38.582 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.578+0000 7efe3fba5640 1 -- 10.20.193.27:0/729250424 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7efe38198d90 con 0x7efe380770a0 2026-02-19T08:24:38.582 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.578+0000 7efe26ffd640 1 -- 10.20.193.27:0/729250424 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v18) ==== 74+0+130 (secure 0 0 0) 0x7efe280765e0 con 0x7efe380770a0 2026-02-19T08:24:38.583 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:38.584 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 10 mgrc shutdown 2026-02-19T08:24:38.584 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 1 -- 10.20.193.27:0/729250424 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efe1403de30 msgr2=0x7efe140402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:38.584 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 1 --2- 10.20.193.27:0/729250424 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efe1403de30 0x7efe140402f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0099c0 tx=0x7efe2c006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:38.584 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 1 -- 10.20.193.27:0/729250424 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efe380770a0 msgr2=0x7efe3819f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:38.584 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 1 --2- 10.20.193.27:0/729250424 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efe380770a0 0x7efe3819f7b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe28009ae0 tx=0x7efe28004290 comp rx=0 tx=0).stop 2026-02-19T08:24:38.584 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 1 -- 10.20.193.27:0/729250424 shutdown_connections 2026-02-19T08:24:38.584 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 1 --2- 10.20.193.27:0/729250424 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efe1403de30 0x7efe140402f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:38.584 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 1 --2- 10.20.193.27:0/729250424 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efe380770a0 0x7efe3819f7b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:38.584 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 1 -- 10.20.193.27:0/729250424 >> 10.20.193.27:0/729250424 conn(0x7efe380fdbb0 msgr2=0x7efe380fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:38.584 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 1 -- 10.20.193.27:0/729250424 shutdown_connections 2026-02-19T08:24:38.585 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.579+0000 7efe3fba5640 1 -- 10.20.193.27:0/729250424 wait complete. 2026-02-19T08:24:38.618 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":18,"num_osds":3,"num_up_osds":3,"osd_up_since":1771489477,"num_in_osds":3,"osd_in_since":1771489461,"num_remapped_pgs":0} 2026-02-19T08:24:38.618 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd dump --format=json 2026-02-19T08:24:38.769 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:38.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:38 trial027 ceph-mon[21739]: purged_snaps scrub starts 2026-02-19T08:24:38.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:38 trial027 ceph-mon[21739]: purged_snaps scrub ok 2026-02-19T08:24:38.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:38 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-19T08:24:38.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:38 trial027 ceph-mon[21739]: osd.2 [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185] boot 2026-02-19T08:24:38.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:38 trial027 ceph-mon[21739]: osdmap e18: 3 total, 3 up, 3 in 2026-02-19T08:24:38.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:38 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-19T08:24:38.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:38 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-19T08:24:38.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:38 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/729250424' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-19T08:24:38.876 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.870+0000 7f31a85fc640 1 -- 10.20.193.27:0/869700895 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f31a010a640 msgr2=0x7f31a010aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:38.876 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.870+0000 7f31a85fc640 1 --2- 10.20.193.27:0/869700895 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f31a010a640 0x7f31a010aa20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31900099b0 tx=0x7f319002f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:38.876 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.870+0000 7f31a85fc640 1 -- 10.20.193.27:0/869700895 shutdown_connections 2026-02-19T08:24:38.876 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.870+0000 7f31a85fc640 1 --2- 10.20.193.27:0/869700895 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f31a010a640 0x7f31a010aa20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:38.876 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.870+0000 7f31a85fc640 1 -- 10.20.193.27:0/869700895 >> 10.20.193.27:0/869700895 conn(0x7f31a01006d0 msgr2=0x7f31a0102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:38.876 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.870+0000 7f31a85fc640 1 -- 10.20.193.27:0/869700895 shutdown_connections 2026-02-19T08:24:38.876 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.870+0000 7f31a85fc640 1 -- 10.20.193.27:0/869700895 wait complete. 2026-02-19T08:24:38.876 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.870+0000 7f31a85fc640 1 Processor -- start 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a85fc640 1 -- start start 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a85fc640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f31a010a640 0x7f31a019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a85fc640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f31a010e050 con 0x7f31a010a640 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a6371640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f31a010a640 0x7f31a019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a6371640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f31a010a640 0x7f31a019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57304/0 (socket says 10.20.193.27:57304) 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a6371640 1 -- 10.20.193.27:0/3153736762 learned_addr learned my addr 10.20.193.27:0/3153736762 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a6371640 1 -- 10.20.193.27:0/3153736762 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a019bb90 con 0x7f31a010a640 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a6371640 1 --2- 10.20.193.27:0/3153736762 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f31a010a640 0x7f31a019b650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3190002410 tx=0x7f3190004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31877fe640 1 -- 10.20.193.27:0/3153736762 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3190038510 con 0x7f31a010a640 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a85fc640 1 -- 10.20.193.27:0/3153736762 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a019be20 con 0x7f31a010a640 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31877fe640 1 -- 10.20.193.27:0/3153736762 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3190046070 con 0x7f31a010a640 2026-02-19T08:24:38.877 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31877fe640 1 -- 10.20.193.27:0/3153736762 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3190041630 con 0x7f31a010a640 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a85fc640 1 -- 10.20.193.27:0/3153736762 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a019ff20 con 0x7f31a010a640 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.871+0000 7f31a85fc640 1 -- 10.20.193.27:0/3153736762 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a0105d80 con 0x7f31a010a640 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.872+0000 7f31877fe640 1 -- 10.20.193.27:0/3153736762 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f31900386b0 con 0x7f31a010a640 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.872+0000 7f31877fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.872+0000 7f31877fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.872+0000 7f31877fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.872+0000 7f31877fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.872+0000 7f31877fe640 1 --2- 10.20.193.27:0/3153736762 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f317c03de80 0x7f317c040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.872+0000 7f31877fe640 1 -- 10.20.193.27:0/3153736762 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3004+0+0 (secure 0 0 0) 0x7f31900779d0 con 0x7f31a010a640 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.872+0000 7f31a5b70640 1 --2- 10.20.193.27:0/3153736762 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f317c03de80 0x7f317c040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:38.878 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.872+0000 7f31a5b70640 1 --2- 10.20.193.27:0/3153736762 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f317c03de80 0x7f317c040340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f31940099c0 tx=0x7f3194006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:38.879 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.874+0000 7f31877fe640 1 -- 10.20.193.27:0/3153736762 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3190007c50 con 0x7f31a010a640 2026-02-19T08:24:38.961 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.958+0000 7f31a85fc640 1 -- 10.20.193.27:0/3153736762 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31a010aaa0 con 0x7f31a010a640 2026-02-19T08:24:38.962 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.958+0000 7f31877fe640 1 -- 10.20.193.27:0/3153736762 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+7386 (secure 0 0 0) 0x7f31900389d0 con 0x7f31a010a640 2026-02-19T08:24:38.963 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:38.963 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":19,"fsid":"3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460","created":"2026-02-19T08:23:28.508633+0000","modified":"2026-02-19T08:24:38.614385+0000","last_up_change":"2026-02-19T08:24:37.610599+0000","last_in_change":"2026-02-19T08:24:21.300893+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-19T08:24:38.298895+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb259e05-73a1-4945-8799-66f67f314d9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6802","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6803","nonce":4167313654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6804","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6805","nonce":4167313654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6808","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6809","nonce":4167313654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6806","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6807","nonce":4167313654}]},"public_addr":"10.20.193.27:6803/4167313654","cluster_addr":"10.20.193.27:6805/4167313654","heartbeat_back_addr":"10.20.193.27:6809/4167313654","heartbeat_front_addr":"10.20.193.27:6807/4167313654","state":["exists","up"]},{"osd":1,"uuid":"f81b4fa6-2886-4ed5-9abc-1d372b4311be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6810","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6811","nonce":2398673182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6812","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6813","nonce":2398673182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6816","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6817","nonce":2398673182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6814","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6815","nonce":2398673182}]},"public_addr":"10.20.193.27:6811/2398673182","cluster_addr":"10.20.193.27:6813/2398673182","heartbeat_back_addr":"10.20.193.27:6817/2398673182","heartbeat_front_addr":"10.20.193.27:6815/2398673182","state":["exists","up"]},{"osd":2,"uuid":"a8cecd57-2426-4e7f-8e64-724764783b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6818","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6819","nonce":1085344185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6820","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6821","nonce":1085344185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6824","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6825","nonce":1085344185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6822","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6823","nonce":1085344185}]},"public_addr":"10.20.193.27:6819/1085344185","cluster_addr":"10.20.193.27:6821/1085344185","heartbeat_back_addr":"10.20.193.27:6825/1085344185","heartbeat_front_addr":"10.20.193.27:6823/1085344185","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T08:24:13.922058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T08:24:25.209524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T08:24:36.109240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.27:0/1830268314":"2026-02-20T08:23:46.264174+0000","10.20.193.27:0/3098658206":"2026-02-20T08:23:46.264174+0000","10.20.193.27:6801/2519751978":"2026-02-20T08:23:46.264174+0000","10.20.193.27:6800/2519751978":"2026-02-20T08:23:46.264174+0000","10.20.193.27:0/3231774743":"2026-02-20T08:23:46.264174+0000","10.20.193.27:6801/688875344":"2026-02-20T08:23:38.096103+0000","10.20.193.27:0/3614775708":"2026-02-20T08:23:38.096103+0000","10.20.193.27:6800/688875344":"2026-02-20T08:23:38.096103+0000","10.20.193.27:0/1431688824":"2026-02-20T08:23:38.096103+0000","10.20.193.27:0/3103857437":"2026-02-20T08:23:38.096103+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-19T08:24:38.964 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 10 mgrc shutdown 2026-02-19T08:24:38.964 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 1 -- 10.20.193.27:0/3153736762 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f317c03de80 msgr2=0x7f317c040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:38.964 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 1 --2- 10.20.193.27:0/3153736762 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f317c03de80 0x7f317c040340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f31940099c0 tx=0x7f3194006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:38.964 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 1 -- 10.20.193.27:0/3153736762 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f31a010a640 msgr2=0x7f31a019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:38.964 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 1 --2- 10.20.193.27:0/3153736762 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f31a010a640 0x7f31a019b650 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3190002410 tx=0x7f3190004290 comp rx=0 tx=0).stop 2026-02-19T08:24:38.964 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 1 -- 10.20.193.27:0/3153736762 shutdown_connections 2026-02-19T08:24:38.964 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 1 --2- 10.20.193.27:0/3153736762 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f317c03de80 0x7f317c040340 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:38.964 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 1 --2- 10.20.193.27:0/3153736762 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f31a010a640 0x7f31a019b650 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:38.965 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 1 -- 10.20.193.27:0/3153736762 >> 10.20.193.27:0/3153736762 conn(0x7f31a01006d0 msgr2=0x7f31a0106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:38.965 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 1 -- 10.20.193.27:0/3153736762 shutdown_connections 2026-02-19T08:24:38.965 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:38.959+0000 7f31a85fc640 1 -- 10.20.193.27:0/3153736762 wait complete. 2026-02-19T08:24:38.997 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-19T08:24:38.298895+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-19T08:24:38.997 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-19T08:24:39.144 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:39.245 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.239+0000 7f42c91aa640 1 -- 10.20.193.27:0/3239235486 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f42c410a650 msgr2=0x7f42c410aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:39.245 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.239+0000 7f42c91aa640 1 --2- 10.20.193.27:0/3239235486 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f42c410a650 0x7f42c410aa30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f42b80099b0 tx=0x7f42b802f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.245 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.239+0000 7f42c91aa640 1 -- 10.20.193.27:0/3239235486 shutdown_connections 2026-02-19T08:24:39.245 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.239+0000 7f42c91aa640 1 --2- 10.20.193.27:0/3239235486 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f42c410a650 0x7f42c410aa30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.245 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.239+0000 7f42c91aa640 1 -- 10.20.193.27:0/3239235486 >> 10.20.193.27:0/3239235486 conn(0x7f42c4100330 msgr2=0x7f42c4102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:39.245 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.240+0000 7f42c91aa640 1 -- 10.20.193.27:0/3239235486 shutdown_connections 2026-02-19T08:24:39.245 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.240+0000 7f42c91aa640 1 -- 10.20.193.27:0/3239235486 wait complete. 2026-02-19T08:24:39.245 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.240+0000 7f42c91aa640 1 Processor -- start 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.240+0000 7f42c91aa640 1 -- start start 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.240+0000 7f42c91aa640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f42c410a650 0x7f42c419b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.240+0000 7f42c91aa640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f42c410e060 con 0x7f42c410a650 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.240+0000 7f42c2d76640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f42c410a650 0x7f42c419b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.240+0000 7f42c2d76640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f42c410a650 0x7f42c419b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57332/0 (socket says 10.20.193.27:57332) 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.240+0000 7f42c2d76640 1 -- 10.20.193.27:0/3812594768 learned_addr learned my addr 10.20.193.27:0/3812594768 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.240+0000 7f42c2d76640 1 -- 10.20.193.27:0/3812594768 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c419bb70 con 0x7f42c410a650 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.241+0000 7f42c2d76640 1 --2- 10.20.193.27:0/3812594768 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f42c410a650 0x7f42c419b630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f42b8004290 tx=0x7f42b80042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.241+0000 7f42a3fff640 1 -- 10.20.193.27:0/3812594768 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42b8038510 con 0x7f42c410a650 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.241+0000 7f42a3fff640 1 -- 10.20.193.27:0/3812594768 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f42b8046070 con 0x7f42c410a650 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.241+0000 7f42c91aa640 1 -- 10.20.193.27:0/3812594768 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c419be00 con 0x7f42c410a650 2026-02-19T08:24:39.246 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.241+0000 7f42a3fff640 1 -- 10.20.193.27:0/3812594768 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42b8041610 con 0x7f42c410a650 2026-02-19T08:24:39.247 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.241+0000 7f42c91aa640 1 -- 10.20.193.27:0/3812594768 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c419ff00 con 0x7f42c410a650 2026-02-19T08:24:39.247 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.241+0000 7f42c91aa640 1 -- 10.20.193.27:0/3812594768 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c4105d90 con 0x7f42c410a650 2026-02-19T08:24:39.248 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.241+0000 7f42a3fff640 1 -- 10.20.193.27:0/3812594768 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f42b80386b0 con 0x7f42c410a650 2026-02-19T08:24:39.248 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.241+0000 7f42a3fff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:39.248 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.242+0000 7f42a3fff640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:39.248 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.242+0000 7f42a3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:39.248 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.242+0000 7f42a3fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:39.248 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.242+0000 7f42a3fff640 1 --2- 10.20.193.27:0/3812594768 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f429803de80 0x7f4298040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:39.248 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.242+0000 7f42a3fff640 1 -- 10.20.193.27:0/3812594768 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3004+0+0 (secure 0 0 0) 0x7f42b8077a30 con 0x7f42c410a650 2026-02-19T08:24:39.248 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.242+0000 7f42c2575640 1 --2- 10.20.193.27:0/3812594768 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f429803de80 0x7f4298040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:39.248 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.242+0000 7f42c2575640 1 --2- 10.20.193.27:0/3812594768 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f429803de80 0x7f4298040340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0099c0 tx=0x7f42ac006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:39.249 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.244+0000 7f42a3fff640 1 -- 10.20.193.27:0/3812594768 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f42b8040360 con 0x7f42c410a650 2026-02-19T08:24:39.330 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.327+0000 7f42c91aa640 1 -- 10.20.193.27:0/3812594768 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f42c410aab0 con 0x7f42c410a650 2026-02-19T08:24:39.330 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.327+0000 7f42a3fff640 1 -- 10.20.193.27:0/3812594768 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f42b8049360 con 0x7f42c410a650 2026-02-19T08:24:39.331 INFO:teuthology.orchestra.run.trial027.stdout:pg_num: 1 2026-02-19T08:24:39.332 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.327+0000 7f42c91aa640 10 mgrc shutdown 2026-02-19T08:24:39.332 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.328+0000 7f42c91aa640 1 -- 10.20.193.27:0/3812594768 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f429803de80 msgr2=0x7f4298040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:39.332 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.328+0000 7f42c91aa640 1 --2- 10.20.193.27:0/3812594768 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f429803de80 0x7f4298040340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0099c0 tx=0x7f42ac006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.332 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.328+0000 7f42c91aa640 1 -- 10.20.193.27:0/3812594768 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f42c410a650 msgr2=0x7f42c419b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:39.332 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.328+0000 7f42c91aa640 1 --2- 10.20.193.27:0/3812594768 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f42c410a650 0x7f42c419b630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f42b8004290 tx=0x7f42b80042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.332 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.328+0000 7f42c91aa640 1 -- 10.20.193.27:0/3812594768 shutdown_connections 2026-02-19T08:24:39.332 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.328+0000 7f42c91aa640 1 --2- 10.20.193.27:0/3812594768 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f429803de80 0x7f4298040340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.332 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.328+0000 7f42c91aa640 1 --2- 10.20.193.27:0/3812594768 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f42c410a650 0x7f42c419b630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.333 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.328+0000 7f42c91aa640 1 -- 10.20.193.27:0/3812594768 >> 10.20.193.27:0/3812594768 conn(0x7f42c4100330 msgr2=0x7f42c4108830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:39.333 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.328+0000 7f42c91aa640 1 -- 10.20.193.27:0/3812594768 shutdown_connections 2026-02-19T08:24:39.333 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.328+0000 7f42c91aa640 1 -- 10.20.193.27:0/3812594768 wait complete. 2026-02-19T08:24:39.366 INFO:tasks.cephadm:Setting up client nodes... 2026-02-19T08:24:39.367 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-19T08:24:39.515 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:39.620 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.615+0000 7f2c55f72640 1 -- 10.20.193.27:0/2871963291 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f2c501046a0 msgr2=0x7f2c50104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:39.620 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.615+0000 7f2c55f72640 1 --2- 10.20.193.27:0/2871963291 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f2c501046a0 0x7f2c50104aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0099b0 tx=0x7f2c3c02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.615+0000 7f2c55f72640 1 -- 10.20.193.27:0/2871963291 shutdown_connections 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.615+0000 7f2c55f72640 1 --2- 10.20.193.27:0/2871963291 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f2c501046a0 0x7f2c50104aa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.615+0000 7f2c55f72640 1 -- 10.20.193.27:0/2871963291 >> 10.20.193.27:0/2871963291 conn(0x7f2c500ffe30 msgr2=0x7f2c50102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.615+0000 7f2c55f72640 1 -- 10.20.193.27:0/2871963291 shutdown_connections 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.615+0000 7f2c55f72640 1 -- 10.20.193.27:0/2871963291 wait complete. 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.615+0000 7f2c55f72640 1 Processor -- start 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.616+0000 7f2c55f72640 1 -- start start 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.616+0000 7f2c55f72640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f2c501046a0 0x7f2c5019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.616+0000 7f2c55f72640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50109b20 con 0x7f2c501046a0 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.616+0000 7f2c4f7fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f2c501046a0 0x7f2c5019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:39.621 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.616+0000 7f2c4f7fe640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f2c501046a0 0x7f2c5019b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57348/0 (socket says 10.20.193.27:57348) 2026-02-19T08:24:39.622 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.616+0000 7f2c4f7fe640 1 -- 10.20.193.27:0/1061464970 learned_addr learned my addr 10.20.193.27:0/1061464970 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:39.622 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.616+0000 7f2c4f7fe640 1 -- 10.20.193.27:0/1061464970 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5019b820 con 0x7f2c501046a0 2026-02-19T08:24:39.622 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.616+0000 7f2c4f7fe640 1 --2- 10.20.193.27:0/1061464970 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f2c501046a0 0x7f2c5019b2e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c002410 tx=0x7f2c3c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:39.622 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.616+0000 7f2c4cff9640 1 -- 10.20.193.27:0/1061464970 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c3c002e00 con 0x7f2c501046a0 2026-02-19T08:24:39.622 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.617+0000 7f2c4cff9640 1 -- 10.20.193.27:0/1061464970 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f2c3c046070 con 0x7f2c501046a0 2026-02-19T08:24:39.622 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.617+0000 7f2c4cff9640 1 -- 10.20.193.27:0/1061464970 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c3c0416d0 con 0x7f2c501046a0 2026-02-19T08:24:39.622 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.617+0000 7f2c55f72640 1 -- 10.20.193.27:0/1061464970 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5019bab0 con 0x7f2c501046a0 2026-02-19T08:24:39.622 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.617+0000 7f2c55f72640 1 -- 10.20.193.27:0/1061464970 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5019e7a0 con 0x7f2c501046a0 2026-02-19T08:24:39.623 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.617+0000 7f2c55f72640 1 -- 10.20.193.27:0/1061464970 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5010a2c0 con 0x7f2c501046a0 2026-02-19T08:24:39.623 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.619+0000 7f2c4cff9640 1 -- 10.20.193.27:0/1061464970 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f2c3c038510 con 0x7f2c501046a0 2026-02-19T08:24:39.624 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.619+0000 7f2c4cff9640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:39.624 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.619+0000 7f2c4cff9640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:39.624 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.619+0000 7f2c4cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:39.624 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.619+0000 7f2c4cff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:39.624 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.619+0000 7f2c4cff9640 1 --2- 10.20.193.27:0/1061464970 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f2c2403de80 0x7f2c24040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:39.624 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.619+0000 7f2c4cff9640 1 -- 10.20.193.27:0/1061464970 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7f2c3c078150 con 0x7f2c501046a0 2026-02-19T08:24:39.624 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.619+0000 7f2c4effd640 1 --2- 10.20.193.27:0/1061464970 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f2c2403de80 0x7f2c24040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:39.624 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.619+0000 7f2c4effd640 1 --2- 10.20.193.27:0/1061464970 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f2c2403de80 0x7f2c24040340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2c400099c0 tx=0x7f2c40006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:39.625 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.621+0000 7f2c4cff9640 1 -- 10.20.193.27:0/1061464970 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2c3c038830 con 0x7f2c501046a0 2026-02-19T08:24:39.738 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.734+0000 7f2c55f72640 1 -- 10.20.193.27:0/1061464970 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f2c50194880 con 0x7f2c501046a0 2026-02-19T08:24:39.738 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:39 trial027 ceph-mon[21739]: pgmap v34: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T08:24:39.738 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:39 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-19T08:24:39.739 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:39 trial027 ceph-mon[21739]: osdmap e19: 3 total, 3 up, 3 in 2026-02-19T08:24:39.739 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:39 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-19T08:24:39.739 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:39 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/3153736762' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-19T08:24:39.739 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:39 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/3812594768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-19T08:24:39.739 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.735+0000 7f2c4cff9640 1 -- 10.20.193.27:0/1061464970 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v7) ==== 170+0+59 (secure 0 0 0) 0x7f2c3c038c80 con 0x7f2c501046a0 2026-02-19T08:24:39.740 INFO:teuthology.orchestra.run.trial027.stdout:[client.0] 2026-02-19T08:24:39.740 INFO:teuthology.orchestra.run.trial027.stdout: key = AQDHyJZp5zfgKxAAjfORraIIBgjZZlQPZPXAow== 2026-02-19T08:24:39.741 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 10 mgrc shutdown 2026-02-19T08:24:39.741 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 1 -- 10.20.193.27:0/1061464970 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f2c2403de80 msgr2=0x7f2c24040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:39.741 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 1 --2- 10.20.193.27:0/1061464970 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f2c2403de80 0x7f2c24040340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2c400099c0 tx=0x7f2c40006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.741 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 1 -- 10.20.193.27:0/1061464970 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f2c501046a0 msgr2=0x7f2c5019b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:39.741 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 1 --2- 10.20.193.27:0/1061464970 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f2c501046a0 0x7f2c5019b2e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c002410 tx=0x7f2c3c004290 comp rx=0 tx=0).stop 2026-02-19T08:24:39.741 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 1 -- 10.20.193.27:0/1061464970 shutdown_connections 2026-02-19T08:24:39.741 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 1 --2- 10.20.193.27:0/1061464970 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f2c2403de80 0x7f2c24040340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.741 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 1 --2- 10.20.193.27:0/1061464970 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f2c501046a0 0x7f2c5019b2e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:39.741 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 1 -- 10.20.193.27:0/1061464970 >> 10.20.193.27:0/1061464970 conn(0x7f2c500ffe30 msgr2=0x7f2c501004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:39.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 1 -- 10.20.193.27:0/1061464970 shutdown_connections 2026-02-19T08:24:39.742 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:39.736+0000 7f2c55f72640 1 -- 10.20.193.27:0/1061464970 wait complete. 2026-02-19T08:24:39.775 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:24:39.776 DEBUG:teuthology.orchestra.run.trial027:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-19T08:24:39.776 DEBUG:teuthology.orchestra.run.trial027:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-19T08:24:39.811 DEBUG:teuthology.orchestra.run.trial116:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-19T08:24:39.957 INFO:teuthology.orchestra.run.trial116.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/config/ceph.conf 2026-02-19T08:24:40.078 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.074+0000 7fed3421f640 1 -- 10.20.193.116:0/2098012100 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fed2c1045b0 msgr2=0x7fed2c1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:40.079 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.074+0000 7fed3421f640 1 --2- 10.20.193.116:0/2098012100 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fed2c1045b0 0x7fed2c1049b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0099b0 tx=0x7fed1c02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.079 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.074+0000 7fed3421f640 1 -- 10.20.193.116:0/2098012100 shutdown_connections 2026-02-19T08:24:40.079 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.074+0000 7fed3421f640 1 --2- 10.20.193.116:0/2098012100 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fed2c1045b0 0x7fed2c1049b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.079 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.074+0000 7fed3421f640 1 -- 10.20.193.116:0/2098012100 >> 10.20.193.116:0/2098012100 conn(0x7fed2c0ffd70 msgr2=0x7fed2c102180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:40.079 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.074+0000 7fed3421f640 1 -- 10.20.193.116:0/2098012100 shutdown_connections 2026-02-19T08:24:40.079 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.074+0000 7fed3421f640 1 -- 10.20.193.116:0/2098012100 wait complete. 2026-02-19T08:24:40.079 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.075+0000 7fed3421f640 1 Processor -- start 2026-02-19T08:24:40.079 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.075+0000 7fed3421f640 1 -- start start 2026-02-19T08:24:40.079 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.075+0000 7fed3421f640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fed2c1045b0 0x7fed2c19b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:40.079 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.075+0000 7fed3421f640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c109a30 con 0x7fed2c1045b0 2026-02-19T08:24:40.080 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.075+0000 7fed31f94640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fed2c1045b0 0x7fed2c19b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:40.080 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.075+0000 7fed31f94640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fed2c1045b0 0x7fed2c19b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.116:37132/0 (socket says 10.20.193.116:37132) 2026-02-19T08:24:40.080 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.075+0000 7fed31f94640 1 -- 10.20.193.116:0/3378271289 learned_addr learned my addr 10.20.193.116:0/3378271289 (peer_addr_for_me v2:10.20.193.116:0/0) 2026-02-19T08:24:40.082 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.076+0000 7fed31f94640 1 -- 10.20.193.116:0/3378271289 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c19b6d0 con 0x7fed2c1045b0 2026-02-19T08:24:40.082 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.076+0000 7fed31f94640 1 --2- 10.20.193.116:0/3378271289 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fed2c1045b0 0x7fed2c19b190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fed1c002410 tx=0x7fed1c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:40.082 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.076+0000 7fed1affd640 1 -- 10.20.193.116:0/3378271289 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c038510 con 0x7fed2c1045b0 2026-02-19T08:24:40.082 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.076+0000 7fed1affd640 1 -- 10.20.193.116:0/3378271289 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fed1c046070 con 0x7fed2c1045b0 2026-02-19T08:24:40.082 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.076+0000 7fed1affd640 1 -- 10.20.193.116:0/3378271289 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c041730 con 0x7fed2c1045b0 2026-02-19T08:24:40.082 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.076+0000 7fed3421f640 1 -- 10.20.193.116:0/3378271289 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2c19b960 con 0x7fed2c1045b0 2026-02-19T08:24:40.082 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.076+0000 7fed3421f640 1 -- 10.20.193.116:0/3378271289 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2c19e650 con 0x7fed2c1045b0 2026-02-19T08:24:40.082 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.076+0000 7fed3421f640 1 -- 10.20.193.116:0/3378271289 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2c10a1d0 con 0x7fed2c1045b0 2026-02-19T08:24:40.082 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.077+0000 7fed1affd640 1 -- 10.20.193.116:0/3378271289 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fed1c0386b0 con 0x7fed2c1045b0 2026-02-19T08:24:40.082 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.077+0000 7fed1affd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:40.083 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.077+0000 7fed1affd640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:40.083 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.077+0000 7fed1affd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:40.083 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.077+0000 7fed1affd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:40.083 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.077+0000 7fed1affd640 1 --2- 10.20.193.116:0/3378271289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fed0803de80 0x7fed08040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:40.083 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.077+0000 7fed1affd640 1 -- 10.20.193.116:0/3378271289 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7fed1c077c10 con 0x7fed2c1045b0 2026-02-19T08:24:40.083 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.077+0000 7fed31793640 1 --2- 10.20.193.116:0/3378271289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fed0803de80 0x7fed08040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:40.083 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.078+0000 7fed31793640 1 --2- 10.20.193.116:0/3378271289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fed0803de80 0x7fed08040340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fed200099c0 tx=0x7fed20006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:40.083 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.079+0000 7fed1affd640 1 -- 10.20.193.116:0/3378271289 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fed1c035320 con 0x7fed2c1045b0 2026-02-19T08:24:40.196 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.193+0000 7fed3421f640 1 -- 10.20.193.116:0/3378271289 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fed2c194790 con 0x7fed2c1045b0 2026-02-19T08:24:40.197 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.194+0000 7fed1affd640 1 -- 10.20.193.116:0/3378271289 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v8) ==== 170+0+59 (secure 0 0 0) 0x7fed1c036370 con 0x7fed2c1045b0 2026-02-19T08:24:40.197 INFO:teuthology.orchestra.run.trial116.stdout:[client.1] 2026-02-19T08:24:40.198 INFO:teuthology.orchestra.run.trial116.stdout: key = AQDIyJZplfWXCxAAcL7lo6qkhVvVonfW2ALi0A== 2026-02-19T08:24:40.199 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 10 mgrc shutdown 2026-02-19T08:24:40.199 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 1 -- 10.20.193.116:0/3378271289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fed0803de80 msgr2=0x7fed08040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:40.199 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 1 --2- 10.20.193.116:0/3378271289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fed0803de80 0x7fed08040340 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fed200099c0 tx=0x7fed20006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.199 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 1 -- 10.20.193.116:0/3378271289 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fed2c1045b0 msgr2=0x7fed2c19b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:40.199 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 1 --2- 10.20.193.116:0/3378271289 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fed2c1045b0 0x7fed2c19b190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fed1c002410 tx=0x7fed1c004290 comp rx=0 tx=0).stop 2026-02-19T08:24:40.199 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 1 -- 10.20.193.116:0/3378271289 shutdown_connections 2026-02-19T08:24:40.199 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 1 --2- 10.20.193.116:0/3378271289 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fed0803de80 0x7fed08040340 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.199 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 1 --2- 10.20.193.116:0/3378271289 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fed2c1045b0 0x7fed2c19b190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.199 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 1 -- 10.20.193.116:0/3378271289 >> 10.20.193.116:0/3378271289 conn(0x7fed2c0ffd70 msgr2=0x7fed2c1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:40.200 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 1 -- 10.20.193.116:0/3378271289 shutdown_connections 2026-02-19T08:24:40.200 INFO:teuthology.orchestra.run.trial116.stderr:2026-02-19T08:24:40.195+0000 7fed3421f640 1 -- 10.20.193.116:0/3378271289 wait complete. 2026-02-19T08:24:40.250 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:24:40.250 DEBUG:teuthology.orchestra.run.trial116:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-19T08:24:40.251 DEBUG:teuthology.orchestra.run.trial116:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-19T08:24:40.335 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-19T08:24:40.335 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-19T08:24:40.335 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-19T08:24:40.348 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50248]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-19T08:24:40.348 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50248]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T08:24:40.348 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T08:24:40.348 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50248]: pam_unix(sudo:session): session closed for user root 2026-02-19T08:24:40.348 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50252]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-19T08:24:40.348 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50252]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T08:24:40.348 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T08:24:40.348 INFO:journalctl@ceph.osd.0.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50252]: pam_unix(sudo:session): session closed for user root 2026-02-19T08:24:40.349 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50256]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-19T08:24:40.349 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50256]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T08:24:40.349 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T08:24:40.349 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50256]: pam_unix(sudo:session): session closed for user root 2026-02-19T08:24:40.349 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50260]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-19T08:24:40.349 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50260]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T08:24:40.349 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T08:24:40.349 INFO:journalctl@ceph.osd.1.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50260]: pam_unix(sudo:session): session closed for user root 2026-02-19T08:24:40.350 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50272]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-19T08:24:40.350 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50272]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T08:24:40.350 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T08:24:40.350 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50272]: pam_unix(sudo:session): session closed for user root 2026-02-19T08:24:40.350 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50276]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-19T08:24:40.350 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50276]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T08:24:40.350 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T08:24:40.350 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50276]: pam_unix(sudo:session): session closed for user root 2026-02-19T08:24:40.351 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50264]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-19T08:24:40.351 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50264]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T08:24:40.351 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T08:24:40.351 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50264]: pam_unix(sudo:session): session closed for user root 2026-02-19T08:24:40.351 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50268]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-19T08:24:40.351 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50268]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T08:24:40.351 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T08:24:40.351 INFO:journalctl@ceph.osd.2.trial027.stdout:Feb 19 08:24:40 trial027 sudo[50268]: pam_unix(sudo:session): session closed for user root 2026-02-19T08:24:40.484 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:40.586 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/2258997224 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5fbc077620 msgr2=0x7f5fbc077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:40.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 --2- 10.20.193.27:0/2258997224 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5fbc077620 0x7f5fbc077a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0099b0 tx=0x7f5fac02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/2258997224 shutdown_connections 2026-02-19T08:24:40.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 --2- 10.20.193.27:0/2258997224 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5fbc077620 0x7f5fbc077a00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/2258997224 >> 10.20.193.27:0/2258997224 conn(0x7f5fbc1006d0 msgr2=0x7f5fbc102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:40.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/2258997224 shutdown_connections 2026-02-19T08:24:40.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/2258997224 wait complete. 2026-02-19T08:24:40.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 Processor -- start 2026-02-19T08:24:40.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 -- start start 2026-02-19T08:24:40.587 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5fbc077620 0x7f5fbc1a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc3a6c640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f5fbc1125b0 con 0x7f5fbc077620 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc17e1640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5fbc077620 0x7f5fbc1a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc17e1640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5fbc077620 0x7f5fbc1a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57384/0 (socket says 10.20.193.27:57384) 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc17e1640 1 -- 10.20.193.27:0/4223127756 learned_addr learned my addr 10.20.193.27:0/4223127756 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc17e1640 1 -- 10.20.193.27:0/4223127756 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc1a5d50 con 0x7f5fbc077620 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.581+0000 7f5fc17e1640 1 --2- 10.20.193.27:0/4223127756 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5fbc077620 0x7f5fbc1a5810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5fac004290 tx=0x7f5fac0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5faa7fc640 1 -- 10.20.193.27:0/4223127756 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fac038510 con 0x7f5fbc077620 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5faa7fc640 1 -- 10.20.193.27:0/4223127756 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f5fac046070 con 0x7f5fbc077620 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5faa7fc640 1 -- 10.20.193.27:0/4223127756 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fac041610 con 0x7f5fbc077620 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/4223127756 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fbc1a5fe0 con 0x7f5fbc077620 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/4223127756 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fbc19f9d0 con 0x7f5fbc077620 2026-02-19T08:24:40.588 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/4223127756 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fbc078d60 con 0x7f5fbc077620 2026-02-19T08:24:40.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5faa7fc640 1 -- 10.20.193.27:0/4223127756 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f5fac041910 con 0x7f5fbc077620 2026-02-19T08:24:40.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5faa7fc640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:40.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5faa7fc640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:40.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5faa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:40.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5faa7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:40.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.582+0000 7f5faa7fc640 1 --2- 10.20.193.27:0/4223127756 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f5f9803de30 0x7f5f980402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:40.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.583+0000 7f5faa7fc640 1 -- 10.20.193.27:0/4223127756 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7f5fac0781a0 con 0x7f5fbc077620 2026-02-19T08:24:40.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.583+0000 7f5fc0fe0640 1 --2- 10.20.193.27:0/4223127756 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f5f9803de30 0x7f5f980402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:40.589 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.583+0000 7f5fc0fe0640 1 --2- 10.20.193.27:0/4223127756 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f5f9803de30 0x7f5f980402f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00099c0 tx=0x7f5fb0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:40.590 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.585+0000 7f5faa7fc640 1 -- 10.20.193.27:0/4223127756 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5fac041c30 con 0x7f5fbc077620 2026-02-19T08:24:40.694 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.690+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/4223127756 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5fbc077ab0 con 0x7f5fbc077620 2026-02-19T08:24:40.694 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.691+0000 7f5faa7fc640 1 -- 10.20.193.27:0/4223127756 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v13) ==== 74+0+96876 (secure 0 0 0) 0x7f5fbc077ab0 con 0x7f5fbc077620 2026-02-19T08:24:40.697 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:40.698 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 10 mgrc shutdown 2026-02-19T08:24:40.699 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/4223127756 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f5f9803de30 msgr2=0x7f5f980402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:40.699 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 1 --2- 10.20.193.27:0/4223127756 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f5f9803de30 0x7f5f980402f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00099c0 tx=0x7f5fb0006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.699 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/4223127756 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5fbc077620 msgr2=0x7f5fbc1a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:40.699 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 1 --2- 10.20.193.27:0/4223127756 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5fbc077620 0x7f5fbc1a5810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5fac004290 tx=0x7f5fac0042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.699 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/4223127756 shutdown_connections 2026-02-19T08:24:40.699 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 1 --2- 10.20.193.27:0/4223127756 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f5f9803de30 0x7f5f980402f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.699 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 1 --2- 10.20.193.27:0/4223127756 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f5fbc077620 0x7f5fbc1a5810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:40.699 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/4223127756 >> 10.20.193.27:0/4223127756 conn(0x7f5fbc1006d0 msgr2=0x7f5fbc1034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:40.699 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/4223127756 shutdown_connections 2026-02-19T08:24:40.699 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:40.692+0000 7f5fc3a6c640 1 -- 10.20.193.27:0/4223127756 wait complete. 2026-02-19T08:24:40.731 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":13,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6800","nonce":111887651},{"type":"v1","addr":"10.20.193.27:6801","nonce":111887651}]},"active_addr":"10.20.193.27:6801/111887651","active_change":"2026-02-19T08:23:46.264262+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.27:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.27:0","nonce":112718568}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.27:0","nonce":2334052956}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.27:0","nonce":1938838867}]}]} 2026-02-19T08:24:40.735 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-19T08:24:40.736 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-19T08:24:40.736 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd dump --format=json 2026-02-19T08:24:40.922 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:40.946 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-19T08:24:40.946 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: osdmap e20: 3 total, 3 up, 3 in 2026-02-19T08:24:40.946 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1061464970' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-19T08:24:40.946 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1061464970' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-19T08:24:40.946 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:40.947 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: from='client.? 10.20.193.116:0/3378271289' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-19T08:24:40.947 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: from='client.? 10.20.193.116:0/3378271289' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-19T08:24:40.947 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' 2026-02-19T08:24:40.947 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-19T08:24:40.947 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-19T08:24:40.947 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:40 trial027 ceph-mon[21739]: from='mgr.14150 10.20.193.27:0/1723578051' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-19T08:24:41.027 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.021+0000 7f4fb82bd640 1 -- 10.20.193.27:0/1015112063 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4fb010a650 msgr2=0x7f4fb010aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.027 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.021+0000 7f4fb82bd640 1 --2- 10.20.193.27:0/1015112063 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4fb010a650 0x7f4fb010aa30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00099b0 tx=0x7f4fa002f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.027 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.021+0000 7f4fb82bd640 1 -- 10.20.193.27:0/1015112063 shutdown_connections 2026-02-19T08:24:41.027 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.021+0000 7f4fb82bd640 1 --2- 10.20.193.27:0/1015112063 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4fb010a650 0x7f4fb010aa30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.027 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.021+0000 7f4fb82bd640 1 -- 10.20.193.27:0/1015112063 >> 10.20.193.27:0/1015112063 conn(0x7f4fb0100330 msgr2=0x7f4fb0102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:41.027 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.021+0000 7f4fb82bd640 1 -- 10.20.193.27:0/1015112063 shutdown_connections 2026-02-19T08:24:41.027 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.021+0000 7f4fb82bd640 1 -- 10.20.193.27:0/1015112063 wait complete. 2026-02-19T08:24:41.027 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.021+0000 7f4fb82bd640 1 Processor -- start 2026-02-19T08:24:41.027 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.021+0000 7f4fb82bd640 1 -- start start 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4fb82bd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4fb010a650 0x7f4fb019b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4fb82bd640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb010e060 con 0x7f4fb010a650 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4fb6032640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4fb010a650 0x7f4fb019b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4fb6032640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4fb010a650 0x7f4fb019b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57414/0 (socket says 10.20.193.27:57414) 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4fb6032640 1 -- 10.20.193.27:0/4066363236 learned_addr learned my addr 10.20.193.27:0/4066363236 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4fb6032640 1 -- 10.20.193.27:0/4066363236 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb019bb70 con 0x7f4fb010a650 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4fb6032640 1 --2- 10.20.193.27:0/4066363236 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4fb010a650 0x7f4fb019b630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0004290 tx=0x7f4fa00042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4f977fe640 1 -- 10.20.193.27:0/4066363236 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa0038510 con 0x7f4fb010a650 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4f977fe640 1 -- 10.20.193.27:0/4066363236 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f4fa0046070 con 0x7f4fb010a650 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4fb82bd640 1 -- 10.20.193.27:0/4066363236 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb019be00 con 0x7f4fb010a650 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4f977fe640 1 -- 10.20.193.27:0/4066363236 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa0041610 con 0x7f4fb010a650 2026-02-19T08:24:41.028 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4fb82bd640 1 -- 10.20.193.27:0/4066363236 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb019ff00 con 0x7f4fb010a650 2026-02-19T08:24:41.029 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.022+0000 7f4fb82bd640 1 -- 10.20.193.27:0/4066363236 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb0105d90 con 0x7f4fb010a650 2026-02-19T08:24:41.029 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.023+0000 7f4f977fe640 1 -- 10.20.193.27:0/4066363236 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f4fa00386b0 con 0x7f4fb010a650 2026-02-19T08:24:41.029 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.023+0000 7f4f977fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-19T08:24:41.029 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.023+0000 7f4f977fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-19T08:24:41.029 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.023+0000 7f4f977fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:41.029 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.023+0000 7f4f977fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:41.029 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.023+0000 7f4f977fe640 1 --2- 10.20.193.27:0/4066363236 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4f8c03de80 0x7f4f8c040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.029 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.023+0000 7f4f977fe640 1 -- 10.20.193.27:0/4066363236 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f4fa0077980 con 0x7f4fb010a650 2026-02-19T08:24:41.029 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.023+0000 7f4fb5831640 1 --2- 10.20.193.27:0/4066363236 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4f8c03de80 0x7f4f8c040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.029 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.023+0000 7f4fb5831640 1 --2- 10.20.193.27:0/4066363236 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4f8c03de80 0x7f4f8c040340 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40099c0 tx=0x7f4fa4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.030 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.025+0000 7f4f977fe640 1 -- 10.20.193.27:0/4066363236 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4fa0040360 con 0x7f4fb010a650 2026-02-19T08:24:41.114 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.111+0000 7f4fb82bd640 1 -- 10.20.193.27:0/4066363236 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4fb010aab0 con 0x7f4fb010a650 2026-02-19T08:24:41.115 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.111+0000 7f4f977fe640 1 -- 10.20.193.27:0/4066363236 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+7382 (secure 0 0 0) 0x7f4fa0049360 con 0x7f4fb010a650 2026-02-19T08:24:41.115 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:41.115 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":21,"fsid":"3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460","created":"2026-02-19T08:23:28.508633+0000","modified":"2026-02-19T08:24:40.736603+0000","last_up_change":"2026-02-19T08:24:37.610599+0000","last_in_change":"2026-02-19T08:24:21.300893+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-19T08:24:38.298895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb259e05-73a1-4945-8799-66f67f314d9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6802","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6803","nonce":4167313654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6804","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6805","nonce":4167313654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6808","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6809","nonce":4167313654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6806","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6807","nonce":4167313654}]},"public_addr":"10.20.193.27:6803/4167313654","cluster_addr":"10.20.193.27:6805/4167313654","heartbeat_back_addr":"10.20.193.27:6809/4167313654","heartbeat_front_addr":"10.20.193.27:6807/4167313654","state":["exists","up"]},{"osd":1,"uuid":"f81b4fa6-2886-4ed5-9abc-1d372b4311be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6810","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6811","nonce":2398673182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6812","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6813","nonce":2398673182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6816","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6817","nonce":2398673182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6814","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6815","nonce":2398673182}]},"public_addr":"10.20.193.27:6811/2398673182","cluster_addr":"10.20.193.27:6813/2398673182","heartbeat_back_addr":"10.20.193.27:6817/2398673182","heartbeat_front_addr":"10.20.193.27:6815/2398673182","state":["exists","up"]},{"osd":2,"uuid":"a8cecd57-2426-4e7f-8e64-724764783b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6818","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6819","nonce":1085344185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6820","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6821","nonce":1085344185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6824","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6825","nonce":1085344185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6822","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6823","nonce":1085344185}]},"public_addr":"10.20.193.27:6819/1085344185","cluster_addr":"10.20.193.27:6821/1085344185","heartbeat_back_addr":"10.20.193.27:6825/1085344185","heartbeat_front_addr":"10.20.193.27:6823/1085344185","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T08:24:13.922058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T08:24:25.209524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T08:24:36.109240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.27:0/1830268314":"2026-02-20T08:23:46.264174+0000","10.20.193.27:0/3098658206":"2026-02-20T08:23:46.264174+0000","10.20.193.27:6801/2519751978":"2026-02-20T08:23:46.264174+0000","10.20.193.27:6800/2519751978":"2026-02-20T08:23:46.264174+0000","10.20.193.27:0/3231774743":"2026-02-20T08:23:46.264174+0000","10.20.193.27:6801/688875344":"2026-02-20T08:23:38.096103+0000","10.20.193.27:0/3614775708":"2026-02-20T08:23:38.096103+0000","10.20.193.27:6800/688875344":"2026-02-20T08:23:38.096103+0000","10.20.193.27:0/1431688824":"2026-02-20T08:23:38.096103+0000","10.20.193.27:0/3103857437":"2026-02-20T08:23:38.096103+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-19T08:24:41.116 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 10 mgrc shutdown 2026-02-19T08:24:41.116 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 1 -- 10.20.193.27:0/4066363236 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4f8c03de80 msgr2=0x7f4f8c040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.116 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 1 --2- 10.20.193.27:0/4066363236 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4f8c03de80 0x7f4f8c040340 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40099c0 tx=0x7f4fa4006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 1 -- 10.20.193.27:0/4066363236 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4fb010a650 msgr2=0x7f4fb019b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 1 --2- 10.20.193.27:0/4066363236 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4fb010a650 0x7f4fb019b630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0004290 tx=0x7f4fa00042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 1 -- 10.20.193.27:0/4066363236 shutdown_connections 2026-02-19T08:24:41.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 1 --2- 10.20.193.27:0/4066363236 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4f8c03de80 0x7f4f8c040340 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 1 --2- 10.20.193.27:0/4066363236 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4fb010a650 0x7f4fb019b630 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 1 -- 10.20.193.27:0/4066363236 >> 10.20.193.27:0/4066363236 conn(0x7f4fb0100330 msgr2=0x7f4fb0108830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:41.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 1 -- 10.20.193.27:0/4066363236 shutdown_connections 2026-02-19T08:24:41.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.112+0000 7f4fb82bd640 1 -- 10.20.193.27:0/4066363236 wait complete. 2026-02-19T08:24:41.153 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-19T08:24:41.153 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd dump --format=json 2026-02-19T08:24:41.303 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:41.415 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.409+0000 7f4b4e964640 1 -- 10.20.193.27:0/1224136549 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4b48077620 msgr2=0x7f4b48077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.415 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.409+0000 7f4b4e964640 1 --2- 10.20.193.27:0/1224136549 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4b48077620 0x7f4b48077a00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b340099b0 tx=0x7f4b3402f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.415 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 -- 10.20.193.27:0/1224136549 shutdown_connections 2026-02-19T08:24:41.415 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 --2- 10.20.193.27:0/1224136549 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4b48077620 0x7f4b48077a00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 -- 10.20.193.27:0/1224136549 >> 10.20.193.27:0/1224136549 conn(0x7f4b481006d0 msgr2=0x7f4b48102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 -- 10.20.193.27:0/1224136549 shutdown_connections 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 -- 10.20.193.27:0/1224136549 wait complete. 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 Processor -- start 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 -- start start 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4b48077620 0x7f4b481a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f4b481125b0 con 0x7f4b48077620 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b47fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4b48077620 0x7f4b481a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b47fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4b48077620 0x7f4b481a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57432/0 (socket says 10.20.193.27:57432) 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b47fff640 1 -- 10.20.193.27:0/1918195285 learned_addr learned my addr 10.20.193.27:0/1918195285 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:41.416 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b47fff640 1 -- 10.20.193.27:0/1918195285 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b481a5d50 con 0x7f4b48077620 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b47fff640 1 --2- 10.20.193.27:0/1918195285 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4b48077620 0x7f4b481a5810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b34002410 tx=0x7f4b34004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b457fa640 1 -- 10.20.193.27:0/1918195285 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b34038510 con 0x7f4b48077620 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 -- 10.20.193.27:0/1918195285 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b481a5fe0 con 0x7f4b48077620 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b457fa640 1 -- 10.20.193.27:0/1918195285 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f4b34046070 con 0x7f4b48077620 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b457fa640 1 -- 10.20.193.27:0/1918195285 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b34041630 con 0x7f4b48077620 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.410+0000 7f4b4e964640 1 -- 10.20.193.27:0/1918195285 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b4819f9d0 con 0x7f4b48077620 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.411+0000 7f4b4e964640 1 -- 10.20.193.27:0/1918195285 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b48078d60 con 0x7f4b48077620 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.411+0000 7f4b457fa640 1 -- 10.20.193.27:0/1918195285 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f4b340386b0 con 0x7f4b48077620 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.411+0000 7f4b457fa640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.411+0000 7f4b457fa640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.411+0000 7f4b457fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.411+0000 7f4b457fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:41.417 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.411+0000 7f4b457fa640 1 --2- 10.20.193.27:0/1918195285 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4b1c03df10 0x7f4b1c0403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.418 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.411+0000 7f4b457fa640 1 -- 10.20.193.27:0/1918195285 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f4b34077b30 con 0x7f4b48077620 2026-02-19T08:24:41.418 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.411+0000 7f4b477fe640 1 --2- 10.20.193.27:0/1918195285 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4b1c03df10 0x7f4b1c0403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.418 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.412+0000 7f4b477fe640 1 --2- 10.20.193.27:0/1918195285 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4b1c03df10 0x7f4b1c0403d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b380099c0 tx=0x7f4b38006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.418 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.414+0000 7f4b457fa640 1 -- 10.20.193.27:0/1918195285 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4b34007c50 con 0x7f4b48077620 2026-02-19T08:24:41.499 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.496+0000 7f4b4e964640 1 -- 10.20.193.27:0/1918195285 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b48077ab0 con 0x7f4b48077620 2026-02-19T08:24:41.500 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.496+0000 7f4b457fa640 1 -- 10.20.193.27:0/1918195285 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+7382 (secure 0 0 0) 0x7f4b48077ab0 con 0x7f4b48077620 2026-02-19T08:24:41.500 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:41.501 INFO:teuthology.orchestra.run.trial027.stdout:{"epoch":21,"fsid":"3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460","created":"2026-02-19T08:23:28.508633+0000","modified":"2026-02-19T08:24:40.736603+0000","last_up_change":"2026-02-19T08:24:37.610599+0000","last_in_change":"2026-02-19T08:24:21.300893+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-19T08:24:38.298895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eb259e05-73a1-4945-8799-66f67f314d9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6802","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6803","nonce":4167313654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6804","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6805","nonce":4167313654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6808","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6809","nonce":4167313654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6806","nonce":4167313654},{"type":"v1","addr":"10.20.193.27:6807","nonce":4167313654}]},"public_addr":"10.20.193.27:6803/4167313654","cluster_addr":"10.20.193.27:6805/4167313654","heartbeat_back_addr":"10.20.193.27:6809/4167313654","heartbeat_front_addr":"10.20.193.27:6807/4167313654","state":["exists","up"]},{"osd":1,"uuid":"f81b4fa6-2886-4ed5-9abc-1d372b4311be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6810","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6811","nonce":2398673182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6812","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6813","nonce":2398673182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6816","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6817","nonce":2398673182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6814","nonce":2398673182},{"type":"v1","addr":"10.20.193.27:6815","nonce":2398673182}]},"public_addr":"10.20.193.27:6811/2398673182","cluster_addr":"10.20.193.27:6813/2398673182","heartbeat_back_addr":"10.20.193.27:6817/2398673182","heartbeat_front_addr":"10.20.193.27:6815/2398673182","state":["exists","up"]},{"osd":2,"uuid":"a8cecd57-2426-4e7f-8e64-724764783b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6818","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6819","nonce":1085344185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6820","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6821","nonce":1085344185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6824","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6825","nonce":1085344185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.27:6822","nonce":1085344185},{"type":"v1","addr":"10.20.193.27:6823","nonce":1085344185}]},"public_addr":"10.20.193.27:6819/1085344185","cluster_addr":"10.20.193.27:6821/1085344185","heartbeat_back_addr":"10.20.193.27:6825/1085344185","heartbeat_front_addr":"10.20.193.27:6823/1085344185","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T08:24:13.922058+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T08:24:25.209524+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T08:24:36.109240+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.27:0/1830268314":"2026-02-20T08:23:46.264174+0000","10.20.193.27:0/3098658206":"2026-02-20T08:23:46.264174+0000","10.20.193.27:6801/2519751978":"2026-02-20T08:23:46.264174+0000","10.20.193.27:6800/2519751978":"2026-02-20T08:23:46.264174+0000","10.20.193.27:0/3231774743":"2026-02-20T08:23:46.264174+0000","10.20.193.27:6801/688875344":"2026-02-20T08:23:38.096103+0000","10.20.193.27:0/3614775708":"2026-02-20T08:23:38.096103+0000","10.20.193.27:6800/688875344":"2026-02-20T08:23:38.096103+0000","10.20.193.27:0/1431688824":"2026-02-20T08:23:38.096103+0000","10.20.193.27:0/3103857437":"2026-02-20T08:23:38.096103+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-19T08:24:41.501 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 10 mgrc shutdown 2026-02-19T08:24:41.502 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 1 -- 10.20.193.27:0/1918195285 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4b1c03df10 msgr2=0x7f4b1c0403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.502 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 1 --2- 10.20.193.27:0/1918195285 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4b1c03df10 0x7f4b1c0403d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4b380099c0 tx=0x7f4b38006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.502 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 1 -- 10.20.193.27:0/1918195285 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4b48077620 msgr2=0x7f4b481a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.502 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 1 --2- 10.20.193.27:0/1918195285 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4b48077620 0x7f4b481a5810 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4b34002410 tx=0x7f4b34004290 comp rx=0 tx=0).stop 2026-02-19T08:24:41.502 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 1 -- 10.20.193.27:0/1918195285 shutdown_connections 2026-02-19T08:24:41.502 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 1 --2- 10.20.193.27:0/1918195285 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f4b1c03df10 0x7f4b1c0403d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.502 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 1 --2- 10.20.193.27:0/1918195285 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f4b48077620 0x7f4b481a5810 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.502 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 1 -- 10.20.193.27:0/1918195285 >> 10.20.193.27:0/1918195285 conn(0x7f4b481006d0 msgr2=0x7f4b481034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:41.502 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 1 -- 10.20.193.27:0/1918195285 shutdown_connections 2026-02-19T08:24:41.502 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.497+0000 7f4b4e964640 1 -- 10.20.193.27:0/1918195285 wait complete. 2026-02-19T08:24:41.536 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-19T08:24:41.537 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-19T08:24:41.537 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-19T08:24:41.700 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:41.700 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:41.709 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:41.814 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 -- 10.20.193.27:0/3297192308 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f2410a640 msgr2=0x7f1f2410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 --2- 10.20.193.27:0/3297192308 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f2410a640 0x7f1f2410aa20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1f140099b0 tx=0x7f1f1402f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 -- 10.20.193.27:0/3297192308 shutdown_connections 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 --2- 10.20.193.27:0/3297192308 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f2410a640 0x7f1f2410aa20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 -- 10.20.193.27:0/3297192308 >> 10.20.193.27:0/3297192308 conn(0x7f1f241006d0 msgr2=0x7f1f24102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 -- 10.20.193.27:0/3297192308 shutdown_connections 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 -- 10.20.193.27:0/3297192308 wait complete. 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 Processor -- start 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 -- start start 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f2410a640 0x7f1f2419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.808+0000 7f1f2b767640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2410e050 con 0x7f1f2410a640 2026-02-19T08:24:41.815 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f294dc640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f2410a640 0x7f1f2419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f294dc640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f2410a640 0x7f1f2419b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57446/0 (socket says 10.20.193.27:57446) 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f294dc640 1 -- 10.20.193.27:0/1389101357 learned_addr learned my addr 10.20.193.27:0/1389101357 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f294dc640 1 -- 10.20.193.27:0/1389101357 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2419bbd0 con 0x7f1f2410a640 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f294dc640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f2410a640 0x7f1f2419b690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f14004290 tx=0x7f1f140042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f127fc640 1 -- 10.20.193.27:0/1389101357 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f14038510 con 0x7f1f2410a640 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2419be60 con 0x7f1f2410a640 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f127fc640 1 -- 10.20.193.27:0/1389101357 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1f14046070 con 0x7f1f2410a640 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f127fc640 1 -- 10.20.193.27:0/1389101357 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f14041610 con 0x7f1f2410a640 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2419ff60 con 0x7f1f2410a640 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.809+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f2419c320 con 0x7f1f2410a640 2026-02-19T08:24:41.816 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f127fc640 1 -- 10.20.193.27:0/1389101357 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f1f14053070 con 0x7f1f2410a640 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f127fc640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f127fc640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f127fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f127fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f127fc640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f0003dec0 0x7f1f00040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f127fc640 1 -- 10.20.193.27:0/1389101357 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f1f14078040 con 0x7f1f2410a640 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f127fc640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654] conn(0x7f1f00042d00 0x7f1f00045140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f28cdb640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f0003dec0 0x7f1f00040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f127fc640 1 -- 10.20.193.27:0/1389101357 --> [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f14051e50 con 0x7f1f00042d00 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f127fc640 1 -- 10.20.193.27:0/1389101357 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1f14078500 con 0x7f1f2410a640 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f29cdd640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654] conn(0x7f1f00042d00 0x7f1f00045140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.817 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f28cdb640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f0003dec0 0x7f1f00040380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f180099c0 tx=0x7f1f18006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.818 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.810+0000 7f1f29cdd640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654] conn(0x7f1f00042d00 0x7f1f00045140 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.818 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.811+0000 7f1f127fc640 1 -- 10.20.193.27:0/1389101357 <== osd.0 v2:10.20.193.27:6802/4167313654 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f1f14051e50 con 0x7f1f00042d00 2026-02-19T08:24:41.820 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.811+0000 7f22c58a7640 1 -- 10.20.193.27:0/3403306817 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f22c0108460 msgr2=0x7f22c0108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.820 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.811+0000 7f22c58a7640 1 --2- 10.20.193.27:0/3403306817 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f22c0108460 0x7f22c0108840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f22b40099b0 tx=0x7f22b402f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.820 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.811+0000 7f22c58a7640 1 -- 10.20.193.27:0/3403306817 shutdown_connections 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.811+0000 7f22c58a7640 1 --2- 10.20.193.27:0/3403306817 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f22c0108460 0x7f22c0108840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.811+0000 7f22c58a7640 1 -- 10.20.193.27:0/3403306817 >> 10.20.193.27:0/3403306817 conn(0x7f22c00fcf70 msgr2=0x7f22c00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.811+0000 7f22c58a7640 1 -- 10.20.193.27:0/3403306817 shutdown_connections 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.811+0000 7f22c58a7640 1 -- 10.20.193.27:0/3403306817 wait complete. 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.811+0000 7f22c58a7640 1 Processor -- start 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.811+0000 7f22c58a7640 1 -- start start 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22c58a7640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f22c0108460 0x7f22c0199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22c58a7640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f22c010bde0 con 0x7f22c0108460 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22beffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f22c0108460 0x7f22c0199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22beffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f22c0108460 0x7f22c0199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57468/0 (socket says 10.20.193.27:57468) 2026-02-19T08:24:41.821 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22beffd640 1 -- 10.20.193.27:0/2025067232 learned_addr learned my addr 10.20.193.27:0/2025067232 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22beffd640 1 -- 10.20.193.27:0/2025067232 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c0199a60 con 0x7f22c0108460 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22beffd640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f22c0108460 0x7f22c0199520 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f22b4004290 tx=0x7f22b40042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22c48a5640 1 -- 10.20.193.27:0/2025067232 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22b4038510 con 0x7f22c0108460 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22c48a5640 1 -- 10.20.193.27:0/2025067232 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f22b4046070 con 0x7f22c0108460 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c0199cf0 con 0x7f22c0108460 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22c48a5640 1 -- 10.20.193.27:0/2025067232 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22b4041610 con 0x7f22c0108460 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c019ddf0 con 0x7f22c0108460 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22c019a1b0 con 0x7f22c0108460 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22c48a5640 1 -- 10.20.193.27:0/2025067232 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f22b40386b0 con 0x7f22c0108460 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.812+0000 7f22c48a5640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22c48a5640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22c48a5640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:41.822 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22c48a5640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:41.823 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22c48a5640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f229403df10 0x7f22940403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.823 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22c48a5640 1 -- 10.20.193.27:0/2025067232 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f22b4077b60 con 0x7f22c0108460 2026-02-19T08:24:41.823 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22c48a5640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185] conn(0x7f2294042d50 0x7f2294045190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.823 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22c48a5640 1 -- 10.20.193.27:0/2025067232 --> [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2294045860 con 0x7f2294042d50 2026-02-19T08:24:41.823 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22c48a5640 1 -- 10.20.193.27:0/2025067232 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f22b407c2a0 con 0x7f22c0108460 2026-02-19T08:24:41.823 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22be7fc640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f229403df10 0x7f22940403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.823 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22bf7fe640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185] conn(0x7f2294042d50 0x7f2294045190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.823 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22be7fc640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f229403df10 0x7f22940403d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22a80099c0 tx=0x7f22a8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.823 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7f22bf7fe640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185] conn(0x7f2294042d50 0x7f2294045190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.824 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7fccc3fe4640 1 -- 10.20.193.27:0/2558391007 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fccbc1014f0 msgr2=0x7fccbc1018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.824 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7fccc3fe4640 1 --2- 10.20.193.27:0/2558391007 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fccbc1014f0 0x7fccbc1018d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fccac0099b0 tx=0x7fccac02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.824 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7fccc3fe4640 1 -- 10.20.193.27:0/2558391007 shutdown_connections 2026-02-19T08:24:41.824 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7fccc3fe4640 1 --2- 10.20.193.27:0/2558391007 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fccbc1014f0 0x7fccbc1018d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.824 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7fccc3fe4640 1 -- 10.20.193.27:0/2558391007 >> 10.20.193.27:0/2558391007 conn(0x7fccbc0fcf70 msgr2=0x7fccbc0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:41.824 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7fccc3fe4640 1 -- 10.20.193.27:0/2558391007 shutdown_connections 2026-02-19T08:24:41.824 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.813+0000 7fccc3fe4640 1 -- 10.20.193.27:0/2558391007 wait complete. 2026-02-19T08:24:41.825 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7f22c48a5640 1 -- 10.20.193.27:0/2025067232 <== osd.2 v2:10.20.193.27:6818/1085344185 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f2294045860 con 0x7f2294042d50 2026-02-19T08:24:41.827 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc3fe4640 1 Processor -- start 2026-02-19T08:24:41.827 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc3fe4640 1 -- start start 2026-02-19T08:24:41.827 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc3fe4640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fccbc1014f0 0x7fccbc0fd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.827 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc3fe4640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc10aca0 con 0x7fccbc1014f0 2026-02-19T08:24:41.827 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc1d59640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fccbc1014f0 0x7fccbc0fd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc1d59640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fccbc1014f0 0x7fccbc0fd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57490/0 (socket says 10.20.193.27:57490) 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc1d59640 1 -- 10.20.193.27:0/3412474539 learned_addr learned my addr 10.20.193.27:0/3412474539 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc1d59640 1 -- 10.20.193.27:0/3412474539 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc0ff310 con 0x7fccbc1014f0 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc1d59640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fccbc1014f0 0x7fccbc0fd420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fccac004290 tx=0x7fccac0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccaaffd640 1 -- 10.20.193.27:0/3412474539 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccac038510 con 0x7fccbc1014f0 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccaaffd640 1 -- 10.20.193.27:0/3412474539 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fccac046070 con 0x7fccbc1014f0 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccbc0fd960 con 0x7fccbc1014f0 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccaaffd640 1 -- 10.20.193.27:0/3412474539 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccac041610 con 0x7fccbc1014f0 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.814+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccbc0fde20 con 0x7fccbc1014f0 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fccbc1029d0 con 0x7fccbc1014f0 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccaaffd640 1 -- 10.20.193.27:0/3412474539 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7fccac041910 con 0x7fccbc1014f0 2026-02-19T08:24:41.828 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccaaffd640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccaaffd640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccaaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccaaffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccaaffd640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc9803dec0 0x7fcc98040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccaaffd640 1 -- 10.20.193.27:0/3412474539 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7fccac077af0 con 0x7fccbc1014f0 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccaaffd640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182] conn(0x7fcc98042d00 0x7fcc98045140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccaaffd640 1 -- 10.20.193.27:0/3412474539 --> [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc98045810 con 0x7fcc98042d00 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccaaffd640 1 -- 10.20.193.27:0/3412474539 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fccac07e050 con 0x7fccbc1014f0 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccc1558640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc9803dec0 0x7fcc98040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccc255a640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182] conn(0x7fcc98042d00 0x7fcc98045140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccc1558640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc9803dec0 0x7fcc98040380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fccb00099c0 tx=0x7fccb0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.829 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.815+0000 7fccc255a640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182] conn(0x7fcc98042d00 0x7fcc98045140 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:41.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.816+0000 7fccaaffd640 1 -- 10.20.193.27:0/3412474539 <== osd.1 v2:10.20.193.27:6810/2398673182 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fcc98045810 con 0x7fcc98042d00 2026-02-19T08:24:41.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.817+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 --> [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f241a07d0 con 0x7f1f00042d00 2026-02-19T08:24:41.830 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f127fc640 1 -- 10.20.193.27:0/1389101357 <== osd.0 v2:10.20.193.27:6802/4167313654 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f241a07d0 con 0x7f1f00042d00 2026-02-19T08:24:41.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654] conn(0x7f1f00042d00 msgr2=0x7f1f00045140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654] conn(0x7f1f00042d00 0x7f1f00045140 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.831 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 10 mgrc shutdown 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f0003dec0 msgr2=0x7f1f00040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f0003dec0 0x7f1f00040380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f180099c0 tx=0x7f1f18006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f2410a640 msgr2=0x7f1f2419b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f2410a640 0x7f1f2419b690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1f14004290 tx=0x7f1f140042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 shutdown_connections 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6802/4167313654,v1:10.20.193.27:6803/4167313654] conn(0x7f1f00042d00 0x7f1f00045140 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f1f0003dec0 0x7f1f00040380 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 --2- 10.20.193.27:0/1389101357 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f1f2410a640 0x7f1f2419b690 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 >> 10.20.193.27:0/1389101357 conn(0x7f1f241006d0 msgr2=0x7f1f24106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 shutdown_connections 2026-02-19T08:24:41.832 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.818+0000 7f1f2b767640 1 -- 10.20.193.27:0/1389101357 wait complete. 2026-02-19T08:24:41.833 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.820+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 --> [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f22c010a190 con 0x7f2294042d50 2026-02-19T08:24:41.833 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c48a5640 1 -- 10.20.193.27:0/2025067232 <== osd.2 v2:10.20.193.27:6818/1085344185 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f22c010a190 con 0x7f2294042d50 2026-02-19T08:24:41.834 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185] conn(0x7f2294042d50 msgr2=0x7f2294045190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.835 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185] conn(0x7f2294042d50 0x7f2294045190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.835 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 10 mgrc shutdown 2026-02-19T08:24:41.835 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f229403df10 msgr2=0x7f22940403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.835 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f229403df10 0x7f22940403d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22a80099c0 tx=0x7f22a8006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.835 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f22c0108460 msgr2=0x7f22c0199520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.835 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f22c0108460 0x7f22c0199520 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f22b4004290 tx=0x7f22b40042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.835 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 shutdown_connections 2026-02-19T08:24:41.835 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6818/1085344185,v1:10.20.193.27:6819/1085344185] conn(0x7f2294042d50 0x7f2294045190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.835 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f229403df10 0x7f22940403d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.836 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 --2- 10.20.193.27:0/2025067232 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f22c0108460 0x7f22c0199520 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.836 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 >> 10.20.193.27:0/2025067232 conn(0x7f22c00fcf70 msgr2=0x7f22c0106740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:41.836 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 shutdown_connections 2026-02-19T08:24:41.836 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.821+0000 7f22c58a7640 1 -- 10.20.193.27:0/2025067232 wait complete. 2026-02-19T08:24:41.836 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 --> [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fccbc105120 con 0x7fcc98042d00 2026-02-19T08:24:41.836 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccaaffd640 1 -- 10.20.193.27:0/3412474539 <== osd.1 v2:10.20.193.27:6810/2398673182 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fccbc105120 con 0x7fcc98042d00 2026-02-19T08:24:41.838 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182] conn(0x7fcc98042d00 msgr2=0x7fcc98045140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.838 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182] conn(0x7fcc98042d00 0x7fcc98045140 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.838 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 10 mgrc shutdown 2026-02-19T08:24:41.838 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc9803dec0 msgr2=0x7fcc98040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.838 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc9803dec0 0x7fcc98040380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fccb00099c0 tx=0x7fccb0006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.838 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fccbc1014f0 msgr2=0x7fccbc0fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:41.838 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fccbc1014f0 0x7fccbc0fd420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fccac004290 tx=0x7fccac0042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.838 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 shutdown_connections 2026-02-19T08:24:41.838 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fcc9803dec0 0x7fcc98040380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.839 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:6810/2398673182,v1:10.20.193.27:6811/2398673182] conn(0x7fcc98042d00 0x7fcc98045140 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.839 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 --2- 10.20.193.27:0/3412474539 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fccbc1014f0 0x7fccbc0fd420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:41.839 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 >> 10.20.193.27:0/3412474539 conn(0x7fccbc0fcf70 msgr2=0x7fccbc1096c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:41.839 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 shutdown_connections 2026-02-19T08:24:41.839 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:41.823+0000 7fccc3fe4640 1 -- 10.20.193.27:0/3412474539 wait complete. 2026-02-19T08:24:41.860 INFO:teuthology.orchestra.run.trial027.stdout:38654705673 2026-02-19T08:24:41.861 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-19T08:24:41.872 INFO:teuthology.orchestra.run.trial027.stdout:60129542150 2026-02-19T08:24:41.872 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-19T08:24:41.876 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:41 trial027 ceph-mon[21739]: pgmap v37: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T08:24:41.876 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:41 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/4223127756' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-19T08:24:41.876 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:41 trial027 ceph-mon[21739]: osdmap e21: 3 total, 3 up, 3 in 2026-02-19T08:24:41.876 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:41 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/4066363236' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-19T08:24:41.876 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:41 trial027 ceph-mon[21739]: mgrmap e14: a(active, since 54s) 2026-02-19T08:24:41.876 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:41 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1918195285' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-19T08:24:41.877 INFO:teuthology.orchestra.run.trial027.stdout:77309411332 2026-02-19T08:24:41.878 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-19T08:24:42.010 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:42.025 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:42.093 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:42.116 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.112+0000 7f35d4749640 1 -- 10.20.193.27:0/3097861522 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f35cc10a640 msgr2=0x7f35cc10aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:42.116 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.112+0000 7f35d4749640 1 --2- 10.20.193.27:0/3097861522 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f35cc10a640 0x7f35cc10aa20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0099b0 tx=0x7f35bc02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.116 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.112+0000 7f35d4749640 1 -- 10.20.193.27:0/3097861522 shutdown_connections 2026-02-19T08:24:42.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.112+0000 7f35d4749640 1 --2- 10.20.193.27:0/3097861522 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f35cc10a640 0x7f35cc10aa20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.112+0000 7f35d4749640 1 -- 10.20.193.27:0/3097861522 >> 10.20.193.27:0/3097861522 conn(0x7f35cc1006d0 msgr2=0x7f35cc102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:42.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.112+0000 7f35d4749640 1 -- 10.20.193.27:0/3097861522 shutdown_connections 2026-02-19T08:24:42.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.112+0000 7f35d4749640 1 -- 10.20.193.27:0/3097861522 wait complete. 2026-02-19T08:24:42.117 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d4749640 1 Processor -- start 2026-02-19T08:24:42.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d4749640 1 -- start start 2026-02-19T08:24:42.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d4749640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f35cc10a640 0x7f35cc19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:42.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d4749640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc10e050 con 0x7f35cc10a640 2026-02-19T08:24:42.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d24be640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f35cc10a640 0x7f35cc19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:42.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d24be640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f35cc10a640 0x7f35cc19b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57510/0 (socket says 10.20.193.27:57510) 2026-02-19T08:24:42.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d24be640 1 -- 10.20.193.27:0/910500273 learned_addr learned my addr 10.20.193.27:0/910500273 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:42.119 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d24be640 1 -- 10.20.193.27:0/910500273 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35cc19bbd0 con 0x7f35cc10a640 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d24be640 1 --2- 10.20.193.27:0/910500273 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f35cc10a640 0x7f35cc19b690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35bc004290 tx=0x7f35bc0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35b37fe640 1 -- 10.20.193.27:0/910500273 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc038510 con 0x7f35cc10a640 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d4749640 1 -- 10.20.193.27:0/910500273 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35cc19be60 con 0x7f35cc10a640 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35b37fe640 1 -- 10.20.193.27:0/910500273 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f35bc046070 con 0x7f35cc10a640 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35b37fe640 1 -- 10.20.193.27:0/910500273 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc041610 con 0x7f35cc10a640 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.113+0000 7f35d4749640 1 -- 10.20.193.27:0/910500273 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35cc19ff60 con 0x7f35cc10a640 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.114+0000 7f35d4749640 1 -- 10.20.193.27:0/910500273 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35cc105d80 con 0x7f35cc10a640 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.114+0000 7f35b37fe640 1 -- 10.20.193.27:0/910500273 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f35bc0386b0 con 0x7f35cc10a640 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.114+0000 7f35b37fe640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.114+0000 7f35b37fe640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.114+0000 7f35b37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:42.120 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.114+0000 7f35b37fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:42.121 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.114+0000 7f35b37fe640 1 --2- 10.20.193.27:0/910500273 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f35a803dec0 0x7f35a8040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:42.121 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.114+0000 7f35b37fe640 1 -- 10.20.193.27:0/910500273 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f35bc077ba0 con 0x7f35cc10a640 2026-02-19T08:24:42.121 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.114+0000 7f35d1cbd640 1 --2- 10.20.193.27:0/910500273 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f35a803dec0 0x7f35a8040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:42.121 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.115+0000 7f35d1cbd640 1 --2- 10.20.193.27:0/910500273 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f35a803dec0 0x7f35a8040380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f35c00099c0 tx=0x7f35c0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:42.121 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.117+0000 7f35b37fe640 1 -- 10.20.193.27:0/910500273 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f35bc040360 con 0x7f35cc10a640 2026-02-19T08:24:42.123 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.117+0000 7fa9fd538640 1 -- 10.20.193.27:0/2447176893 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa9f8108460 msgr2=0x7fa9f8108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.117+0000 7fa9fd538640 1 --2- 10.20.193.27:0/2447176893 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa9f8108460 0x7fa9f8108840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0099b0 tx=0x7fa9ec02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.117+0000 7fa9fd538640 1 -- 10.20.193.27:0/2447176893 shutdown_connections 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.117+0000 7fa9fd538640 1 --2- 10.20.193.27:0/2447176893 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa9f8108460 0x7fa9f8108840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.117+0000 7fa9fd538640 1 -- 10.20.193.27:0/2447176893 >> 10.20.193.27:0/2447176893 conn(0x7fa9f80fcf70 msgr2=0x7fa9f80ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.117+0000 7fa9fd538640 1 -- 10.20.193.27:0/2447176893 shutdown_connections 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.117+0000 7fa9fd538640 1 -- 10.20.193.27:0/2447176893 wait complete. 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.117+0000 7fa9fd538640 1 Processor -- start 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.117+0000 7fa9fd538640 1 -- start start 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9fd538640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa9f8108460 0x7fa9f819b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9fd538640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f810bde0 con 0x7fa9f8108460 2026-02-19T08:24:42.124 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9f6ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa9f8108460 0x7fa9f819b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9f6ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa9f8108460 0x7fa9f819b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57532/0 (socket says 10.20.193.27:57532) 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9f6ffd640 1 -- 10.20.193.27:0/2512284040 learned_addr learned my addr 10.20.193.27:0/2512284040 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9f6ffd640 1 -- 10.20.193.27:0/2512284040 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f819bce0 con 0x7fa9f8108460 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9f6ffd640 1 --2- 10.20.193.27:0/2512284040 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa9f8108460 0x7fa9f819b7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec002410 tx=0x7fa9ec004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9d7fff640 1 -- 10.20.193.27:0/2512284040 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec038510 con 0x7fa9f8108460 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9d7fff640 1 -- 10.20.193.27:0/2512284040 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa9ec046070 con 0x7fa9f8108460 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9d7fff640 1 -- 10.20.193.27:0/2512284040 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec041630 con 0x7fa9f8108460 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9fd538640 1 -- 10.20.193.27:0/2512284040 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f819bf70 con 0x7fa9f8108460 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.118+0000 7fa9fd538640 1 -- 10.20.193.27:0/2512284040 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f819efc0 con 0x7fa9f8108460 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.119+0000 7fa9d7fff640 1 -- 10.20.193.27:0/2512284040 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7fa9ec0386b0 con 0x7fa9f8108460 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.119+0000 7fa9d7fff640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:42.125 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.119+0000 7fa9d7fff640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:42.126 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.119+0000 7fa9d7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:42.126 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.119+0000 7fa9d7fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:42.126 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.119+0000 7fa9d7fff640 1 --2- 10.20.193.27:0/2512284040 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa9c803df10 0x7fa9c80403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:42.126 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.119+0000 7fa9d7fff640 1 -- 10.20.193.27:0/2512284040 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7fa9ec077b00 con 0x7fa9f8108460 2026-02-19T08:24:42.126 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.119+0000 7fa9f67fc640 1 --2- 10.20.193.27:0/2512284040 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa9c803df10 0x7fa9c80403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:42.126 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.119+0000 7fa9fd538640 1 -- 10.20.193.27:0/2512284040 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f8103b10 con 0x7fa9f8108460 2026-02-19T08:24:42.126 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.119+0000 7fa9f67fc640 1 --2- 10.20.193.27:0/2512284040 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa9c803df10 0x7fa9c80403d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00099c0 tx=0x7fa9e0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:42.126 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.122+0000 7fa9d7fff640 1 -- 10.20.193.27:0/2512284040 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa9ec077e20 con 0x7fa9f8108460 2026-02-19T08:24:42.198 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 -- 10.20.193.27:0/1029874504 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efd3810a650 msgr2=0x7efd3810aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 --2- 10.20.193.27:0/1029874504 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efd3810a650 0x7efd3810aa30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efd280099b0 tx=0x7efd2802f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 -- 10.20.193.27:0/1029874504 shutdown_connections 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 --2- 10.20.193.27:0/1029874504 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efd3810a650 0x7efd3810aa30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 -- 10.20.193.27:0/1029874504 >> 10.20.193.27:0/1029874504 conn(0x7efd38100330 msgr2=0x7efd38102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 -- 10.20.193.27:0/1029874504 shutdown_connections 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 -- 10.20.193.27:0/1029874504 wait complete. 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 Processor -- start 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 -- start start 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efd3810a650 0x7efd3819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3f697640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7efd3810e060 con 0x7efd3810a650 2026-02-19T08:24:42.199 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3d40c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efd3810a650 0x7efd3819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3d40c640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efd3810a650 0x7efd3819b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57548/0 (socket says 10.20.193.27:57548) 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.193+0000 7efd3d40c640 1 -- 10.20.193.27:0/388060169 learned_addr learned my addr 10.20.193.27:0/388060169 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.194+0000 7efd3d40c640 1 -- 10.20.193.27:0/388060169 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3819bbc0 con 0x7efd3810a650 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.194+0000 7efd3d40c640 1 --2- 10.20.193.27:0/388060169 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efd3810a650 0x7efd3819b680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efd28004290 tx=0x7efd280042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.194+0000 7efd267fc640 1 -- 10.20.193.27:0/388060169 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd28038510 con 0x7efd3810a650 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.194+0000 7efd267fc640 1 -- 10.20.193.27:0/388060169 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7efd28046070 con 0x7efd3810a650 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.194+0000 7efd267fc640 1 -- 10.20.193.27:0/388060169 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd28041610 con 0x7efd3810a650 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.194+0000 7efd3f697640 1 -- 10.20.193.27:0/388060169 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3819be50 con 0x7efd3810a650 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.194+0000 7efd3f697640 1 -- 10.20.193.27:0/388060169 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd3819ff50 con 0x7efd3810a650 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.194+0000 7efd3f697640 1 -- 10.20.193.27:0/388060169 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd38105d90 con 0x7efd3810a650 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.194+0000 7efd267fc640 1 -- 10.20.193.27:0/388060169 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7efd280386b0 con 0x7efd3810a650 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.194+0000 7efd267fc640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:42.200 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.195+0000 7efd267fc640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:42.201 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.195+0000 7efd267fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:42.201 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.195+0000 7efd267fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:42.201 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.195+0000 7efd267fc640 1 --2- 10.20.193.27:0/388060169 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efd1403df10 0x7efd140403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:42.201 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.195+0000 7efd267fc640 1 -- 10.20.193.27:0/388060169 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7efd28077b40 con 0x7efd3810a650 2026-02-19T08:24:42.201 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.195+0000 7efd3cc0b640 1 --2- 10.20.193.27:0/388060169 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efd1403df10 0x7efd140403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:42.201 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.195+0000 7efd3cc0b640 1 --2- 10.20.193.27:0/388060169 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efd1403df10 0x7efd140403d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0099c0 tx=0x7efd2c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:42.201 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.197+0000 7efd267fc640 1 -- 10.20.193.27:0/388060169 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efd28040360 con 0x7efd3810a650 2026-02-19T08:24:42.206 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.202+0000 7f35d4749640 1 -- 10.20.193.27:0/910500273 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f35cc10aaa0 con 0x7f35cc10a640 2026-02-19T08:24:42.206 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.202+0000 7f35b37fe640 1 -- 10.20.193.27:0/910500273 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f35bc049360 con 0x7f35cc10a640 2026-02-19T08:24:42.206 INFO:teuthology.orchestra.run.trial027.stdout:38654705671 2026-02-19T08:24:42.208 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 10 mgrc shutdown 2026-02-19T08:24:42.208 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 1 -- 10.20.193.27:0/910500273 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f35a803dec0 msgr2=0x7f35a8040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:42.208 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 1 --2- 10.20.193.27:0/910500273 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f35a803dec0 0x7f35a8040380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f35c00099c0 tx=0x7f35c0006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.208 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 1 -- 10.20.193.27:0/910500273 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f35cc10a640 msgr2=0x7f35cc19b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:42.208 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 1 --2- 10.20.193.27:0/910500273 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f35cc10a640 0x7f35cc19b690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35bc004290 tx=0x7f35bc0042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.208 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 1 -- 10.20.193.27:0/910500273 shutdown_connections 2026-02-19T08:24:42.208 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 1 --2- 10.20.193.27:0/910500273 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f35a803dec0 0x7f35a8040380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.209 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 1 --2- 10.20.193.27:0/910500273 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f35cc10a640 0x7f35cc19b690 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.209 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 1 -- 10.20.193.27:0/910500273 >> 10.20.193.27:0/910500273 conn(0x7f35cc1006d0 msgr2=0x7f35cc106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:42.209 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 1 -- 10.20.193.27:0/910500273 shutdown_connections 2026-02-19T08:24:42.209 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.204+0000 7f35d4749640 1 -- 10.20.193.27:0/910500273 wait complete. 2026-02-19T08:24:42.211 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.208+0000 7fa9fd538640 1 -- 10.20.193.27:0/2512284040 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa9f81088c0 con 0x7fa9f8108460 2026-02-19T08:24:42.211 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.208+0000 7fa9d7fff640 1 -- 10.20.193.27:0/2512284040 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa9ec007c50 con 0x7fa9f8108460 2026-02-19T08:24:42.212 INFO:teuthology.orchestra.run.trial027.stdout:60129542149 2026-02-19T08:24:42.214 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 10 mgrc shutdown 2026-02-19T08:24:42.214 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 1 -- 10.20.193.27:0/2512284040 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa9c803df10 msgr2=0x7fa9c80403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:42.214 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 1 --2- 10.20.193.27:0/2512284040 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa9c803df10 0x7fa9c80403d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00099c0 tx=0x7fa9e0006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.214 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 1 -- 10.20.193.27:0/2512284040 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa9f8108460 msgr2=0x7fa9f819b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:42.214 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 1 --2- 10.20.193.27:0/2512284040 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa9f8108460 0x7fa9f819b7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec002410 tx=0x7fa9ec004290 comp rx=0 tx=0).stop 2026-02-19T08:24:42.214 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 1 -- 10.20.193.27:0/2512284040 shutdown_connections 2026-02-19T08:24:42.214 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 1 --2- 10.20.193.27:0/2512284040 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fa9c803df10 0x7fa9c80403d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.214 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 1 --2- 10.20.193.27:0/2512284040 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fa9f8108460 0x7fa9f819b7a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.214 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 1 -- 10.20.193.27:0/2512284040 >> 10.20.193.27:0/2512284040 conn(0x7fa9f80fcf70 msgr2=0x7fa9f810a100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:42.214 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 1 -- 10.20.193.27:0/2512284040 shutdown_connections 2026-02-19T08:24:42.215 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.210+0000 7fa9fd538640 1 -- 10.20.193.27:0/2512284040 wait complete. 2026-02-19T08:24:42.248 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705673 got 38654705671 for osd.0 2026-02-19T08:24:42.251 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2026-02-19T08:24:42.289 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.285+0000 7efd3f697640 1 -- 10.20.193.27:0/388060169 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efd3810aab0 con 0x7efd3810a650 2026-02-19T08:24:42.289 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.286+0000 7efd267fc640 1 -- 10.20.193.27:0/388060169 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd28049360 con 0x7efd3810a650 2026-02-19T08:24:42.290 INFO:teuthology.orchestra.run.trial027.stdout:77309411331 2026-02-19T08:24:42.291 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 10 mgrc shutdown 2026-02-19T08:24:42.291 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 1 -- 10.20.193.27:0/388060169 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efd1403df10 msgr2=0x7efd140403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:42.291 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 1 --2- 10.20.193.27:0/388060169 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efd1403df10 0x7efd140403d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0099c0 tx=0x7efd2c006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.291 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 1 -- 10.20.193.27:0/388060169 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efd3810a650 msgr2=0x7efd3819b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:42.291 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 1 --2- 10.20.193.27:0/388060169 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efd3810a650 0x7efd3819b680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efd28004290 tx=0x7efd280042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.292 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 1 -- 10.20.193.27:0/388060169 shutdown_connections 2026-02-19T08:24:42.292 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 1 --2- 10.20.193.27:0/388060169 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7efd1403df10 0x7efd140403d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.292 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 1 --2- 10.20.193.27:0/388060169 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7efd3810a650 0x7efd3819b680 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:42.292 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 1 -- 10.20.193.27:0/388060169 >> 10.20.193.27:0/388060169 conn(0x7efd38100330 msgr2=0x7efd381087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:42.292 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 1 -- 10.20.193.27:0/388060169 shutdown_connections 2026-02-19T08:24:42.292 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:42.287+0000 7efd3f697640 1 -- 10.20.193.27:0/388060169 wait complete. 2026-02-19T08:24:42.327 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411331 for osd.2 2026-02-19T08:24:42.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:42 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/910500273' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-19T08:24:42.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:42 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/2512284040' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-19T08:24:42.848 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:42 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/388060169' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-19T08:24:43.249 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-19T08:24:43.252 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-19T08:24:43.328 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-19T08:24:43.401 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:43.478 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:43.498 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:43.523 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/370665544 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8eb4075410 msgr2=0x7f8eb40757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:43.523 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 --2- 10.20.193.27:0/370665544 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8eb4075410 0x7f8eb40757f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40099b0 tx=0x7f8ea402f340 comp rx=0 tx=0).stop 2026-02-19T08:24:43.523 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/370665544 shutdown_connections 2026-02-19T08:24:43.523 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 --2- 10.20.193.27:0/370665544 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8eb4075410 0x7f8eb40757f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.523 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/370665544 >> 10.20.193.27:0/370665544 conn(0x7f8eb4079240 msgr2=0x7f8eb4100510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:43.523 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/370665544 shutdown_connections 2026-02-19T08:24:43.523 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/370665544 wait complete. 2026-02-19T08:24:43.523 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 Processor -- start 2026-02-19T08:24:43.523 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 -- start start 2026-02-19T08:24:43.523 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8eb4075410 0x7f8eb419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.517+0000 7f8ebb6cb640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb410e090 con 0x7f8eb4075410 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8eb9440640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8eb4075410 0x7f8eb419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8eb9440640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8eb4075410 0x7f8eb419b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57570/0 (socket says 10.20.193.27:57570) 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8eb9440640 1 -- 10.20.193.27:0/1750681030 learned_addr learned my addr 10.20.193.27:0/1750681030 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8eb9440640 1 -- 10.20.193.27:0/1750681030 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb419bbc0 con 0x7f8eb4075410 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8eb9440640 1 --2- 10.20.193.27:0/1750681030 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8eb4075410 0x7f8eb419b680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004290 tx=0x7f8ea40042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8ea27fc640 1 -- 10.20.193.27:0/1750681030 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea40385a0 con 0x7f8eb4075410 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8ea27fc640 1 -- 10.20.193.27:0/1750681030 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8ea4046070 con 0x7f8eb4075410 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/1750681030 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb419be50 con 0x7f8eb4075410 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8ea27fc640 1 -- 10.20.193.27:0/1750681030 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea4041730 con 0x7f8eb4075410 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/1750681030 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb419c2b0 con 0x7f8eb4075410 2026-02-19T08:24:43.524 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.518+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/1750681030 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb4076b50 con 0x7f8eb4075410 2026-02-19T08:24:43.525 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.519+0000 7f8ea27fc640 1 -- 10.20.193.27:0/1750681030 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f8ea4038740 con 0x7f8eb4075410 2026-02-19T08:24:43.525 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.519+0000 7f8ea27fc640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:43.525 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.519+0000 7f8ea27fc640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:43.525 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.519+0000 7f8ea27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:43.525 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.519+0000 7f8ea27fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:43.525 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.519+0000 7f8ea27fc640 1 --2- 10.20.193.27:0/1750681030 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8e9003dec0 0x7f8e90040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:43.525 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.519+0000 7f8ea27fc640 1 -- 10.20.193.27:0/1750681030 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f8ea4077c20 con 0x7f8eb4075410 2026-02-19T08:24:43.525 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.519+0000 7f8eb8c3f640 1 --2- 10.20.193.27:0/1750681030 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8e9003dec0 0x7f8e90040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:43.525 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.519+0000 7f8eb8c3f640 1 --2- 10.20.193.27:0/1750681030 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8e9003dec0 0x7f8e90040380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80099c0 tx=0x7f8ea8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:43.526 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.521+0000 7f8ea27fc640 1 -- 10.20.193.27:0/1750681030 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8ea4038a60 con 0x7f8eb4075410 2026-02-19T08:24:43.590 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f0e6667a640 1 -- 10.20.193.27:0/4075874655 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0e6010a640 msgr2=0x7f0e6010aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:43.591 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f0e6667a640 1 --2- 10.20.193.27:0/4075874655 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0e6010a640 0x7f0e6010aa20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c0099b0 tx=0x7f0e4c02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.591 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f0e6667a640 1 -- 10.20.193.27:0/4075874655 shutdown_connections 2026-02-19T08:24:43.591 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f0e6667a640 1 --2- 10.20.193.27:0/4075874655 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0e6010a640 0x7f0e6010aa20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.591 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f0e6667a640 1 -- 10.20.193.27:0/4075874655 >> 10.20.193.27:0/4075874655 conn(0x7f0e601006d0 msgr2=0x7f0e60102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:43.591 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f0e6667a640 1 -- 10.20.193.27:0/4075874655 shutdown_connections 2026-02-19T08:24:43.591 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f50ea6e4640 1 -- 10.20.193.27:0/83982530 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f50e406aa50 msgr2=0x7f50e406ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:43.592 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f50ea6e4640 1 --2- 10.20.193.27:0/83982530 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f50e406aa50 0x7f50e406ae30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f50d00099b0 tx=0x7f50d002f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.592 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f50ea6e4640 1 -- 10.20.193.27:0/83982530 shutdown_connections 2026-02-19T08:24:43.592 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f50ea6e4640 1 --2- 10.20.193.27:0/83982530 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f50e406aa50 0x7f50e406ae30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.592 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f50ea6e4640 1 -- 10.20.193.27:0/83982530 >> 10.20.193.27:0/83982530 conn(0x7f50e40780d0 msgr2=0x7f50e40ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:43.592 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f50ea6e4640 1 -- 10.20.193.27:0/83982530 shutdown_connections 2026-02-19T08:24:43.592 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f50ea6e4640 1 -- 10.20.193.27:0/83982530 wait complete. 2026-02-19T08:24:43.592 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f0e6667a640 1 -- 10.20.193.27:0/4075874655 wait complete. 2026-02-19T08:24:43.593 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f50ea6e4640 1 Processor -- start 2026-02-19T08:24:43.593 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f0e6667a640 1 Processor -- start 2026-02-19T08:24:43.593 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f50ea6e4640 1 -- start start 2026-02-19T08:24:43.594 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.587+0000 7f0e6667a640 1 -- start start 2026-02-19T08:24:43.594 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50ea6e4640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f50e406aa50 0x7f50e4101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:43.594 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50ea6e4640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f50e410bdd0 con 0x7f50e406aa50 2026-02-19T08:24:43.594 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e6667a640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0e6010a640 0x7f0e6019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:43.594 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e6667a640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6010e050 con 0x7f0e6010a640 2026-02-19T08:24:43.595 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50e3fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f50e406aa50 0x7f50e4101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:43.595 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e5ffff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0e6010a640 0x7f0e6019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:43.596 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50e3fff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f50e406aa50 0x7f50e4101260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57598/0 (socket says 10.20.193.27:57598) 2026-02-19T08:24:43.596 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50e3fff640 1 -- 10.20.193.27:0/275293235 learned_addr learned my addr 10.20.193.27:0/275293235 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:43.596 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e5ffff640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0e6010a640 0x7f0e6019b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57602/0 (socket says 10.20.193.27:57602) 2026-02-19T08:24:43.596 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e5ffff640 1 -- 10.20.193.27:0/3740255525 learned_addr learned my addr 10.20.193.27:0/3740255525 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:43.596 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50e3fff640 1 -- 10.20.193.27:0/275293235 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e4103150 con 0x7f50e406aa50 2026-02-19T08:24:43.597 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e5ffff640 1 -- 10.20.193.27:0/3740255525 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6019bbd0 con 0x7f0e6010a640 2026-02-19T08:24:43.597 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50e3fff640 1 --2- 10.20.193.27:0/275293235 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f50e406aa50 0x7f50e4101260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f50d0004290 tx=0x7f50d00042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:43.597 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e5ffff640 1 --2- 10.20.193.27:0/3740255525 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0e6010a640 0x7f0e6019b690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c002410 tx=0x7f0e4c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:43.598 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50e17fa640 1 -- 10.20.193.27:0/275293235 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d0038510 con 0x7f50e406aa50 2026-02-19T08:24:43.598 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50ea6e4640 1 -- 10.20.193.27:0/275293235 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e41017a0 con 0x7f50e406aa50 2026-02-19T08:24:43.598 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50e17fa640 1 -- 10.20.193.27:0/275293235 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f50d0046070 con 0x7f50e406aa50 2026-02-19T08:24:43.599 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50e17fa640 1 -- 10.20.193.27:0/275293235 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d0041610 con 0x7f50e406aa50 2026-02-19T08:24:43.599 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f50ea6e4640 1 -- 10.20.193.27:0/275293235 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e4101c60 con 0x7f50e406aa50 2026-02-19T08:24:43.599 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e5d7fa640 1 -- 10.20.193.27:0/3740255525 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e4c038510 con 0x7f0e6010a640 2026-02-19T08:24:43.599 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e6667a640 1 -- 10.20.193.27:0/3740255525 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6019be60 con 0x7f0e6010a640 2026-02-19T08:24:43.599 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e5d7fa640 1 -- 10.20.193.27:0/3740255525 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0e4c046070 con 0x7f0e6010a640 2026-02-19T08:24:43.600 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e5d7fa640 1 -- 10.20.193.27:0/3740255525 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e4c041630 con 0x7f0e6010a640 2026-02-19T08:24:43.600 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.588+0000 7f0e6667a640 1 -- 10.20.193.27:0/3740255525 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6019ff60 con 0x7f0e6010a640 2026-02-19T08:24:43.600 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f50ea6e4640 1 -- 10.20.193.27:0/275293235 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e4103b00 con 0x7f50e406aa50 2026-02-19T08:24:43.600 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f0e6667a640 1 -- 10.20.193.27:0/3740255525 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e60105d80 con 0x7f0e6010a640 2026-02-19T08:24:43.601 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f50e17fa640 1 -- 10.20.193.27:0/275293235 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f50d00386b0 con 0x7f50e406aa50 2026-02-19T08:24:43.601 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f50e17fa640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:43.601 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f0e5d7fa640 1 -- 10.20.193.27:0/3740255525 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f0e4c0386b0 con 0x7f0e6010a640 2026-02-19T08:24:43.601 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f0e5d7fa640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:43.601 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f50e17fa640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:43.602 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f50e17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:43.602 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f0e5d7fa640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:43.602 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f0e5d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:43.602 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f0e5d7fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:43.602 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f0e5d7fa640 1 --2- 10.20.193.27:0/3740255525 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0e3403df10 0x7f0e340403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:43.603 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f50e17fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:43.603 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f50e17fa640 1 --2- 10.20.193.27:0/275293235 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f50b803df10 0x7f50b80403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:43.603 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f0e5d7fa640 1 -- 10.20.193.27:0/3740255525 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f0e4c077b00 con 0x7f0e6010a640 2026-02-19T08:24:43.603 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f50e17fa640 1 -- 10.20.193.27:0/275293235 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f50d0077b60 con 0x7f50e406aa50 2026-02-19T08:24:43.604 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f0e5f7fe640 1 --2- 10.20.193.27:0/3740255525 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0e3403df10 0x7f0e340403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:43.604 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f50e37fe640 1 --2- 10.20.193.27:0/275293235 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f50b803df10 0x7f50b80403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:43.604 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f0e5f7fe640 1 --2- 10.20.193.27:0/3740255525 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0e3403df10 0x7f0e340403d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0e500099c0 tx=0x7f0e50006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:43.605 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.589+0000 7f50e37fe640 1 --2- 10.20.193.27:0/275293235 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f50b803df10 0x7f50b80403d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50d40099c0 tx=0x7f50d4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:43.605 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.592+0000 7f50e17fa640 1 -- 10.20.193.27:0/275293235 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f50d0040360 con 0x7f50e406aa50 2026-02-19T08:24:43.605 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.594+0000 7f0e5d7fa640 1 -- 10.20.193.27:0/3740255525 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0e4c007c50 con 0x7f0e6010a640 2026-02-19T08:24:43.611 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.607+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/1750681030 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8eb419c9e0 con 0x7f8eb4075410 2026-02-19T08:24:43.611 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.608+0000 7f8ea27fc640 1 -- 10.20.193.27:0/1750681030 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ea4007c50 con 0x7f8eb4075410 2026-02-19T08:24:43.611 INFO:teuthology.orchestra.run.trial027.stdout:38654705673 2026-02-19T08:24:43.614 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 10 mgrc shutdown 2026-02-19T08:24:43.614 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/1750681030 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8e9003dec0 msgr2=0x7f8e90040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:43.614 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 1 --2- 10.20.193.27:0/1750681030 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8e9003dec0 0x7f8e90040380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80099c0 tx=0x7f8ea8006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.614 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/1750681030 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8eb4075410 msgr2=0x7f8eb419b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:43.614 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 1 --2- 10.20.193.27:0/1750681030 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8eb4075410 0x7f8eb419b680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4004290 tx=0x7f8ea40042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.614 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/1750681030 shutdown_connections 2026-02-19T08:24:43.614 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 1 --2- 10.20.193.27:0/1750681030 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f8e9003dec0 0x7f8e90040380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.614 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 1 --2- 10.20.193.27:0/1750681030 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f8eb4075410 0x7f8eb419b680 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.614 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/1750681030 >> 10.20.193.27:0/1750681030 conn(0x7f8eb4079240 msgr2=0x7f8eb410bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:43.614 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/1750681030 shutdown_connections 2026-02-19T08:24:43.615 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.610+0000 7f8ebb6cb640 1 -- 10.20.193.27:0/1750681030 wait complete. 2026-02-19T08:24:43.651 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.0 2026-02-19T08:24:43.651 DEBUG:teuthology.parallel:result is None 2026-02-19T08:24:43.680 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.677+0000 7f50ea6e4640 1 -- 10.20.193.27:0/275293235 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f50e4102790 con 0x7f50e406aa50 2026-02-19T08:24:43.681 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.677+0000 7f50e17fa640 1 -- 10.20.193.27:0/275293235 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f50d0049360 con 0x7f50e406aa50 2026-02-19T08:24:43.681 INFO:teuthology.orchestra.run.trial027.stdout:60129542150 2026-02-19T08:24:43.682 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 10 mgrc shutdown 2026-02-19T08:24:43.682 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 1 -- 10.20.193.27:0/275293235 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f50b803df10 msgr2=0x7f50b80403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:43.682 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 1 --2- 10.20.193.27:0/275293235 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f50b803df10 0x7f50b80403d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50d40099c0 tx=0x7f50d4006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.682 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 1 -- 10.20.193.27:0/275293235 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f50e406aa50 msgr2=0x7f50e4101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:43.682 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 1 --2- 10.20.193.27:0/275293235 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f50e406aa50 0x7f50e4101260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f50d0004290 tx=0x7f50d00042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.683 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 1 -- 10.20.193.27:0/275293235 shutdown_connections 2026-02-19T08:24:43.683 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 1 --2- 10.20.193.27:0/275293235 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f50b803df10 0x7f50b80403d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.683 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 1 --2- 10.20.193.27:0/275293235 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f50e406aa50 0x7f50e4101260 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.683 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 1 -- 10.20.193.27:0/275293235 >> 10.20.193.27:0/275293235 conn(0x7f50e40780d0 msgr2=0x7f50e4104470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:43.683 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 1 -- 10.20.193.27:0/275293235 shutdown_connections 2026-02-19T08:24:43.683 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.679+0000 7f50ea6e4640 1 -- 10.20.193.27:0/275293235 wait complete. 2026-02-19T08:24:43.687 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.684+0000 7f0e6667a640 1 -- 10.20.193.27:0/3740255525 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0e6010aaa0 con 0x7f0e6010a640 2026-02-19T08:24:43.688 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.684+0000 7f0e5d7fa640 1 -- 10.20.193.27:0/3740255525 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e4c0389d0 con 0x7f0e6010a640 2026-02-19T08:24:43.688 INFO:teuthology.orchestra.run.trial027.stdout:77309411332 2026-02-19T08:24:43.689 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 10 mgrc shutdown 2026-02-19T08:24:43.690 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 1 -- 10.20.193.27:0/3740255525 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0e3403df10 msgr2=0x7f0e340403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:43.690 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 1 --2- 10.20.193.27:0/3740255525 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0e3403df10 0x7f0e340403d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0e500099c0 tx=0x7f0e50006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.690 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 1 -- 10.20.193.27:0/3740255525 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0e6010a640 msgr2=0x7f0e6019b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:43.690 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 1 --2- 10.20.193.27:0/3740255525 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0e6010a640 0x7f0e6019b690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c002410 tx=0x7f0e4c004290 comp rx=0 tx=0).stop 2026-02-19T08:24:43.690 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 1 -- 10.20.193.27:0/3740255525 shutdown_connections 2026-02-19T08:24:43.690 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 1 --2- 10.20.193.27:0/3740255525 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f0e3403df10 0x7f0e340403d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.690 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 1 --2- 10.20.193.27:0/3740255525 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0e6010a640 0x7f0e6019b690 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:43.690 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 1 -- 10.20.193.27:0/3740255525 >> 10.20.193.27:0/3740255525 conn(0x7f0e601006d0 msgr2=0x7f0e60106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:43.690 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 1 -- 10.20.193.27:0/3740255525 shutdown_connections 2026-02-19T08:24:43.690 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:43.685+0000 7f0e6667a640 1 -- 10.20.193.27:0/3740255525 wait complete. 2026-02-19T08:24:43.721 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2026-02-19T08:24:43.721 DEBUG:teuthology.parallel:result is None 2026-02-19T08:24:43.728 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411332 for osd.2 2026-02-19T08:24:43.728 DEBUG:teuthology.parallel:result is None 2026-02-19T08:24:43.729 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-19T08:24:43.729 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph pg dump --format=json 2026-02-19T08:24:43.790 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:43 trial027 ceph-mon[21739]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T08:24:43.790 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:43 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1750681030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-19T08:24:43.919 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:44.016 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 -- 10.20.193.27:0/1997888386 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0a28103230 msgr2=0x7f0a28103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:44.016 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 --2- 10.20.193.27:0/1997888386 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0a28103230 0x7f0a28103610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0099b0 tx=0x7f0a1c02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 -- 10.20.193.27:0/1997888386 shutdown_connections 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 --2- 10.20.193.27:0/1997888386 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0a28103230 0x7f0a28103610 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 -- 10.20.193.27:0/1997888386 >> 10.20.193.27:0/1997888386 conn(0x7f0a280fc6a0 msgr2=0x7f0a280feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 -- 10.20.193.27:0/1997888386 shutdown_connections 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 -- 10.20.193.27:0/1997888386 wait complete. 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 Processor -- start 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 -- start start 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0a28103230 0x7f0a2819b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a2d300640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2810e0a0 con 0x7f0a28103230 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a26ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0a28103230 0x7f0a2819b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a26ffd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0a28103230 0x7f0a2819b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57612/0 (socket says 10.20.193.27:57612) 2026-02-19T08:24:44.017 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a26ffd640 1 -- 10.20.193.27:0/2222152524 learned_addr learned my addr 10.20.193.27:0/2222152524 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a26ffd640 1 -- 10.20.193.27:0/2222152524 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2819bbe0 con 0x7f0a28103230 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.011+0000 7f0a26ffd640 1 --2- 10.20.193.27:0/2222152524 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0a28103230 0x7f0a2819b6a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c004290 tx=0x7f0a1c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a07fff640 1 -- 10.20.193.27:0/2222152524 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1c038510 con 0x7f0a28103230 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a07fff640 1 -- 10.20.193.27:0/2222152524 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0a1c046070 con 0x7f0a28103230 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a2d300640 1 -- 10.20.193.27:0/2222152524 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2819be70 con 0x7f0a28103230 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a07fff640 1 -- 10.20.193.27:0/2222152524 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1c041610 con 0x7f0a28103230 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a2d300640 1 -- 10.20.193.27:0/2222152524 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2819c2d0 con 0x7f0a28103230 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a2d300640 1 -- 10.20.193.27:0/2222152524 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a281019d0 con 0x7f0a28103230 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a07fff640 1 -- 10.20.193.27:0/2222152524 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f0a1c0386b0 con 0x7f0a28103230 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a07fff640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a07fff640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:44.018 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a07fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:44.019 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a07fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:44.019 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a07fff640 1 --2- 10.20.193.27:0/2222152524 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f09fc03df10 0x7f09fc0403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:44.019 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a07fff640 1 -- 10.20.193.27:0/2222152524 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f0a1c077b10 con 0x7f0a28103230 2026-02-19T08:24:44.019 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.012+0000 7f0a267fc640 1 --2- 10.20.193.27:0/2222152524 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f09fc03df10 0x7f09fc0403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:44.019 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.013+0000 7f0a267fc640 1 --2- 10.20.193.27:0/2222152524 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f09fc03df10 0x7f09fc0403d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a100099c0 tx=0x7f0a10006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:44.019 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.015+0000 7f0a07fff640 1 -- 10.20.193.27:0/2222152524 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0a1c049360 con 0x7f0a28103230 2026-02-19T08:24:44.103 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.100+0000 7f0a2d300640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-19T08:24:44.104 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.100+0000 7f0a2d300640 1 -- 10.20.193.27:0/2222152524 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a2819ca00 con 0x7f09fc03df10 2026-02-19T08:24:44.104 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.100+0000 7f0a07fff640 1 -- 10.20.193.27:0/2222152524 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9926 (secure 0 0 0) 0x7f0a2819ca00 con 0x7f09fc03df10 2026-02-19T08:24:44.104 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.100+0000 7f0a07fff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:24:44.105 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:44.106 INFO:teuthology.orchestra.run.trial027.stderr:dumped all 2026-02-19T08:24:44.106 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 10 mgrc shutdown 2026-02-19T08:24:44.106 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 1 -- 10.20.193.27:0/2222152524 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f09fc03df10 msgr2=0x7f09fc0403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:44.106 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 1 --2- 10.20.193.27:0/2222152524 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f09fc03df10 0x7f09fc0403d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a100099c0 tx=0x7f0a10006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.106 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 1 -- 10.20.193.27:0/2222152524 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0a28103230 msgr2=0x7f0a2819b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:44.106 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 1 --2- 10.20.193.27:0/2222152524 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0a28103230 0x7f0a2819b6a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c004290 tx=0x7f0a1c0042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.106 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 1 -- 10.20.193.27:0/2222152524 shutdown_connections 2026-02-19T08:24:44.106 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 1 --2- 10.20.193.27:0/2222152524 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f09fc03df10 0x7f09fc0403d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.106 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 1 --2- 10.20.193.27:0/2222152524 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f0a28103230 0x7f0a2819b6a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.107 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 1 -- 10.20.193.27:0/2222152524 >> 10.20.193.27:0/2222152524 conn(0x7f0a280fc6a0 msgr2=0x7f0a2810c810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:44.107 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 1 -- 10.20.193.27:0/2222152524 shutdown_connections 2026-02-19T08:24:44.107 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.101+0000 7f0a2d300640 1 -- 10.20.193.27:0/2222152524 wait complete. 2026-02-19T08:24:44.141 INFO:teuthology.orchestra.run.trial027.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2026-02-19T08:24:42.273214+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":83856,"kb_used_data":2268,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":2201925744,"statfs":{"total":2254857830400,"available":2254771961856,"internally_reserved":0,"allocated":2322432,"data_stored":1929540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":82767187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"20'72","reported_seq":103,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-19T08:24:40.840030+0000","last_change":"2026-02-19T08:24:40.061004+0000","last_active":"2026-02-19T08:24:40.840030+0000","last_peered":"2026-02-19T08:24:40.840030+0000","last_clean":"2026-02-19T08:24:40.840030+0000","last_became_active":"2026-02-19T08:24:40.060349+0000","last_became_peered":"2026-02-19T08:24:40.060349+0000","last_unstale":"2026-02-19T08:24:40.840030+0000","last_undegraded":"2026-02-19T08:24:40.840030+0000","last_fullsized":"2026-02-19T08:24:40.840030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T08:24:38.614385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T08:24:38.614385+0000","last_clean_scrub_stamp":"2026-02-19T08:24:38.614385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T09:24:27.838189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411332,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27912,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975288,"statfs":{"total":751619276800,"available":751590694912,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-19T08:24:44.142 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph pg dump --format=json 2026-02-19T08:24:44.327 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:44.427 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 -- 10.20.193.27:0/3979273106 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f454010a640 msgr2=0x7f454010aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:44.428 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 --2- 10.20.193.27:0/3979273106 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f454010a640 0x7f454010aa20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f45340099b0 tx=0x7f453402f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.428 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 -- 10.20.193.27:0/3979273106 shutdown_connections 2026-02-19T08:24:44.428 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 --2- 10.20.193.27:0/3979273106 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f454010a640 0x7f454010aa20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.428 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 -- 10.20.193.27:0/3979273106 >> 10.20.193.27:0/3979273106 conn(0x7f45401006d0 msgr2=0x7f4540102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:44.428 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 -- 10.20.193.27:0/3979273106 shutdown_connections 2026-02-19T08:24:44.428 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 -- 10.20.193.27:0/3979273106 wait complete. 2026-02-19T08:24:44.428 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 Processor -- start 2026-02-19T08:24:44.428 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 -- start start 2026-02-19T08:24:44.428 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f454010a640 0x7f454019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:44.428 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.422+0000 7f4545336640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7f454010e050 con 0x7f454010a640 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f453effd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f454010a640 0x7f454019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f453effd640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f454010a640 0x7f454019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57628/0 (socket says 10.20.193.27:57628) 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f453effd640 1 -- 10.20.193.27:0/1289893479 learned_addr learned my addr 10.20.193.27:0/1289893479 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f453effd640 1 -- 10.20.193.27:0/1289893479 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454019bb90 con 0x7f454010a640 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f453effd640 1 --2- 10.20.193.27:0/1289893479 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f454010a640 0x7f454019b650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4534002410 tx=0x7f4534004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f451ffff640 1 -- 10.20.193.27:0/1289893479 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4534038510 con 0x7f454010a640 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f451ffff640 1 -- 10.20.193.27:0/1289893479 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f4534046070 con 0x7f454010a640 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f4545336640 1 -- 10.20.193.27:0/1289893479 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454019be20 con 0x7f454010a640 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f451ffff640 1 -- 10.20.193.27:0/1289893479 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4534041630 con 0x7f454010a640 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f4545336640 1 -- 10.20.193.27:0/1289893479 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454019ff20 con 0x7f454010a640 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f4545336640 1 -- 10.20.193.27:0/1289893479 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4540105d80 con 0x7f454010a640 2026-02-19T08:24:44.429 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f451ffff640 1 -- 10.20.193.27:0/1289893479 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f45340386b0 con 0x7f454010a640 2026-02-19T08:24:44.430 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.423+0000 7f451ffff640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:44.430 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.424+0000 7f451ffff640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:44.430 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.424+0000 7f451ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:44.430 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.424+0000 7f451ffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:44.430 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.424+0000 7f451ffff640 1 --2- 10.20.193.27:0/1289893479 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f451003df10 0x7f45100403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:44.430 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.424+0000 7f451ffff640 1 -- 10.20.193.27:0/1289893479 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f4534077b00 con 0x7f454010a640 2026-02-19T08:24:44.430 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.424+0000 7f453e7fc640 1 --2- 10.20.193.27:0/1289893479 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f451003df10 0x7f45100403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:44.430 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.424+0000 7f453e7fc640 1 --2- 10.20.193.27:0/1289893479 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f451003df10 0x7f45100403d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45280099c0 tx=0x7f4528006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:44.431 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.426+0000 7f451ffff640 1 -- 10.20.193.27:0/1289893479 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4534007c50 con 0x7f454010a640 2026-02-19T08:24:44.512 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.508+0000 7f4545336640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-19T08:24:44.512 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.508+0000 7f4545336640 1 -- 10.20.193.27:0/1289893479 --> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f454010aaa0 con 0x7f451003df10 2026-02-19T08:24:44.512 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.508+0000 7f451ffff640 1 -- 10.20.193.27:0/1289893479 <== mgr.14150 v2:10.20.193.27:6800/111887651 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9882 (secure 0 0 0) 0x7f454010aaa0 con 0x7f451003df10 2026-02-19T08:24:44.512 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.508+0000 7f451ffff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-19T08:24:44.513 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:44.514 INFO:teuthology.orchestra.run.trial027.stderr:dumped all 2026-02-19T08:24:44.514 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 10 mgrc shutdown 2026-02-19T08:24:44.514 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 1 -- 10.20.193.27:0/1289893479 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f451003df10 msgr2=0x7f45100403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:44.514 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 1 --2- 10.20.193.27:0/1289893479 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f451003df10 0x7f45100403d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45280099c0 tx=0x7f4528006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.514 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 1 -- 10.20.193.27:0/1289893479 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f454010a640 msgr2=0x7f454019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:44.515 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 1 --2- 10.20.193.27:0/1289893479 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f454010a640 0x7f454019b650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4534002410 tx=0x7f4534004290 comp rx=0 tx=0).stop 2026-02-19T08:24:44.515 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 1 -- 10.20.193.27:0/1289893479 shutdown_connections 2026-02-19T08:24:44.515 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 1 --2- 10.20.193.27:0/1289893479 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7f451003df10 0x7f45100403d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.515 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 1 --2- 10.20.193.27:0/1289893479 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7f454010a640 0x7f454019b650 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.515 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 1 -- 10.20.193.27:0/1289893479 >> 10.20.193.27:0/1289893479 conn(0x7f45401006d0 msgr2=0x7f4540106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:44.515 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 1 -- 10.20.193.27:0/1289893479 shutdown_connections 2026-02-19T08:24:44.515 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.509+0000 7f4545336640 1 -- 10.20.193.27:0/1289893479 wait complete. 2026-02-19T08:24:44.547 INFO:teuthology.orchestra.run.trial027.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2026-02-19T08:24:44.273402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":83856,"kb_used_data":2268,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":2201925744,"statfs":{"total":2254857830400,"available":2254771961856,"internally_reserved":0,"allocated":2322432,"data_stored":1929540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":82767187},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000187"},"pg_stats":[{"pgid":"1.0","version":"20'72","reported_seq":103,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-19T08:24:40.840030+0000","last_change":"2026-02-19T08:24:40.061004+0000","last_active":"2026-02-19T08:24:40.840030+0000","last_peered":"2026-02-19T08:24:40.840030+0000","last_clean":"2026-02-19T08:24:40.840030+0000","last_became_active":"2026-02-19T08:24:40.060349+0000","last_became_peered":"2026-02-19T08:24:40.060349+0000","last_unstale":"2026-02-19T08:24:40.840030+0000","last_undegraded":"2026-02-19T08:24:40.840030+0000","last_fullsized":"2026-02-19T08:24:40.840030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T08:24:38.614385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T08:24:38.614385+0000","last_clean_scrub_stamp":"2026-02-19T08:24:38.614385+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T09:24:27.838189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411333,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27912,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975288,"statfs":{"total":751619276800,"available":751590694912,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-19T08:24:44.548 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-19T08:24:44.548 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-19T08:24:44.548 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-19T08:24:44.548 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid 3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460 -- ceph health --format=json 2026-02-19T08:24:44.698 INFO:teuthology.orchestra.run.trial027.stderr:Inferring config /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/mon.a/config 2026-02-19T08:24:44.801 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.795+0000 7fbb9407e640 1 -- 10.20.193.27:0/2496318788 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fbb8c10a640 msgr2=0x7fbb8c10aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:44.801 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.795+0000 7fbb9407e640 1 --2- 10.20.193.27:0/2496318788 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fbb8c10a640 0x7fbb8c10aa20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c0099b0 tx=0x7fbb7c02f2b0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.801 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.795+0000 7fbb9407e640 1 -- 10.20.193.27:0/2496318788 shutdown_connections 2026-02-19T08:24:44.801 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.795+0000 7fbb9407e640 1 --2- 10.20.193.27:0/2496318788 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fbb8c10a640 0x7fbb8c10aa20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.801 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.795+0000 7fbb9407e640 1 -- 10.20.193.27:0/2496318788 >> 10.20.193.27:0/2496318788 conn(0x7fbb8c1006d0 msgr2=0x7fbb8c102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:44.801 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.795+0000 7fbb9407e640 1 -- 10.20.193.27:0/2496318788 shutdown_connections 2026-02-19T08:24:44.801 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.795+0000 7fbb9407e640 1 -- 10.20.193.27:0/2496318788 wait complete. 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb9407e640 1 Processor -- start 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb9407e640 1 -- start start 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb9407e640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fbb8c10a640 0x7fbb8c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb9407e640 1 -- --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c10e050 con 0x7fbb8c10a640 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb91df3640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fbb8c10a640 0x7fbb8c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb91df3640 1 --2- >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fbb8c10a640 0x7fbb8c19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.27:3300/0 says I am v2:10.20.193.27:57646/0 (socket says 10.20.193.27:57646) 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb91df3640 1 -- 10.20.193.27:0/1758826887 learned_addr learned my addr 10.20.193.27:0/1758826887 (peer_addr_for_me v2:10.20.193.27:0/0) 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb91df3640 1 -- 10.20.193.27:0/1758826887 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c19bb90 con 0x7fbb8c10a640 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb91df3640 1 --2- 10.20.193.27:0/1758826887 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fbb8c10a640 0x7fbb8c19b650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c004290 tx=0x7fbb7c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb7affd640 1 -- 10.20.193.27:0/1758826887 <== mon.0 v2:10.20.193.27:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb7c038510 con 0x7fbb8c10a640 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb7affd640 1 -- 10.20.193.27:0/1758826887 <== mon.0 v2:10.20.193.27:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fbb7c046070 con 0x7fbb8c10a640 2026-02-19T08:24:44.802 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb9407e640 1 -- 10.20.193.27:0/1758826887 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8c19be20 con 0x7fbb8c10a640 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb7affd640 1 -- 10.20.193.27:0/1758826887 <== mon.0 v2:10.20.193.27:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb7c041610 con 0x7fbb8c10a640 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.796+0000 7fbb9407e640 1 -- 10.20.193.27:0/1758826887 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8c19ff20 con 0x7fbb8c10a640 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.797+0000 7fbb9407e640 1 -- 10.20.193.27:0/1758826887 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8c105d80 con 0x7fbb8c10a640 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.797+0000 7fbb7affd640 1 -- 10.20.193.27:0/1758826887 <== mon.0 v2:10.20.193.27:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7fbb7c0386b0 con 0x7fbb8c10a640 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.797+0000 7fbb7affd640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.797+0000 7fbb7affd640 4 mgrc handle_mgr_map Got map version 14 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.797+0000 7fbb7affd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.797+0000 7fbb7affd640 4 mgrc reconnect Starting new session with [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.797+0000 7fbb7affd640 1 --2- 10.20.193.27:0/1758826887 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fbb6803dec0 0x7fbb68040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.797+0000 7fbb7affd640 1 -- 10.20.193.27:0/1758826887 <== mon.0 v2:10.20.193.27:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7fbb7c077ba0 con 0x7fbb8c10a640 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.797+0000 7fbb915f2640 1 --2- 10.20.193.27:0/1758826887 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fbb6803dec0 0x7fbb68040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T08:24:44.803 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.797+0000 7fbb915f2640 1 --2- 10.20.193.27:0/1758826887 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fbb6803dec0 0x7fbb68040380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbb800099c0 tx=0x7fbb80006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T08:24:44.804 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.800+0000 7fbb7affd640 1 -- 10.20.193.27:0/1758826887 <== mon.0 v2:10.20.193.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbb7c040360 con 0x7fbb8c10a640 2026-02-19T08:24:44.903 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.899+0000 7fbb9407e640 1 -- 10.20.193.27:0/1758826887 --> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb8c10aaa0 con 0x7fbb8c10a640 2026-02-19T08:24:44.903 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:44 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/275293235' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-19T08:24:44.903 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:44 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/3740255525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-19T08:24:44.904 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.899+0000 7fbb7affd640 1 -- 10.20.193.27:0/1758826887 <== mon.0 v2:10.20.193.27:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbb7c049360 con 0x7fbb8c10a640 2026-02-19T08:24:44.904 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:44.904 INFO:teuthology.orchestra.run.trial027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-19T08:24:44.905 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 10 mgrc shutdown 2026-02-19T08:24:44.905 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 1 -- 10.20.193.27:0/1758826887 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fbb6803dec0 msgr2=0x7fbb68040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:44.905 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 1 --2- 10.20.193.27:0/1758826887 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fbb6803dec0 0x7fbb68040380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbb800099c0 tx=0x7fbb80006eb0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.905 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 1 -- 10.20.193.27:0/1758826887 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fbb8c10a640 msgr2=0x7fbb8c19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T08:24:44.905 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 1 --2- 10.20.193.27:0/1758826887 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fbb8c10a640 0x7fbb8c19b650 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c004290 tx=0x7fbb7c0042c0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.906 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 1 -- 10.20.193.27:0/1758826887 shutdown_connections 2026-02-19T08:24:44.906 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 1 --2- 10.20.193.27:0/1758826887 >> [v2:10.20.193.27:6800/111887651,v1:10.20.193.27:6801/111887651] conn(0x7fbb6803dec0 0x7fbb68040380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.906 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 1 --2- 10.20.193.27:0/1758826887 >> [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] conn(0x7fbb8c10a640 0x7fbb8c19b650 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T08:24:44.906 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 1 -- 10.20.193.27:0/1758826887 >> 10.20.193.27:0/1758826887 conn(0x7fbb8c1006d0 msgr2=0x7fbb8c106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T08:24:44.906 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 1 -- 10.20.193.27:0/1758826887 shutdown_connections 2026-02-19T08:24:44.906 INFO:teuthology.orchestra.run.trial027.stderr:2026-02-19T08:24:44.900+0000 7fbb9407e640 1 -- 10.20.193.27:0/1758826887 wait complete. 2026-02-19T08:24:44.938 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-19T08:24:44.938 INFO:tasks.cephadm:Setup complete, yielding 2026-02-19T08:24:44.939 INFO:teuthology.run_tasks:Running task ceph... 2026-02-19T08:24:44.955 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-19T08:24:44.955 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(OSD_DOWN\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-19T08:24:44.956 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-19_08:14:16-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/57864', 'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'description': 'rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '57864', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-19_08:14:16-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 60, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'], ['host.b', 'client.1']], 'seed': 3603, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'targets': {'trial027.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDpsvHLBGvB8wRDBJv3XsVD1ISmy0zmfx0WvqA80W+KMh00+02rbc441rQRBvt1pQiGCawiUBh7ERhSNyx23r24=', 'trial116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEleG5PWj5yDzbuNjjGYs0fjh//dei5RlcvD1d7mz1zDCLZpac+7tPuZJQhN5/HqFPlBhEwW9NJGU2x76wtfGNA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'pexec': {'all': ['sudo dnf remove nvme-cli -y', 'sudo dnf install nvmetcli nvme-cli -y']}}, {'install': None}, {'cephadm': None}, {'ceph': {'log-ignorelist': ['\\(OSD_DOWN\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.1': ['cephadm/create_iscsi_disks.sh']}}}, {'workunit': {'clients': {'client.0': ['cephadm/test_dashboard_e2e.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-19_08:14:16', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-19T08:24:44.956 DEBUG:teuthology.orchestra.run.trial027:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-19T08:24:44.959 DEBUG:teuthology.orchestra.run.trial116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-19T08:24:44.977 DEBUG:teuthology.orchestra.run.trial027:> sudo install -d -m0777 -- /var/run/ceph 2026-02-19T08:24:45.015 DEBUG:teuthology.orchestra.run.trial116:> sudo install -d -m0777 -- /var/run/ceph 2026-02-19T08:24:45.042 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:24:45.042 DEBUG:teuthology.orchestra.run.trial027:> dd if=/scratch_devs of=/dev/stdout 2026-02-19T08:24:45.096 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-19T08:24:45.097 DEBUG:teuthology.orchestra.run.trial027:> stat /dev/vg_nvme/lv_1 2026-02-19T08:24:45.154 INFO:teuthology.orchestra.run.trial027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-19T08:24:45.154 INFO:teuthology.orchestra.run.trial027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:24:45.155 INFO:teuthology.orchestra.run.trial027.stdout:Device: 6h/6d Inode: 3538 Links: 1 2026-02-19T08:24:45.155 INFO:teuthology.orchestra.run.trial027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:24:45.155 INFO:teuthology.orchestra.run.trial027.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:24:45.155 INFO:teuthology.orchestra.run.trial027.stdout:Access: 2026-02-19 08:24:30.405672931 +0000 2026-02-19T08:24:45.155 INFO:teuthology.orchestra.run.trial027.stdout:Modify: 2026-02-19 08:24:29.673685612 +0000 2026-02-19T08:24:45.155 INFO:teuthology.orchestra.run.trial027.stdout:Change: 2026-02-19 08:24:29.673685612 +0000 2026-02-19T08:24:45.155 INFO:teuthology.orchestra.run.trial027.stdout: Birth: 2026-02-19 08:24:29.673685612 +0000 2026-02-19T08:24:45.156 DEBUG:teuthology.orchestra.run.trial027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-19T08:24:45.218 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records in 2026-02-19T08:24:45.218 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records out 2026-02-19T08:24:45.219 INFO:teuthology.orchestra.run.trial027.stderr:512 bytes copied, 0.000182388 s, 2.8 MB/s 2026-02-19T08:24:45.220 DEBUG:teuthology.orchestra.run.trial027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-19T08:24:45.278 DEBUG:teuthology.orchestra.run.trial027:> stat /dev/vg_nvme/lv_2 2026-02-19T08:24:45.334 INFO:teuthology.orchestra.run.trial027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-19T08:24:45.334 INFO:teuthology.orchestra.run.trial027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:24:45.334 INFO:teuthology.orchestra.run.trial027.stdout:Device: 6h/6d Inode: 3982 Links: 1 2026-02-19T08:24:45.335 INFO:teuthology.orchestra.run.trial027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:24:45.335 INFO:teuthology.orchestra.run.trial027.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:24:45.335 INFO:teuthology.orchestra.run.trial027.stdout:Access: 2026-02-19 08:24:35.123591199 +0000 2026-02-19T08:24:45.335 INFO:teuthology.orchestra.run.trial027.stdout:Modify: 2026-02-19 08:24:35.122591216 +0000 2026-02-19T08:24:45.335 INFO:teuthology.orchestra.run.trial027.stdout:Change: 2026-02-19 08:24:35.122591216 +0000 2026-02-19T08:24:45.335 INFO:teuthology.orchestra.run.trial027.stdout: Birth: 2026-02-19 08:24:35.122591216 +0000 2026-02-19T08:24:45.335 DEBUG:teuthology.orchestra.run.trial027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-19T08:24:45.397 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records in 2026-02-19T08:24:45.397 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records out 2026-02-19T08:24:45.398 INFO:teuthology.orchestra.run.trial027.stderr:512 bytes copied, 0.000116867 s, 4.4 MB/s 2026-02-19T08:24:45.399 DEBUG:teuthology.orchestra.run.trial027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-19T08:24:45.455 DEBUG:teuthology.orchestra.run.trial027:> stat /dev/vg_nvme/lv_3 2026-02-19T08:24:45.512 INFO:teuthology.orchestra.run.trial027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-19T08:24:45.512 INFO:teuthology.orchestra.run.trial027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:24:45.512 INFO:teuthology.orchestra.run.trial027.stdout:Device: 6h/6d Inode: 3263 Links: 1 2026-02-19T08:24:45.512 INFO:teuthology.orchestra.run.trial027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:24:45.512 INFO:teuthology.orchestra.run.trial027.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:24:45.512 INFO:teuthology.orchestra.run.trial027.stdout:Access: 2026-02-19 08:24:30.405672931 +0000 2026-02-19T08:24:45.513 INFO:teuthology.orchestra.run.trial027.stdout:Modify: 2026-02-19 08:24:24.240779731 +0000 2026-02-19T08:24:45.513 INFO:teuthology.orchestra.run.trial027.stdout:Change: 2026-02-19 08:24:24.240779731 +0000 2026-02-19T08:24:45.513 INFO:teuthology.orchestra.run.trial027.stdout: Birth: 2026-02-19 08:24:24.240779731 +0000 2026-02-19T08:24:45.513 DEBUG:teuthology.orchestra.run.trial027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-19T08:24:45.575 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records in 2026-02-19T08:24:45.575 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records out 2026-02-19T08:24:45.575 INFO:teuthology.orchestra.run.trial027.stderr:512 bytes copied, 2.5898e-05 s, 19.8 MB/s 2026-02-19T08:24:45.576 DEBUG:teuthology.orchestra.run.trial027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-19T08:24:45.635 DEBUG:teuthology.orchestra.run.trial027:> stat /dev/vg_nvme/lv_4 2026-02-19T08:24:45.691 INFO:teuthology.orchestra.run.trial027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-19T08:24:45.692 INFO:teuthology.orchestra.run.trial027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T08:24:45.692 INFO:teuthology.orchestra.run.trial027.stdout:Device: 6h/6d Inode: 2393 Links: 1 2026-02-19T08:24:45.692 INFO:teuthology.orchestra.run.trial027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T08:24:45.692 INFO:teuthology.orchestra.run.trial027.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T08:24:45.692 INFO:teuthology.orchestra.run.trial027.stdout:Access: 2026-02-19 08:24:30.405672931 +0000 2026-02-19T08:24:45.692 INFO:teuthology.orchestra.run.trial027.stdout:Modify: 2026-02-19 08:24:12.910976004 +0000 2026-02-19T08:24:45.692 INFO:teuthology.orchestra.run.trial027.stdout:Change: 2026-02-19 08:24:12.910976004 +0000 2026-02-19T08:24:45.692 INFO:teuthology.orchestra.run.trial027.stdout: Birth: 2026-02-19 08:24:12.910976004 +0000 2026-02-19T08:24:45.693 DEBUG:teuthology.orchestra.run.trial027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-19T08:24:45.754 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records in 2026-02-19T08:24:45.754 INFO:teuthology.orchestra.run.trial027.stderr:1+0 records out 2026-02-19T08:24:45.755 INFO:teuthology.orchestra.run.trial027.stderr:512 bytes copied, 2.4847e-05 s, 20.6 MB/s 2026-02-19T08:24:45.756 DEBUG:teuthology.orchestra.run.trial027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-19T08:24:45.812 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-19T08:24:45.812 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-19T08:24:45.812 INFO:tasks.ceph:Generating config... 2026-02-19T08:24:45.813 INFO:tasks.ceph:[client] debug client = 20 2026-02-19T08:24:45.813 INFO:tasks.ceph:[client] debug mgrc = 20 2026-02-19T08:24:45.813 INFO:tasks.ceph:[client] debug ms = 1 2026-02-19T08:24:45.813 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-19T08:24:45.813 INFO:tasks.ceph:[mds] debug mgrc = 20 2026-02-19T08:24:45.813 INFO:tasks.ceph:[mgr] debug client = 20 2026-02-19T08:24:45.813 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-19T08:24:45.813 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-19T08:24:45.813 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-19T08:24:45.813 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-19T08:24:45.813 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-19T08:24:45.813 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-19T08:24:45.813 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-19T08:24:45.813 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] debug mgrc = 20 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-19T08:24:45.814 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-19T08:24:45.814 INFO:tasks.ceph:Setting up mon.a... 2026-02-19T08:24:45.814 DEBUG:teuthology.orchestra.run.trial027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-19T08:24:45.847 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:45 trial027 ceph-mon[21739]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T08:24:45.847 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:45 trial027 ceph-mon[21739]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T08:24:45.847 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:45 trial027 ceph-mon[21739]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T08:24:45.847 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:45 trial027 ceph-mon[21739]: from='client.? 10.20.193.27:0/1758826887' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-19T08:24:45.881 INFO:teuthology.orchestra.run.trial027.stdout:creating /etc/ceph/ceph.keyring 2026-02-19T08:24:45.883 DEBUG:teuthology.orchestra.run.trial027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-19T08:24:45.958 DEBUG:teuthology.orchestra.run.trial027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-19T08:24:46.022 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.27')] 2026-02-19T08:24:46.022 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.27', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'mon.a': {}, 'mds': {'debug mgrc': 20}} 2026-02-19T08:24:46.022 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:24:46.023 DEBUG:teuthology.orchestra.run.trial027:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-19T08:24:46.078 DEBUG:teuthology.orchestra.run.trial027:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.27 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:monmaptool: generated fsid b3d04205-c070-4fc5-9060-f7c7e46c1657 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:setting min_mon_release = quincy 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:epoch 0 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:fsid b3d04205-c070-4fc5-9060-f7c7e46c1657 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:last_changed 2026-02-19T08:24:46.148803+0000 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:created 2026-02-19T08:24:46.148803+0000 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:min_mon_release 17 (quincy) 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:election_strategy: 3 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:0: [v2:10.20.193.27:3300/0,v1:10.20.193.27:6789/0] mon.a 2026-02-19T08:24:46.151 INFO:teuthology.orchestra.run.trial027.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-19T08:24:46.153 DEBUG:teuthology.orchestra.run.trial027:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-19T08:24:46.208 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b3d04205-c070-4fc5-9060-f7c7e46c1657... 2026-02-19T08:24:46.208 DEBUG:teuthology.orchestra.run.trial027:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-19T08:24:46.250 DEBUG:teuthology.orchestra.run.trial116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout:[global] 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: chdir = "" 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: auth supported = cephx 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: filestore xattr use omap = true 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon clock drift allowed = 1.000 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: osd crush chooseleaf type = 0 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: auth debug = true 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: ms die on old message = true 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: ms die on bug = true 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon pg warn max object skew = 0 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: # disable pg_autoscaler by default for new pools 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: osd pool default size = 2 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon osd allow primary affinity = true 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon osd allow pg remap = true 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon warn on legacy crush tunables = false 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon warn on crush straw calc version zero = false 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon warn on no sortbitwise = false 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon warn on osd down out interval zero = false 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon warn on too few osds = false 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: mon_allow_pool_size_one = true 2026-02-19T08:24:46.287 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd default data pool replay window = 5 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: mon allow pool delete = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: mon cluster log file level = debug 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: debug asserts on shutdown = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: mon health detail to clog = false 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: mon host = 10.20.193.27 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: mon election default strategy = 3 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: fsid = b3d04205-c070-4fc5-9060-f7c7e46c1657 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout:[osd] 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd journal size = 100 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd scrub load threshold = 5.0 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd scrub max interval = 600 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd mclock profile = high_recovery_ops 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd recover clone overlap = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd recovery max chunk = 1048576 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd debug shutdown = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd debug op order = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd debug verify stray on activate = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd debug trim objects = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd open classes on start = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd debug pg log writeout = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd deep scrub update digest min age = 30 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd map max advance = 10 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: journal zero on create = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: filestore ondisk finisher threads = 3 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: filestore apply finisher threads = 3 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: bdev debug aio = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: osd debug misdirected ops = true 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: bdev async discard = True 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: bdev enable discard = True 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: bluestore allocator = stupid 2026-02-19T08:24:46.288 INFO:teuthology.orchestra.run.trial027.stdout: bluestore block size = 96636764160 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: bluestore fsck on mount = True 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug bluefs = 1/20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug bluestore = 1/20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug mgrc = 20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug ms = 1 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug osd = 20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug rocksdb = 4/10 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon osd backfillfull_ratio = 0.85 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon osd full ratio = 0.9 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon osd nearfull ratio = 0.8 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: osd failsafe full ratio = 0.95 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: osd objectstore = bluestore 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout:[mgr] 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug ms = 1 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug mgr = 20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug mon = 20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug auth = 20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon reweight min pgs per osd = 4 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon reweight min bytes per osd = 10 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mgr/telemetry/nag = false 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug client = 20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout:[mon] 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug ms = 1 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug mon = 20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug paxos = 20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: debug auth = 20 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon data avail warn = 5 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon mgr mkfs grace = 240 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon reweight min pgs per osd = 4 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon osd reporter subtree level = osd 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon osd prime pg temp = true 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon reweight min bytes per osd = 10 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: auth mon ticket ttl = 660 # 11m 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: auth service ticket ttl = 240 # 4m 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: # don't complain about insecure global_id in the test suite 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: # 1m isn't quite enough 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon_down_mkfs_grace = 2m 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.289 INFO:teuthology.orchestra.run.trial027.stdout: mon_warn_on_filestore_osds = false 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout: 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout:[client] 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout: rgw cache enabled = true 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout: rgw enable ops log = true 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout: rgw enable usage log = true 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout: debug client = 20 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout: debug mgrc = 20 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout: debug ms = 1 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout:[mon.a] 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout:[mds] 2026-02-19T08:24:46.290 INFO:teuthology.orchestra.run.trial027.stdout: debug mgrc = 20 2026-02-19T08:24:46.291 INFO:teuthology.orchestra.run.trial116.stdout:[global] 2026-02-19T08:24:46.291 INFO:teuthology.orchestra.run.trial116.stdout: chdir = "" 2026-02-19T08:24:46.291 INFO:teuthology.orchestra.run.trial116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-19T08:24:46.291 INFO:teuthology.orchestra.run.trial116.stdout: auth supported = cephx 2026-02-19T08:24:46.291 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: filestore xattr use omap = true 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon clock drift allowed = 1.000 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: osd crush chooseleaf type = 0 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: auth debug = true 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: ms die on old message = true 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: ms die on bug = true 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon pg warn max object skew = 0 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: # disable pg_autoscaler by default for new pools 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: osd pool default size = 2 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon osd allow primary affinity = true 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon osd allow pg remap = true 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon warn on legacy crush tunables = false 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon warn on crush straw calc version zero = false 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon warn on no sortbitwise = false 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon warn on osd down out interval zero = false 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon warn on too few osds = false 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon_allow_pool_size_one = true 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: osd default data pool replay window = 5 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon allow pool delete = true 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon cluster log file level = debug 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: debug asserts on shutdown = true 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon health detail to clog = false 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon host = 10.20.193.27 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: mon election default strategy = 3 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: fsid = b3d04205-c070-4fc5-9060-f7c7e46c1657 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout:[osd] 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: osd journal size = 100 2026-02-19T08:24:46.292 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd scrub load threshold = 5.0 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd scrub max interval = 600 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd mclock profile = high_recovery_ops 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd recover clone overlap = true 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd recovery max chunk = 1048576 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd debug shutdown = true 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd debug op order = true 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd debug verify stray on activate = true 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd debug trim objects = true 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd open classes on start = true 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd debug pg log writeout = true 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd deep scrub update digest min age = 30 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd map max advance = 10 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: journal zero on create = true 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: filestore ondisk finisher threads = 3 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: filestore apply finisher threads = 3 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: bdev debug aio = true 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd debug misdirected ops = true 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: bdev async discard = True 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: bdev enable discard = True 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: bluestore allocator = stupid 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: bluestore block size = 96636764160 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: bluestore fsck on mount = True 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: debug bluefs = 1/20 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: debug bluestore = 1/20 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: debug mgrc = 20 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: debug ms = 1 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: debug osd = 20 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: debug rocksdb = 4/10 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: mon osd backfillfull_ratio = 0.85 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: mon osd full ratio = 0.9 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: mon osd nearfull ratio = 0.8 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd failsafe full ratio = 0.95 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: osd objectstore = bluestore 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout:[mgr] 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: debug ms = 1 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: debug mgr = 20 2026-02-19T08:24:46.293 INFO:teuthology.orchestra.run.trial116.stdout: debug mon = 20 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: debug auth = 20 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon reweight min pgs per osd = 4 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon reweight min bytes per osd = 10 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mgr/telemetry/nag = false 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: debug client = 20 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout:[mon] 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: debug ms = 1 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: debug mon = 20 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: debug paxos = 20 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: debug auth = 20 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon data avail warn = 5 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon mgr mkfs grace = 240 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon reweight min pgs per osd = 4 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon osd reporter subtree level = osd 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon osd prime pg temp = true 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon reweight min bytes per osd = 10 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: auth mon ticket ttl = 660 # 11m 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: auth service ticket ttl = 240 # 4m 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: # don't complain about insecure global_id in the test suite 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: # 1m isn't quite enough 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon_down_mkfs_grace = 2m 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: mon_warn_on_filestore_osds = false 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout:[client] 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: rgw cache enabled = true 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: rgw enable ops log = true 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: rgw enable usage log = true 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: debug client = 20 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: debug mgrc = 20 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: debug ms = 1 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout:[mon.a] 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout:[mds] 2026-02-19T08:24:46.294 INFO:teuthology.orchestra.run.trial116.stdout: debug mgrc = 20 2026-02-19T08:24:46.303 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-19T08:24:46.304 DEBUG:teuthology.orchestra.run.trial027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-19T08:24:46.378 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-19T08:24:46.378 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:24:46.378 DEBUG:teuthology.orchestra.run.trial027:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-19T08:24:46.435 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:24:46.435 DEBUG:teuthology.orchestra.run.trial027:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-19T08:24:46.490 INFO:tasks.ceph:Sending monmap to node ubuntu@trial027.front.sepia.ceph.com 2026-02-19T08:24:46.490 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:24:46.491 DEBUG:teuthology.orchestra.run.trial027:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-19T08:24:46.491 DEBUG:teuthology.orchestra.run.trial027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-19T08:24:46.564 DEBUG:teuthology.orchestra.run.trial027:> set -ex 2026-02-19T08:24:46.564 DEBUG:teuthology.orchestra.run.trial027:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-19T08:24:46.620 INFO:tasks.ceph:Sending monmap to node ubuntu@trial116.front.sepia.ceph.com 2026-02-19T08:24:46.620 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:24:46.620 DEBUG:teuthology.orchestra.run.trial116:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-19T08:24:46.621 DEBUG:teuthology.orchestra.run.trial116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-19T08:24:46.655 DEBUG:teuthology.orchestra.run.trial116:> set -ex 2026-02-19T08:24:46.655 DEBUG:teuthology.orchestra.run.trial116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-19T08:24:46.711 INFO:tasks.ceph:Setting up mon nodes... 2026-02-19T08:24:46.712 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-19T08:24:46.712 DEBUG:teuthology.orchestra.run.trial027:> sudo mkdir -p /var/lib/ceph/mgr/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.a /var/lib/ceph/mgr/ceph-a/keyring 2026-02-19T08:24:46.754 INFO:teuthology.orchestra.run.trial027.stdout:creating /var/lib/ceph/mgr/ceph-a/keyring 2026-02-19T08:24:46.757 INFO:tasks.ceph:Setting up mds nodes... 2026-02-19T08:24:46.757 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-19T08:24:46.757 DEBUG:teuthology.orchestra.run.trial027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-19T08:24:46.831 INFO:teuthology.orchestra.run.trial027.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-19T08:24:46.842 DEBUG:teuthology.orchestra.run.trial116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-19T08:24:46.878 INFO:teuthology.orchestra.run.trial116.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-19T08:24:46.889 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-19T08:24:46.890 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial027.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-19T08:24:46.890 DEBUG:teuthology.orchestra.run.trial027:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-19T08:24:46.914 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-19T08:24:46.914 INFO:tasks.ceph:role: osd.0 2026-02-19T08:24:46.914 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial027.front.sepia.ceph.com 2026-02-19T08:24:46.914 DEBUG:teuthology.orchestra.run.trial027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-19T08:24:46.979 INFO:teuthology.orchestra.run.trial027.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-19T08:24:46.979 INFO:teuthology.orchestra.run.trial027.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-19T08:24:46.979 INFO:teuthology.orchestra.run.trial027.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-19T08:24:46.979 INFO:teuthology.orchestra.run.trial027.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-19T08:24:46.979 INFO:teuthology.orchestra.run.trial027.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-19T08:24:46.979 INFO:teuthology.orchestra.run.trial027.stdout: = sunit=0 swidth=0 blks 2026-02-19T08:24:46.979 INFO:teuthology.orchestra.run.trial027.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-19T08:24:46.980 INFO:teuthology.orchestra.run.trial027.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-19T08:24:46.980 INFO:teuthology.orchestra.run.trial027.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-19T08:24:46.980 INFO:teuthology.orchestra.run.trial027.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-19T08:24:47.614 INFO:teuthology.orchestra.run.trial027.stdout:Discarding blocks...Done. 2026-02-19T08:24:47.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial027.front.sepia.ceph.com -o noatime 2026-02-19T08:24:47.616 DEBUG:teuthology.orchestra.run.trial027:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-19T08:24:47.698 DEBUG:teuthology.orchestra.run.trial027:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-19T08:24:47.766 DEBUG:teuthology.orchestra.run.trial027:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-19T08:24:47.831 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-19T08:24:47.831 INFO:tasks.ceph:role: osd.1 2026-02-19T08:24:47.831 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial027.front.sepia.ceph.com 2026-02-19T08:24:47.831 DEBUG:teuthology.orchestra.run.trial027:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-19T08:24:47.892 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:47 trial027 ceph-mon[21739]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T08:24:47.894 INFO:teuthology.orchestra.run.trial027.stderr:mkfs.xfs: cannot open /dev/vg_nvme/lv_2: Device or resource busy 2026-02-19T08:24:47.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:24:47.896 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048', '-f'] on /dev/vg_nvme/lv_2 on ubuntu@trial027.front.sepia.ceph.com 2026-02-19T08:24:47.897 DEBUG:teuthology.orchestra.run.trial027:> yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2 2026-02-19T08:24:47.960 INFO:teuthology.orchestra.run.trial027.stderr:mkfs.xfs: cannot open /dev/vg_nvme/lv_2: Device or resource busy 2026-02-19T08:24:47.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:24:47.962 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 924, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial027 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 30, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 931, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial027 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2' 2026-02-19T08:24:47.970 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 924, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial027 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 1919, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 30, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 931, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial027 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2' 2026-02-19T08:24:47.976 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-19T08:24:47.991 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-19T08:24:48.005 INFO:tasks.cephadm:Teardown begin 2026-02-19T08:24:48.006 DEBUG:teuthology.orchestra.run.trial027:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-19T08:24:48.030 DEBUG:teuthology.orchestra.run.trial116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-19T08:24:48.056 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-19T08:24:48.056 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-19T08:24:48.058 DEBUG:teuthology.misc:Transferring archived files from trial027:/var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_08:14:16-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/57864/remote/trial027/crash 2026-02-19T08:24:48.059 DEBUG:teuthology.orchestra.run.trial027:> sudo tar c -f - -C /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/crash -- . 2026-02-19T08:24:48.095 DEBUG:teuthology.misc:Transferring archived files from trial116:/var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_08:14:16-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/57864/remote/trial116/crash 2026-02-19T08:24:48.097 DEBUG:teuthology.orchestra.run.trial116:> sudo tar c -f - -C /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/crash -- . 2026-02-19T08:24:48.123 INFO:teuthology.orchestra.run.trial116.stderr:tar: /var/lib/ceph/3ae9aa8e-0d6c-11f1-89ae-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-19T08:24:48.123 INFO:teuthology.orchestra.run.trial116.stderr:tar: Error is not recoverable: exiting now 2026-02-19T08:24:48.124 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-19T08:24:48.124 INFO:tasks.cephadm:Removing cluster... 2026-02-19T08:24:48.124 DEBUG:teuthology.orchestra.run.trial027:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b3d04205-c070-4fc5-9060-f7c7e46c1657 --force 2026-02-19T08:24:48.247 INFO:teuthology.orchestra.run.trial027.stdout:Deleting cluster with fsid: b3d04205-c070-4fc5-9060-f7c7e46c1657 2026-02-19T08:24:48.326 DEBUG:teuthology.orchestra.run.trial116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b3d04205-c070-4fc5-9060-f7c7e46c1657 --force 2026-02-19T08:24:48.438 INFO:teuthology.orchestra.run.trial116.stdout:Deleting cluster with fsid: b3d04205-c070-4fc5-9060-f7c7e46c1657 2026-02-19T08:24:48.509 INFO:tasks.cephadm:Removing cephadm ... 2026-02-19T08:24:48.509 DEBUG:teuthology.orchestra.run.trial027:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-19T08:24:48.527 DEBUG:teuthology.orchestra.run.trial116:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-19T08:24:48.543 INFO:tasks.cephadm:Teardown complete 2026-02-19T08:24:48.543 ERROR:teuthology.run_tasks:Manager failed: cephadm Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-19T08:24:48.544 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-19T08:24:48.557 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-19T08:24:48.558 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-19T08:24:48.558 DEBUG:teuthology.orchestra.run.trial027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-19T08:24:48.570 DEBUG:teuthology.orchestra.run.trial116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-19T08:24:48.767 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-19T08:24:48.777 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-19T08:24:48.777 DEBUG:teuthology.orchestra.run.trial027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T08:24:48.779 DEBUG:teuthology.orchestra.run.trial116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T08:24:48.793 INFO:teuthology.orchestra.run.trial027.stderr:bash: line 1: ntpq: command not found 2026-02-19T08:24:48.796 INFO:teuthology.orchestra.run.trial116.stderr:bash: line 1: ntpq: command not found 2026-02-19T08:24:48.809 INFO:teuthology.orchestra.run.trial027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-19T08:24:48.809 INFO:teuthology.orchestra.run.trial027.stdout:=============================================================================== 2026-02-19T08:24:48.809 INFO:teuthology.orchestra.run.trial027.stdout:^- 45-79-189-79.ip.linodeus> 3 6 77 43 -1296us[-2104us] +/- 56ms 2026-02-19T08:24:48.809 INFO:teuthology.orchestra.run.trial027.stdout:^+ ntp1.wiktel.com 1 6 77 42 -2908us[-3720us] +/- 20ms 2026-02-19T08:24:48.809 INFO:teuthology.orchestra.run.trial027.stdout:^* wsip-24-249-17-252.dc.dc> 2 6 77 41 +2314us[+1499us] +/- 11ms 2026-02-19T08:24:48.809 INFO:teuthology.orchestra.run.trial027.stdout:^+ dug.arpnet.net 2 6 77 42 -1749us[-2558us] +/- 27ms 2026-02-19T08:24:48.811 INFO:teuthology.orchestra.run.trial116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-19T08:24:48.811 INFO:teuthology.orchestra.run.trial116.stdout:=============================================================================== 2026-02-19T08:24:48.811 INFO:teuthology.orchestra.run.trial116.stdout:^+ time.lmtlabs.com 2 6 77 42 +1746us[ +332us] +/- 14ms 2026-02-19T08:24:48.811 INFO:teuthology.orchestra.run.trial116.stdout:^- time2.trtnw.net 2 6 77 41 -1332us[-2750us] +/- 41ms 2026-02-19T08:24:48.811 INFO:teuthology.orchestra.run.trial116.stdout:^* time.cloudflare.com 3 6 77 41 -611us[-2037us] +/- 6468us 2026-02-19T08:24:48.811 INFO:teuthology.orchestra.run.trial116.stdout:^- 144.202.66.214.vultruser> 3 6 77 42 -294us[-1696us] +/- 33ms 2026-02-19T08:24:48.812 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-19T08:24:48.823 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-19T08:24:48.823 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-19T08:24:48.837 DEBUG:teuthology.orchestra.run.trial027:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-19T08:24:48.894 DEBUG:teuthology.orchestra.run.trial116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-19T08:24:48.937 DEBUG:teuthology.orchestra.run.trial027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-19T08:24:48.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:24:48.962 DEBUG:teuthology.orchestra.run.trial116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-19T08:24:49.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:24:49.003 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-19T08:24:49.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-19T08:24:49.033 INFO:teuthology.task.internal:Duration was 246.640989 seconds 2026-02-19T08:24:49.033 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-19T08:24:49.048 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-19T08:24:49.048 DEBUG:teuthology.orchestra.run.trial027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-19T08:24:49.051 DEBUG:teuthology.orchestra.run.trial116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-19T08:24:49.086 INFO:teuthology.orchestra.run.trial027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-19T08:24:49.089 INFO:teuthology.orchestra.run.trial116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-19T08:24:49.384 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-19T08:24:49.384 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial027.front.sepia.ceph.com 2026-02-19T08:24:49.384 DEBUG:teuthology.orchestra.run.trial027:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-19T08:24:49.444 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial116.front.sepia.ceph.com 2026-02-19T08:24:49.444 DEBUG:teuthology.orchestra.run.trial116:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-19T08:24:49.464 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-19T08:24:49.464 DEBUG:teuthology.orchestra.run.trial027:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T08:24:49.486 DEBUG:teuthology.orchestra.run.trial116:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T08:24:49.590 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-19T08:24:49.590 DEBUG:teuthology.orchestra.run.trial027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-19T08:24:49.593 DEBUG:teuthology.orchestra.run.trial116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-19T08:24:49.613 INFO:teuthology.orchestra.run.trial027.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T08:24:49.614 INFO:teuthology.orchestra.run.trial027.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T08:24:49.614 INFO:teuthology.orchestra.run.trial027.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-19T08:24:49.615 INFO:teuthology.orchestra.run.trial027.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T08:24:49.615 INFO:teuthology.orchestra.run.trial027.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-19T08:24:49.617 INFO:teuthology.orchestra.run.trial116.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T08:24:49.619 INFO:teuthology.orchestra.run.trial116.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T08:24:49.619 INFO:teuthology.orchestra.run.trial116.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-19T08:24:49.619 INFO:teuthology.orchestra.run.trial116.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T08:24:49.619 INFO:teuthology.orchestra.run.trial116.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-19T08:24:49.623 INFO:teuthology.orchestra.run.trial116.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-19T08:24:49.629 INFO:teuthology.orchestra.run.trial027.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-19T08:24:49.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-19T08:24:49.647 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-19T08:24:49.648 DEBUG:teuthology.orchestra.run.trial027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-19T08:24:49.696 DEBUG:teuthology.orchestra.run.trial116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-19T08:24:49.721 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-19T08:24:49.737 DEBUG:teuthology.orchestra.run.trial027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-19T08:24:49.740 DEBUG:teuthology.orchestra.run.trial116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-19T08:24:49.761 INFO:teuthology.orchestra.run.trial027.stdout:kernel.core_pattern = core 2026-02-19T08:24:49.785 INFO:teuthology.orchestra.run.trial116.stdout:kernel.core_pattern = core 2026-02-19T08:24:49.797 DEBUG:teuthology.orchestra.run.trial027:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-19T08:24:49.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:24:49.837 DEBUG:teuthology.orchestra.run.trial116:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-19T08:24:49.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:24:49.853 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-19T08:24:49.870 INFO:teuthology.task.internal:Transferring archived files... 2026-02-19T08:24:49.871 DEBUG:teuthology.misc:Transferring archived files from trial027:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_08:14:16-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/57864/remote/trial027 2026-02-19T08:24:49.871 DEBUG:teuthology.orchestra.run.trial027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-19T08:24:49.896 INFO:journalctl@ceph.mon.a.trial027.stdout:Feb 19 08:24:49 trial027 ceph-mon[21739]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T08:24:49.911 DEBUG:teuthology.misc:Transferring archived files from trial116:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_08:14:16-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/57864/remote/trial116 2026-02-19T08:24:49.912 DEBUG:teuthology.orchestra.run.trial116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-19T08:24:49.944 INFO:teuthology.task.internal:Removing archive directory... 2026-02-19T08:24:49.944 DEBUG:teuthology.orchestra.run.trial027:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-19T08:24:49.946 DEBUG:teuthology.orchestra.run.trial116:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-19T08:24:49.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-19T08:24:50.012 INFO:teuthology.task.internal:Not uploading archives. 2026-02-19T08:24:50.012 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-19T08:24:50.028 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-19T08:24:50.028 DEBUG:teuthology.orchestra.run.trial027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-19T08:24:50.030 DEBUG:teuthology.orchestra.run.trial116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-19T08:24:50.046 INFO:teuthology.orchestra.run.trial027.stdout: 917572 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 19 08:24 /home/ubuntu/cephtest 2026-02-19T08:24:50.046 INFO:teuthology.orchestra.run.trial027.stdout: 919457 4 -rw-r--r-- 1 ubuntu ubuntu 201 Feb 19 08:24 /home/ubuntu/cephtest/ceph.monmap 2026-02-19T08:24:50.046 INFO:teuthology.orchestra.run.trial027.stdout: 919429 4 -rw-r--r-- 1 root root 123 Feb 19 08:23 /home/ubuntu/cephtest/ceph.pub 2026-02-19T08:24:50.046 INFO:teuthology.orchestra.run.trial027.stdout: 919398 4 -rw-r--r-- 1 ubuntu ubuntu 3070 Feb 19 08:23 /home/ubuntu/cephtest/seed.ceph.conf 2026-02-19T08:24:50.046 INFO:teuthology.orchestra.run.trial027.stdout: 1179703 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 08:24 /home/ubuntu/cephtest/ceph.data 2026-02-19T08:24:50.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T08:24:50.048 INFO:teuthology.orchestra.run.trial027.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-19T08:24:50.048 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial027 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-19T08:24:50.054 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-19T08:24:50.072 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-19T08:24:50.089 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-19T08:24:50.094 INFO:teuthology.run:Summary data: description: rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e} duration: 246.6409888267517 failure_reason: 'Command failed on trial027 with status 1: ''yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2''' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-19T08:24:50.094 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T08:24:50.098 INFO:teuthology.orchestra.run.trial116.stdout: 917522 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 19 08:24 /home/ubuntu/cephtest 2026-02-19T08:24:50.098 INFO:teuthology.orchestra.run.trial116.stdout: 919378 4 -rw-r--r-- 1 ubuntu ubuntu 201 Feb 19 08:24 /home/ubuntu/cephtest/ceph.monmap 2026-02-19T08:24:50.098 INFO:teuthology.orchestra.run.trial116.stdout: 1179675 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 08:24 /home/ubuntu/cephtest/ceph.data 2026-02-19T08:24:50.099 INFO:teuthology.orchestra.run.trial116.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-19T08:24:50.203 INFO:teuthology.run:FAIL