2026-02-17T08:15:01.411 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T08:15:01.426 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:15:01.504 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51117 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51117' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 global: mon election default strategy: 3 mds: debug mgrc: 20 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug mgrc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_DEGRADED\) sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - mon.a - mgr.a - client.0 - - host.b - client.1 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCsNB/yci/ReWR4EwD/dnIH3bz+A+lgLQ0xVjQ1Rj1zotw+WFDUz+lYVyAWO+sDBFMEQOApkBHloCda5qF3uR1Y= trial134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuyah0gJQqf2xsOcmL7KELXSos58Ds70wKFG/u9b8ydFRAFKM8Cann/dvL/wb+ORm+8Vxsxd+M7jNfGt8AXiFo= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: null - cephadm: null - ceph: log-ignorelist: - \(OSD_DOWN\) - workunit: clients: client.1: - cephadm/create_iscsi_disks.sh - workunit: clients: client.0: - cephadm/test_dashboard_e2e.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T08:15:01.504 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T08:15:01.504 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T08:15:01.504 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T08:15:01.506 INFO:teuthology.task.internal:Checking packages... 2026-02-17T08:15:01.506 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T08:15:01.506 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T08:15:01.506 INFO:teuthology.packaging:ref: None 2026-02-17T08:15:01.506 INFO:teuthology.packaging:tag: None 2026-02-17T08:15:01.506 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:15:01.506 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:15:01.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T08:15:01.646 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705.g04cf6dd4 2026-02-17T08:15:01.647 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T08:15:01.658 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T08:15:01.658 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T08:15:01.671 INFO:teuthology.task.internal:Saving configuration 2026-02-17T08:15:01.684 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T08:15:01.696 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T08:15:01.764 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial016.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51117', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 08:11:36.244387', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCsNB/yci/ReWR4EwD/dnIH3bz+A+lgLQ0xVjQ1Rj1zotw+WFDUz+lYVyAWO+sDBFMEQOApkBHloCda5qF3uR1Y='} 2026-02-17T08:15:01.822 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial134.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51117', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 08:11:36.243436', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuyah0gJQqf2xsOcmL7KELXSos58Ds70wKFG/u9b8ydFRAFKM8Cann/dvL/wb+ORm+8Vxsxd+M7jNfGt8AXiFo='} 2026-02-17T08:15:01.822 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T08:15:01.837 INFO:teuthology.task.internal:roles: ubuntu@trial016.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'] 2026-02-17T08:15:01.837 INFO:teuthology.task.internal:roles: ubuntu@trial134.front.sepia.ceph.com - ['host.b', 'client.1'] 2026-02-17T08:15:01.837 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T08:15:01.972 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7dc5737a56c0>, signals=[15]) 2026-02-17T08:15:01.972 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T08:15:01.983 INFO:teuthology.task.internal:Opening connections... 2026-02-17T08:15:01.983 DEBUG:teuthology.task.internal:connecting to ubuntu@trial016.front.sepia.ceph.com 2026-02-17T08:15:01.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:15:02.044 DEBUG:teuthology.task.internal:connecting to ubuntu@trial134.front.sepia.ceph.com 2026-02-17T08:15:02.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:15:02.105 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T08:15:02.116 DEBUG:teuthology.orchestra.run.trial016:> uname -m 2026-02-17T08:15:02.132 INFO:teuthology.orchestra.run.trial016.stdout:x86_64 2026-02-17T08:15:02.132 DEBUG:teuthology.orchestra.run.trial016:> cat /etc/os-release 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:NAME="CentOS Stream" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:VERSION="9" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:ID="centos" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:VERSION_ID="9" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:ANSI_COLOR="0;31" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:15:02.188 INFO:teuthology.orchestra.run.trial016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:15:02.189 INFO:teuthology.lock.ops:Updating trial016.front.sepia.ceph.com on lock server 2026-02-17T08:15:02.258 DEBUG:teuthology.orchestra.run.trial134:> uname -m 2026-02-17T08:15:02.273 INFO:teuthology.orchestra.run.trial134.stdout:x86_64 2026-02-17T08:15:02.273 DEBUG:teuthology.orchestra.run.trial134:> cat /etc/os-release 2026-02-17T08:15:02.329 INFO:teuthology.orchestra.run.trial134.stdout:NAME="CentOS Stream" 2026-02-17T08:15:02.329 INFO:teuthology.orchestra.run.trial134.stdout:VERSION="9" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:ID="centos" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:ID_LIKE="rhel fedora" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:VERSION_ID="9" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:PLATFORM_ID="platform:el9" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:ANSI_COLOR="0;31" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:LOGO="fedora-logo-icon" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:HOME_URL="https://centos.org/" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T08:15:02.330 INFO:teuthology.orchestra.run.trial134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T08:15:02.330 INFO:teuthology.lock.ops:Updating trial134.front.sepia.ceph.com on lock server 2026-02-17T08:15:02.406 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T08:15:02.419 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T08:15:02.432 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T08:15:02.432 DEBUG:teuthology.orchestra.run.trial016:> test '!' -e /home/ubuntu/cephtest 2026-02-17T08:15:02.433 DEBUG:teuthology.orchestra.run.trial134:> test '!' -e /home/ubuntu/cephtest 2026-02-17T08:15:02.448 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T08:15:02.459 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T08:15:02.459 DEBUG:teuthology.orchestra.run.trial016:> test -z $(ls -A /var/lib/ceph) 2026-02-17T08:15:02.488 DEBUG:teuthology.orchestra.run.trial134:> test -z $(ls -A /var/lib/ceph) 2026-02-17T08:15:02.504 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T08:15:02.661 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T08:15:02.680 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T08:15:02.680 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T08:15:02.680 DEBUG:teuthology.orchestra.run.trial016:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T08:15:02.680 DEBUG:teuthology.orchestra.run.trial134:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T08:15:02.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:15:02.695 DEBUG:teuthology.orchestra.run.trial016:> uname -r 2026-02-17T08:15:02.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:15:02.695 DEBUG:teuthology.orchestra.run.trial134:> uname -r 2026-02-17T08:15:02.751 INFO:teuthology.orchestra.run.trial016.stdout:5.14.0-645.el9.x86_64 2026-02-17T08:15:02.751 INFO:teuthology.task.kernel:Running kernel on trial016: 5.14.0-645.el9.x86_64 2026-02-17T08:15:02.751 DEBUG:teuthology.orchestra.run.trial016:> sudo yum install -y kernel 2026-02-17T08:15:02.751 INFO:teuthology.orchestra.run.trial134.stdout:5.14.0-645.el9.x86_64 2026-02-17T08:15:02.752 INFO:teuthology.task.kernel:Running kernel on trial134: 5.14.0-645.el9.x86_64 2026-02-17T08:15:02.752 DEBUG:teuthology.orchestra.run.trial134:> sudo yum install -y kernel 2026-02-17T08:15:03.798 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-17T08:15:03.818 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-17T08:15:06.849 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T08:15:06.867 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T08:15:11.095 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 7.8 MB 00:01 2026-02-17T08:15:13.228 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 20 kB 00:01 2026-02-17T08:15:15.445 INFO:teuthology.orchestra.run.trial016.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 20 MB 00:02 2026-02-17T08:15:16.164 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 7.8 MB 00:06 2026-02-17T08:15:18.241 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 20 kB 00:01 2026-02-17T08:15:18.642 INFO:teuthology.orchestra.run.trial016.stdout:lab-extras 1.2 MB/s | 50 kB 00:00 2026-02-17T08:15:19.165 INFO:teuthology.orchestra.run.trial134.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2026-02-17T08:15:19.653 INFO:teuthology.orchestra.run.trial016.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T08:15:19.673 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:15:19.674 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:15:19.674 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-17T08:15:19.674 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:15:19.674 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:15:19.674 INFO:teuthology.orchestra.run.trial016.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T08:15:19.675 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-17T08:15:19.675 INFO:teuthology.orchestra.run.trial016.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T08:15:19.675 INFO:teuthology.orchestra.run.trial016.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T08:15:19.675 INFO:teuthology.orchestra.run.trial016.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T08:15:19.675 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:15:19.675 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:15:19.675 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:15:19.675 INFO:teuthology.orchestra.run.trial016.stdout:Install 4 Packages 2026-02-17T08:15:19.675 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:15:19.675 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 88 M 2026-02-17T08:15:19.676 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 135 M 2026-02-17T08:15:19.676 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:15:20.360 INFO:teuthology.orchestra.run.trial016.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2026-02-17T08:15:20.916 INFO:teuthology.orchestra.run.trial016.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-17T08:15:21.439 INFO:teuthology.orchestra.run.trial016.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-17T08:15:21.651 INFO:teuthology.orchestra.run.trial016.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-17T08:15:21.652 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:15:21.652 INFO:teuthology.orchestra.run.trial016.stdout:Total 45 MB/s | 88 MB 00:01 2026-02-17T08:15:21.841 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:15:22.048 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:15:22.048 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:15:22.369 INFO:teuthology.orchestra.run.trial134.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T08:15:22.396 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:15:22.397 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:15:23.385 INFO:teuthology.orchestra.run.trial134.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T08:15:23.405 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:15:23.406 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:15:23.406 INFO:teuthology.orchestra.run.trial134.stdout: Package Architecture Version Repository Size 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout:Installing dependencies: 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:15:23.407 INFO:teuthology.orchestra.run.trial134.stdout:Install 4 Packages 2026-02-17T08:15:23.408 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:15:23.408 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 88 M 2026-02-17T08:15:23.408 INFO:teuthology.orchestra.run.trial134.stdout:Installed size: 135 M 2026-02-17T08:15:23.408 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:15:23.482 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:15:23.737 INFO:teuthology.orchestra.run.trial134.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 30 MB/s | 803 kB 00:00 2026-02-17T08:15:23.766 INFO:teuthology.orchestra.run.trial016.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T08:15:23.786 INFO:teuthology.orchestra.run.trial016.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T08:15:23.834 INFO:teuthology.orchestra.run.trial134.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 138 MB/s | 17 MB 00:00 2026-02-17T08:15:23.891 INFO:teuthology.orchestra.run.trial134.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 200 MB/s | 31 MB 00:00 2026-02-17T08:15:23.952 INFO:teuthology.orchestra.run.trial134.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 164 MB/s | 40 MB 00:00 2026-02-17T08:15:23.953 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:15:23.953 INFO:teuthology.orchestra.run.trial134.stdout:Total 162 MB/s | 88 MB 00:00 2026-02-17T08:15:24.141 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:15:24.348 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:15:24.348 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:15:24.695 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:15:24.696 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:15:25.569 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T08:15:25.597 INFO:teuthology.orchestra.run.trial016.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T08:15:25.793 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:15:26.080 INFO:teuthology.orchestra.run.trial134.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T08:15:26.100 INFO:teuthology.orchestra.run.trial134.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T08:15:27.881 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T08:15:27.910 INFO:teuthology.orchestra.run.trial134.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T08:15:28.684 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T08:15:28.690 INFO:teuthology.orchestra.run.trial016.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:15:31.123 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T08:15:31.130 INFO:teuthology.orchestra.run.trial134.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:15:31.889 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:15:34.229 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:16:02.235 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:16:02.256 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:16:02.425 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:16:02.425 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T08:16:02.425 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T08:16:02.425 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T08:16:02.477 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:16:02.477 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:16:02.477 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:16:02.477 INFO:teuthology.orchestra.run.trial016.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T08:16:02.478 INFO:teuthology.orchestra.run.trial016.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T08:16:02.478 INFO:teuthology.orchestra.run.trial016.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T08:16:02.478 INFO:teuthology.orchestra.run.trial016.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T08:16:02.478 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:16:02.478 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:16:02.536 DEBUG:teuthology.orchestra.run.trial016:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T08:16:02.561 INFO:teuthology.orchestra.run.trial016.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T08:16:02.562 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T08:16:02.562 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T08:16:02.562 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T08:16:02.562 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T08:16:02.563 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-17T08:16:02.563 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial016.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T08:16:02.563 DEBUG:teuthology.orchestra.run.trial016:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T08:16:02.625 INFO:teuthology.orchestra.run.trial016.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T08:16:02.627 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T08:16:02.627 DEBUG:teuthology.orchestra.run.trial016:> sudo rpm -qi grub2-tools 2026-02-17T08:16:02.695 INFO:teuthology.orchestra.run.trial016.stdout:Name : grub2-tools 2026-02-17T08:16:02.695 INFO:teuthology.orchestra.run.trial016.stdout:Epoch : 1 2026-02-17T08:16:02.695 INFO:teuthology.orchestra.run.trial016.stdout:Version : 2.06 2026-02-17T08:16:02.695 INFO:teuthology.orchestra.run.trial016.stdout:Release : 118.el9 2026-02-17T08:16:02.696 INFO:teuthology.orchestra.run.trial016.stdout:Architecture: x86_64 2026-02-17T08:16:02.696 INFO:teuthology.orchestra.run.trial016.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T08:16:02.696 INFO:teuthology.orchestra.run.trial016.stdout:Group : Unspecified 2026-02-17T08:16:02.696 INFO:teuthology.orchestra.run.trial016.stdout:Size : 8393909 2026-02-17T08:16:02.696 INFO:teuthology.orchestra.run.trial016.stdout:License : GPLv3+ 2026-02-17T08:16:02.696 INFO:teuthology.orchestra.run.trial016.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T08:16:02.696 INFO:teuthology.orchestra.run.trial016.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T08:16:02.696 INFO:teuthology.orchestra.run.trial016.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T08:16:02.697 INFO:teuthology.orchestra.run.trial016.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T08:16:02.697 INFO:teuthology.orchestra.run.trial016.stdout:Packager : builder@centos.org 2026-02-17T08:16:02.697 INFO:teuthology.orchestra.run.trial016.stdout:Vendor : CentOS 2026-02-17T08:16:02.697 INFO:teuthology.orchestra.run.trial016.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T08:16:02.697 INFO:teuthology.orchestra.run.trial016.stdout:Summary : Support tools for GRUB. 2026-02-17T08:16:02.697 INFO:teuthology.orchestra.run.trial016.stdout:Description : 2026-02-17T08:16:02.697 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:16:02.697 INFO:teuthology.orchestra.run.trial016.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T08:16:02.698 INFO:teuthology.orchestra.run.trial016.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T08:16:02.698 INFO:teuthology.orchestra.run.trial016.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T08:16:02.698 INFO:teuthology.orchestra.run.trial016.stdout:hardware devices. 2026-02-17T08:16:02.698 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:16:02.698 INFO:teuthology.orchestra.run.trial016.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T08:16:02.700 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T08:16:02.700 INFO:teuthology.task.kernel:Updating grub on trial016 to boot 5.14.0-681.el9.x86_64 2026-02-17T08:16:02.700 DEBUG:teuthology.orchestra.run.trial016:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T08:16:02.764 INFO:teuthology.orchestra.run.trial016.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T08:16:02.765 DEBUG:teuthology.orchestra.run.trial016:> sudo command -v grubby && echo yes || echo no 2026-02-17T08:16:02.830 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/grubby 2026-02-17T08:16:02.831 INFO:teuthology.orchestra.run.trial016.stdout:yes 2026-02-17T08:16:02.832 DEBUG:teuthology.orchestra.run.trial016:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T08:16:02.895 INFO:teuthology.orchestra.run.trial016.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T08:16:02.896 DEBUG:teuthology.orchestra.run.trial016:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T08:16:02.971 DEBUG:teuthology.orchestra.run.trial016:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T08:16:03.179 INFO:teuthology.orchestra.run.trial016.stderr:Generating grub configuration file ... 2026-02-17T08:16:03.242 INFO:teuthology.orchestra.run.trial016.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T08:16:03.249 INFO:teuthology.orchestra.run.trial016.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T08:16:03.498 INFO:teuthology.orchestra.run.trial016.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T08:16:03.504 INFO:teuthology.orchestra.run.trial016.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T08:16:03.537 INFO:teuthology.orchestra.run.trial016.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T08:16:03.543 INFO:teuthology.orchestra.run.trial016.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T08:16:03.567 INFO:teuthology.orchestra.run.trial016.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T08:16:03.573 INFO:teuthology.orchestra.run.trial016.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T08:16:03.654 INFO:teuthology.orchestra.run.trial016.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T08:16:03.663 INFO:teuthology.orchestra.run.trial016.stderr:done 2026-02-17T08:16:03.665 DEBUG:teuthology.orchestra.run.trial016:> test -d /sys/firmware/efi 2026-02-17T08:16:03.681 DEBUG:teuthology.orchestra.run.trial016:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T08:16:03.746 INFO:teuthology.orchestra.run.trial016.stdout:/boot/efi/EFI/BOOT 2026-02-17T08:16:03.746 INFO:teuthology.orchestra.run.trial016.stdout:/boot/efi/EFI/centos 2026-02-17T08:16:03.748 DEBUG:teuthology.orchestra.run.trial016:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T08:16:03.814 INFO:teuthology.orchestra.run.trial016.stdout:no 2026-02-17T08:16:03.815 DEBUG:teuthology.orchestra.run.trial016:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T08:16:03.878 INFO:teuthology.orchestra.run.trial016.stdout:yes 2026-02-17T08:16:03.879 DEBUG:teuthology.orchestra.run.trial016:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T08:16:03.943 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial016 2026-02-17T08:16:03.943 DEBUG:teuthology.orchestra.run.trial016:> sudo bash -c ' 2026-02-17T08:16:03.943 DEBUG:teuthology.orchestra.run.trial016:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T08:16:03.943 DEBUG:teuthology.orchestra.run.trial016:> ' 2026-02-17T08:16:04.656 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:16:04.678 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:16:04.848 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:16:04.848 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T08:16:04.848 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T08:16:04.848 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T08:16:04.900 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T08:16:04.900 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:16:04.900 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:16:04.900 INFO:teuthology.orchestra.run.trial134.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T08:16:04.901 INFO:teuthology.orchestra.run.trial134.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T08:16:04.901 INFO:teuthology.orchestra.run.trial134.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T08:16:04.901 INFO:teuthology.orchestra.run.trial134.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T08:16:04.901 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:16:04.901 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:16:04.958 DEBUG:teuthology.orchestra.run.trial134:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T08:16:04.983 INFO:teuthology.orchestra.run.trial134.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T08:16:04.984 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T08:16:04.984 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T08:16:04.984 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T08:16:04.984 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T08:16:04.984 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-17T08:16:04.984 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial134.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T08:16:04.984 DEBUG:teuthology.orchestra.run.trial134:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T08:16:05.047 INFO:teuthology.orchestra.run.trial134.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T08:16:05.048 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T08:16:05.048 DEBUG:teuthology.orchestra.run.trial134:> sudo rpm -qi grub2-tools 2026-02-17T08:16:05.116 INFO:teuthology.orchestra.run.trial134.stdout:Name : grub2-tools 2026-02-17T08:16:05.116 INFO:teuthology.orchestra.run.trial134.stdout:Epoch : 1 2026-02-17T08:16:05.116 INFO:teuthology.orchestra.run.trial134.stdout:Version : 2.06 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:Release : 118.el9 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:Architecture: x86_64 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:Group : Unspecified 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:Size : 8393909 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:License : GPLv3+ 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T08:16:05.117 INFO:teuthology.orchestra.run.trial134.stdout:Packager : builder@centos.org 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout:Vendor : CentOS 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout:Summary : Support tools for GRUB. 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout:Description : 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout:hardware devices. 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:16:05.118 INFO:teuthology.orchestra.run.trial134.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T08:16:05.120 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T08:16:05.120 INFO:teuthology.task.kernel:Updating grub on trial134 to boot 5.14.0-681.el9.x86_64 2026-02-17T08:16:05.120 DEBUG:teuthology.orchestra.run.trial134:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T08:16:05.183 INFO:teuthology.orchestra.run.trial134.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T08:16:05.185 DEBUG:teuthology.orchestra.run.trial134:> sudo command -v grubby && echo yes || echo no 2026-02-17T08:16:05.247 INFO:teuthology.orchestra.run.trial134.stdout:/sbin/grubby 2026-02-17T08:16:05.249 INFO:teuthology.orchestra.run.trial134.stdout:yes 2026-02-17T08:16:05.249 DEBUG:teuthology.orchestra.run.trial134:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T08:16:05.313 INFO:teuthology.orchestra.run.trial134.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T08:16:05.314 DEBUG:teuthology.orchestra.run.trial134:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T08:16:05.387 DEBUG:teuthology.orchestra.run.trial134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T08:16:05.596 INFO:teuthology.orchestra.run.trial134.stderr:Generating grub configuration file ... 2026-02-17T08:16:05.660 INFO:teuthology.orchestra.run.trial134.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T08:16:05.666 INFO:teuthology.orchestra.run.trial134.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T08:16:05.916 INFO:teuthology.orchestra.run.trial134.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T08:16:05.923 INFO:teuthology.orchestra.run.trial134.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T08:16:05.956 INFO:teuthology.orchestra.run.trial134.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T08:16:05.962 INFO:teuthology.orchestra.run.trial134.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T08:16:05.986 INFO:teuthology.orchestra.run.trial134.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T08:16:05.992 INFO:teuthology.orchestra.run.trial134.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T08:16:06.074 INFO:teuthology.orchestra.run.trial134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T08:16:06.083 INFO:teuthology.orchestra.run.trial134.stderr:done 2026-02-17T08:16:06.084 DEBUG:teuthology.orchestra.run.trial134:> test -d /sys/firmware/efi 2026-02-17T08:16:06.101 DEBUG:teuthology.orchestra.run.trial134:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T08:16:06.166 INFO:teuthology.orchestra.run.trial134.stdout:/boot/efi/EFI/BOOT 2026-02-17T08:16:06.166 INFO:teuthology.orchestra.run.trial134.stdout:/boot/efi/EFI/centos 2026-02-17T08:16:06.168 DEBUG:teuthology.orchestra.run.trial134:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T08:16:06.234 INFO:teuthology.orchestra.run.trial134.stdout:no 2026-02-17T08:16:06.235 DEBUG:teuthology.orchestra.run.trial134:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T08:16:06.300 INFO:teuthology.orchestra.run.trial134.stdout:yes 2026-02-17T08:16:06.301 DEBUG:teuthology.orchestra.run.trial134:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T08:16:06.365 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial134 2026-02-17T08:16:06.365 DEBUG:teuthology.orchestra.run.trial134:> sudo bash -c ' 2026-02-17T08:16:06.365 DEBUG:teuthology.orchestra.run.trial134:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T08:16:06.365 DEBUG:teuthology.orchestra.run.trial134:> ' 2026-02-17T08:16:33.986 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-17T08:16:33.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-17T08:16:33.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:16:36.407 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-17T08:16:36.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial134.front.sepia.ceph.com' 2026-02-17T08:16:36.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:17:34.048 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T08:17:36.414 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T08:17:43.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-17T08:17:43.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:17:43.327 DEBUG:teuthology.orchestra.run.trial016:> true 2026-02-17T08:17:43.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-17T08:17:43.476 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T08:17:43.476 DEBUG:teuthology.orchestra.run.trial016:> uname -r 2026-02-17T08:17:43.531 INFO:teuthology.orchestra.run.trial016.stdout:5.14.0-681.el9.x86_64 2026-02-17T08:17:43.532 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T08:17:43.532 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T08:17:43.532 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T08:17:44.532 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-17T08:17:44.532 DEBUG:teuthology.orchestra.run.trial016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T08:17:44.563 INFO:teuthology.orchestra.run.trial016.stdout:ttyS1 2026-02-17T08:17:44.588 DEBUG:teuthology.parallel:result is None 2026-02-17T08:17:45.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial134.front.sepia.ceph.com' 2026-02-17T08:17:45.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:17:45.506 DEBUG:teuthology.orchestra.run.trial134:> true 2026-02-17T08:17:45.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial134.front.sepia.ceph.com' 2026-02-17T08:17:45.659 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-681.el9.x86_64"... 2026-02-17T08:17:45.660 DEBUG:teuthology.orchestra.run.trial134:> uname -r 2026-02-17T08:17:45.714 INFO:teuthology.orchestra.run.trial134.stdout:5.14.0-681.el9.x86_64 2026-02-17T08:17:45.715 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T08:17:45.715 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T08:17:45.715 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T08:17:46.716 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-17T08:17:46.716 DEBUG:teuthology.orchestra.run.trial134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T08:17:46.746 INFO:teuthology.orchestra.run.trial134.stdout:ttyS1 2026-02-17T08:17:46.779 DEBUG:teuthology.parallel:result is None 2026-02-17T08:17:46.779 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T08:17:46.791 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T08:17:46.791 DEBUG:teuthology.orchestra.run.trial016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T08:17:46.794 DEBUG:teuthology.orchestra.run.trial134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T08:17:46.837 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T08:17:46.849 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T08:17:46.861 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T08:17:46.862 DEBUG:teuthology.orchestra.run.trial016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T08:17:46.864 DEBUG:teuthology.orchestra.run.trial134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T08:17:46.902 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T08:17:46.913 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T08:17:46.913 DEBUG:teuthology.orchestra.run.trial016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T08:17:46.920 DEBUG:teuthology.orchestra.run.trial134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T08:17:46.943 INFO:teuthology.orchestra.run.trial016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:17:46.952 INFO:teuthology.orchestra.run.trial016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:17:46.961 INFO:teuthology.orchestra.run.trial134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:17:46.970 INFO:teuthology.orchestra.run.trial134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T08:17:46.972 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T08:17:46.985 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T08:17:46.985 DEBUG:teuthology.orchestra.run.trial016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T08:17:46.996 DEBUG:teuthology.orchestra.run.trial134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T08:17:47.037 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T08:17:47.055 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T08:17:47.055 DEBUG:teuthology.orchestra.run.trial016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T08:17:47.060 DEBUG:teuthology.orchestra.run.trial134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T08:17:47.094 DEBUG:teuthology.orchestra.run.trial016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:17:47.233 DEBUG:teuthology.orchestra.run.trial016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:17:47.259 DEBUG:teuthology.orchestra.run.trial016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:17:47.408 DEBUG:teuthology.orchestra.run.trial016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:17:47.433 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:17:47.433 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T08:17:47.496 DEBUG:teuthology.orchestra.run.trial134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:17:47.602 DEBUG:teuthology.orchestra.run.trial134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:17:47.626 DEBUG:teuthology.orchestra.run.trial134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:17:47.751 DEBUG:teuthology.orchestra.run.trial134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:17:47.776 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:17:47.776 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T08:17:47.840 DEBUG:teuthology.orchestra.run.trial016:> sudo service rsyslog restart 2026-02-17T08:17:47.842 DEBUG:teuthology.orchestra.run.trial134:> sudo service rsyslog restart 2026-02-17T08:17:47.869 INFO:teuthology.orchestra.run.trial016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T08:17:47.908 INFO:teuthology.orchestra.run.trial134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T08:17:48.260 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T08:17:48.273 INFO:teuthology.task.internal:Starting timer... 2026-02-17T08:17:48.273 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T08:17:48.296 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T08:17:48.316 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-17T08:17:48.316 DEBUG:teuthology.orchestra.run.trial016:> sudo service auditd rotate 2026-02-17T08:17:48.346 INFO:teuthology.orchestra.run.trial016.stdout:Rotating logs: 2026-02-17T08:17:48.347 DEBUG:teuthology.orchestra.run.trial134:> sudo service auditd rotate 2026-02-17T08:17:48.377 INFO:teuthology.orchestra.run.trial134.stdout:Rotating logs: 2026-02-17T08:17:48.379 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T08:17:48.379 DEBUG:teuthology.orchestra.run.trial016:> /usr/sbin/getenforce 2026-02-17T08:17:48.404 INFO:teuthology.orchestra.run.trial016.stdout:Permissive 2026-02-17T08:17:48.404 DEBUG:teuthology.orchestra.run.trial134:> /usr/sbin/getenforce 2026-02-17T08:17:48.434 INFO:teuthology.orchestra.run.trial134.stdout:Permissive 2026-02-17T08:17:48.435 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial016.front.sepia.ceph.com': 'permissive', 'ubuntu@trial134.front.sepia.ceph.com': 'permissive'} 2026-02-17T08:17:48.435 DEBUG:teuthology.orchestra.run.trial016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T08:17:48.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:17:48.471 DEBUG:teuthology.orchestra.run.trial134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T08:17:48.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:17:48.500 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T08:17:48.501 DEBUG:teuthology.orchestra.run.trial016:> sudo /usr/sbin/setenforce permissive 2026-02-17T08:17:48.535 DEBUG:teuthology.orchestra.run.trial134:> sudo /usr/sbin/setenforce permissive 2026-02-17T08:17:48.565 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T08:17:48.578 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T08:17:48.585 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T08:17:48.586 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial016.front.sepia.ceph.com,trial134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T08:20:31.981 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial016.front.sepia.ceph.com'), Remote(name='ubuntu@trial134.front.sepia.ceph.com')] 2026-02-17T08:20:31.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-17T08:20:31.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:20:32.108 DEBUG:teuthology.orchestra.run.trial016:> true 2026-02-17T08:20:32.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-17T08:20:32.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial134.front.sepia.ceph.com' 2026-02-17T08:20:32.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T08:20:32.265 DEBUG:teuthology.orchestra.run.trial134:> true 2026-02-17T08:20:32.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial134.front.sepia.ceph.com' 2026-02-17T08:20:32.339 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T08:20:32.353 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T08:20:32.353 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T08:20:32.354 DEBUG:teuthology.orchestra.run.trial016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:20:32.356 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T08:20:32.356 DEBUG:teuthology.orchestra.run.trial134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:20:32.381 INFO:teuthology.orchestra.run.trial016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T08:20:32.393 INFO:teuthology.orchestra.run.trial016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T08:20:32.406 INFO:teuthology.orchestra.run.trial134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T08:20:32.414 INFO:teuthology.orchestra.run.trial016.stderr:sudo: ntpd: command not found 2026-02-17T08:20:32.417 INFO:teuthology.orchestra.run.trial134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T08:20:32.423 INFO:teuthology.orchestra.run.trial016.stdout:506 Cannot talk to daemon 2026-02-17T08:20:32.435 INFO:teuthology.orchestra.run.trial016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T08:20:32.437 INFO:teuthology.orchestra.run.trial134.stderr:sudo: ntpd: command not found 2026-02-17T08:20:32.447 INFO:teuthology.orchestra.run.trial016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T08:20:32.448 INFO:teuthology.orchestra.run.trial134.stdout:506 Cannot talk to daemon 2026-02-17T08:20:32.459 INFO:teuthology.orchestra.run.trial134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T08:20:32.470 INFO:teuthology.orchestra.run.trial134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T08:20:32.494 INFO:teuthology.orchestra.run.trial016.stderr:bash: line 1: ntpq: command not found 2026-02-17T08:20:32.499 INFO:teuthology.orchestra.run.trial016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T08:20:32.499 INFO:teuthology.orchestra.run.trial016.stdout:=============================================================================== 2026-02-17T08:20:32.499 INFO:teuthology.orchestra.run.trial016.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T08:20:32.516 INFO:teuthology.orchestra.run.trial134.stderr:bash: line 1: ntpq: command not found 2026-02-17T08:20:32.575 INFO:teuthology.orchestra.run.trial134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T08:20:32.576 INFO:teuthology.orchestra.run.trial134.stdout:=============================================================================== 2026-02-17T08:20:32.576 INFO:teuthology.orchestra.run.trial134.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T08:20:32.576 INFO:teuthology.orchestra.run.trial134.stdout:^? 172-234-37-140.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T08:20:32.576 INFO:teuthology.orchestra.run.trial134.stdout:^? 172-233-177-198.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T08:20:32.576 INFO:teuthology.orchestra.run.trial134.stdout:^? 23-95-18-208-host.colocr> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T08:20:32.577 INFO:teuthology.run_tasks:Running task pexec... 2026-02-17T08:20:32.600 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-17T08:20:32.601 DEBUG:teuthology.orchestra.run.trial016:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T08:20:32.602 DEBUG:teuthology.orchestra.run.trial134:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T08:20:32.605 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial016.front.sepia.ceph.com 2026-02-17T08:20:32.605 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-17T08:20:32.605 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-17T08:20:32.620 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial134.front.sepia.ceph.com 2026-02-17T08:20:32.620 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-17T08:20:32.620 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-17T08:20:32.778 INFO:teuthology.orchestra.run.trial016.stdout:No match for argument: nvme-cli 2026-02-17T08:20:32.778 INFO:teuthology.orchestra.run.trial016.stderr:No packages marked for removal. 2026-02-17T08:20:32.780 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:20:32.781 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:20:32.781 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:20:32.792 INFO:teuthology.orchestra.run.trial134.stdout:No match for argument: nvme-cli 2026-02-17T08:20:32.793 INFO:teuthology.orchestra.run.trial134.stderr:No packages marked for removal. 2026-02-17T08:20:32.795 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:20:32.796 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:20:32.796 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:20:33.085 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 08:20:03 AM UTC. 2026-02-17T08:20:33.098 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 08:20:02 AM UTC. 2026-02-17T08:20:33.165 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:20:33.166 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:20:33.166 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-17T08:20:33.166 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:20:33.166 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:20:33.166 INFO:teuthology.orchestra.run.trial016.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-17T08:20:33.166 INFO:teuthology.orchestra.run.trial016.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout:Upgrading: 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout:Install 6 Packages 2026-02-17T08:20:33.167 INFO:teuthology.orchestra.run.trial016.stdout:Upgrade 1 Package 2026-02-17T08:20:33.168 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:20:33.168 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 2.4 M 2026-02-17T08:20:33.168 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:20:33.178 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:20:33.179 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:20:33.179 INFO:teuthology.orchestra.run.trial134.stdout: Package Architecture Version Repository Size 2026-02-17T08:20:33.179 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:20:33.179 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:20:33.179 INFO:teuthology.orchestra.run.trial134.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-17T08:20:33.180 INFO:teuthology.orchestra.run.trial134.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-17T08:20:33.180 INFO:teuthology.orchestra.run.trial134.stdout:Upgrading: 2026-02-17T08:20:33.180 INFO:teuthology.orchestra.run.trial134.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-17T08:20:33.180 INFO:teuthology.orchestra.run.trial134.stdout:Installing dependencies: 2026-02-17T08:20:33.180 INFO:teuthology.orchestra.run.trial134.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-17T08:20:33.180 INFO:teuthology.orchestra.run.trial134.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-17T08:20:33.180 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T08:20:33.181 INFO:teuthology.orchestra.run.trial134.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-17T08:20:33.181 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:20:33.181 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:20:33.181 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:20:33.181 INFO:teuthology.orchestra.run.trial134.stdout:Install 6 Packages 2026-02-17T08:20:33.181 INFO:teuthology.orchestra.run.trial134.stdout:Upgrade 1 Package 2026-02-17T08:20:33.181 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:20:33.182 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 2.4 M 2026-02-17T08:20:33.182 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:20:33.518 INFO:teuthology.orchestra.run.trial016.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 165 kB/s | 44 kB 00:00 2026-02-17T08:20:33.518 INFO:teuthology.orchestra.run.trial016.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 271 kB/s | 72 kB 00:00 2026-02-17T08:20:33.526 INFO:teuthology.orchestra.run.trial016.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 10 MB/s | 84 kB 00:00 2026-02-17T08:20:33.528 INFO:teuthology.orchestra.run.trial016.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 16 MB/s | 150 kB 00:00 2026-02-17T08:20:33.533 INFO:teuthology.orchestra.run.trial016.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 4.1 MB/s | 1.2 MB 00:00 2026-02-17T08:20:33.534 INFO:teuthology.orchestra.run.trial016.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 19 MB/s | 116 kB 00:00 2026-02-17T08:20:33.540 INFO:teuthology.orchestra.run.trial016.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 59 MB/s | 837 kB 00:00 2026-02-17T08:20:33.540 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:20:33.540 INFO:teuthology.orchestra.run.trial016.stdout:Total 6.5 MB/s | 2.4 MB 00:00 2026-02-17T08:20:33.601 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:20:33.610 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:20:33.610 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:20:33.660 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:20:33.660 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:20:33.729 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:20:33.775 INFO:teuthology.orchestra.run.trial134.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 82 kB/s | 44 kB 00:00 2026-02-17T08:20:33.781 INFO:teuthology.orchestra.run.trial134.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 133 kB/s | 72 kB 00:00 2026-02-17T08:20:33.795 INFO:teuthology.orchestra.run.trial016.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-17T08:20:33.802 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-17T08:20:33.810 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-17T08:20:33.816 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-17T08:20:33.821 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-17T08:20:33.822 INFO:teuthology.orchestra.run.trial016.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T08:20:33.953 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T08:20:33.955 INFO:teuthology.orchestra.run.trial016.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T08:20:34.047 INFO:teuthology.orchestra.run.trial134.stdout:(3/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 567 kB/s | 150 kB 00:00 2026-02-17T08:20:34.201 INFO:teuthology.orchestra.run.trial134.stdout:(4/7): python3-kmod-0.9-32.el9.x86_64.rpm 198 kB/s | 84 kB 00:00 2026-02-17T08:20:34.229 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T08:20:34.229 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T08:20:34.229 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:20:34.253 INFO:teuthology.orchestra.run.trial016.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T08:20:34.469 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T08:20:34.469 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-17T08:20:34.469 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-17T08:20:34.469 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-17T08:20:34.469 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-17T08:20:34.470 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-17T08:20:34.470 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-17T08:20:34.470 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-17T08:20:34.520 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T08:20:34.521 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:20:34.521 INFO:teuthology.orchestra.run.trial016.stdout:Upgraded: 2026-02-17T08:20:34.521 INFO:teuthology.orchestra.run.trial016.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-17T08:20:34.521 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:20:34.521 INFO:teuthology.orchestra.run.trial016.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-17T08:20:34.521 INFO:teuthology.orchestra.run.trial016.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-17T08:20:34.521 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-17T08:20:34.521 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:20:34.521 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:20:34.551 DEBUG:teuthology.parallel:result is None 2026-02-17T08:20:34.625 INFO:teuthology.orchestra.run.trial134.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 274 kB/s | 116 kB 00:00 2026-02-17T08:20:34.884 INFO:teuthology.orchestra.run.trial134.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 1.0 MB/s | 837 kB 00:00 2026-02-17T08:20:35.088 INFO:teuthology.orchestra.run.trial134.stdout:(7/7): nvme-cli-2.16-1.el9.x86_64.rpm 638 kB/s | 1.2 MB 00:01 2026-02-17T08:20:35.090 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:20:35.090 INFO:teuthology.orchestra.run.trial134.stdout:Total 1.3 MB/s | 2.4 MB 00:01 2026-02-17T08:20:35.155 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:20:35.163 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:20:35.163 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:20:35.213 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:20:35.214 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:20:35.283 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:20:35.352 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-17T08:20:35.358 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-17T08:20:35.367 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-17T08:20:35.372 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-17T08:20:35.378 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-17T08:20:35.379 INFO:teuthology.orchestra.run.trial134.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T08:20:35.510 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T08:20:35.512 INFO:teuthology.orchestra.run.trial134.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T08:20:35.802 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T08:20:35.803 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T08:20:35.803 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:20:35.825 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T08:20:36.038 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T08:20:36.038 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-17T08:20:36.039 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-17T08:20:36.039 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-17T08:20:36.039 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-17T08:20:36.039 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-17T08:20:36.039 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-17T08:20:36.039 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-17T08:20:36.093 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T08:20:36.094 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:20:36.094 INFO:teuthology.orchestra.run.trial134.stdout:Upgraded: 2026-02-17T08:20:36.094 INFO:teuthology.orchestra.run.trial134.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-17T08:20:36.094 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:20:36.094 INFO:teuthology.orchestra.run.trial134.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-17T08:20:36.094 INFO:teuthology.orchestra.run.trial134.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-17T08:20:36.094 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-17T08:20:36.094 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:20:36.094 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:20:36.123 DEBUG:teuthology.parallel:result is None 2026-02-17T08:20:36.123 INFO:teuthology.run_tasks:Running task install... 2026-02-17T08:20:36.138 DEBUG:teuthology.task.install:project ceph 2026-02-17T08:20:36.138 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T08:20:36.138 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T08:20:36.139 INFO:teuthology.task.install:Using flavor: default 2026-02-17T08:20:36.147 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T08:20:36.147 INFO:teuthology.task.install:extra packages: [] 2026-02-17T08:20:36.148 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-17T08:20:36.148 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:20:36.151 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'tag': None, 'wait_for_package': False} 2026-02-17T08:20:36.151 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:20:36.342 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-17T08:20:36.343 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-17T08:20:36.354 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/ 2026-02-17T08:20:36.354 INFO:teuthology.task.install.rpm:Package version is 19.2.3-705.g04cf6dd4 2026-02-17T08:20:36.644 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T08:20:36.645 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:20:36.645 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T08:20:36.674 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T08:20:36.675 DEBUG:teuthology.orchestra.run.trial016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T08:20:36.691 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T08:20:36.691 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:20:36.691 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T08:20:36.722 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T08:20:36.722 DEBUG:teuthology.orchestra.run.trial134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T08:20:36.740 DEBUG:teuthology.orchestra.run.trial016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T08:20:36.787 DEBUG:teuthology.orchestra.run.trial134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T08:20:36.815 DEBUG:teuthology.orchestra.run.trial016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T08:20:36.862 DEBUG:teuthology.orchestra.run.trial134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T08:20:36.881 INFO:teuthology.orchestra.run.trial016.stdout:check_obsoletes = 1 2026-02-17T08:20:36.882 DEBUG:teuthology.orchestra.run.trial016:> sudo yum clean all 2026-02-17T08:20:36.929 INFO:teuthology.orchestra.run.trial134.stdout:check_obsoletes = 1 2026-02-17T08:20:36.931 DEBUG:teuthology.orchestra.run.trial134:> sudo yum clean all 2026-02-17T08:20:37.034 INFO:teuthology.orchestra.run.trial016.stdout:41 files removed 2026-02-17T08:20:37.048 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-radosgw 2026-02-17T08:20:37.079 INFO:teuthology.orchestra.run.trial134.stdout:41 files removed 2026-02-17T08:20:37.092 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-radosgw 2026-02-17T08:20:37.712 INFO:teuthology.orchestra.run.trial016.stdout:ceph packages for x86_64 166 kB/s | 86 kB 00:00 2026-02-17T08:20:37.764 INFO:teuthology.orchestra.run.trial134.stdout:ceph packages for x86_64 163 kB/s | 86 kB 00:00 2026-02-17T08:20:38.151 INFO:teuthology.orchestra.run.trial016.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2026-02-17T08:20:38.204 INFO:teuthology.orchestra.run.trial134.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2026-02-17T08:20:38.602 INFO:teuthology.orchestra.run.trial016.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2026-02-17T08:20:38.644 INFO:teuthology.orchestra.run.trial134.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2026-02-17T08:20:38.857 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - BaseOS 38 MB/s | 8.9 MB 00:00 2026-02-17T08:20:38.996 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - BaseOS 27 MB/s | 8.9 MB 00:00 2026-02-17T08:20:41.915 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T08:20:42.066 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T08:20:45.262 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 7.8 MB 00:00 2026-02-17T08:20:45.471 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 7.8 MB 00:01 2026-02-17T08:20:47.028 INFO:teuthology.orchestra.run.trial134.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 20 kB 00:00 2026-02-17T08:20:47.165 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 20 kB 00:01 2026-02-17T08:20:47.450 INFO:teuthology.orchestra.run.trial134.stdout:Extra Packages for Enterprise Linux 56 MB/s | 20 MB 00:00 2026-02-17T08:20:47.866 INFO:teuthology.orchestra.run.trial016.stdout:Extra Packages for Enterprise Linux 32 MB/s | 20 MB 00:00 2026-02-17T08:20:50.656 INFO:teuthology.orchestra.run.trial134.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T08:20:51.067 INFO:teuthology.orchestra.run.trial016.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-17T08:20:51.874 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:20:51.875 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:20:51.875 INFO:teuthology.orchestra.run.trial134.stdout: Package Arch Version Repository Size 2026-02-17T08:20:51.875 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:20:51.875 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:20:51.875 INFO:teuthology.orchestra.run.trial134.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T08:20:51.875 INFO:teuthology.orchestra.run.trial134.stdout:Upgrading: 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout:Installing dependencies: 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-17T08:20:51.876 INFO:teuthology.orchestra.run.trial134.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T08:20:51.877 INFO:teuthology.orchestra.run.trial134.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout:Installing weak dependencies: 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T08:20:51.878 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:20:51.879 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:20:51.879 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:20:51.879 INFO:teuthology.orchestra.run.trial134.stdout:Install 32 Packages 2026-02-17T08:20:51.879 INFO:teuthology.orchestra.run.trial134.stdout:Upgrade 2 Packages 2026-02-17T08:20:51.879 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:20:51.880 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 62 M 2026-02-17T08:20:51.880 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:20:52.292 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:20:52.294 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:20:52.294 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repository Size 2026-02-17T08:20:52.294 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:20:52.294 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:20:52.294 INFO:teuthology.orchestra.run.trial016.stdout: ceph-radosgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 11 M 2026-02-17T08:20:52.294 INFO:teuthology.orchestra.run.trial016.stdout:Upgrading: 2026-02-17T08:20:52.294 INFO:teuthology.orchestra.run.trial016.stdout: librados2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.4 M 2026-02-17T08:20:52.294 INFO:teuthology.orchestra.run.trial016.stdout: librbd1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.2 M 2026-02-17T08:20:52.294 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-17T08:20:52.294 INFO:teuthology.orchestra.run.trial016.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: ceph-base x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.5 M 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 22 M 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: ceph-selinux x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 25 k 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.0 M 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T08:20:52.295 INFO:teuthology.orchestra.run.trial016.stdout: libradosstriper1 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 503 k 2026-02-17T08:20:52.296 INFO:teuthology.orchestra.run.trial016.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T08:20:52.296 INFO:teuthology.orchestra.run.trial016.stdout: librgw2 x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 5.4 M 2026-02-17T08:20:52.296 INFO:teuthology.orchestra.run.trial016.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T08:20:52.296 INFO:teuthology.orchestra.run.trial016.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T08:20:52.296 INFO:teuthology.orchestra.run.trial016.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T08:20:52.296 INFO:teuthology.orchestra.run.trial016.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T08:20:52.296 INFO:teuthology.orchestra.run.trial016.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-argparse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 45 k 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-common x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 154 k 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout: python3-cephfs x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 165 k 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout: python3-rados x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 323 k 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout: python3-rbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 303 k 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout: python3-rgw x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 100 k 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T08:20:52.297 INFO:teuthology.orchestra.run.trial016.stdout:Installing weak dependencies: 2026-02-17T08:20:52.298 INFO:teuthology.orchestra.run.trial016.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T08:20:52.298 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:20:52.298 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:20:52.298 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:20:52.298 INFO:teuthology.orchestra.run.trial016.stdout:Install 32 Packages 2026-02-17T08:20:52.298 INFO:teuthology.orchestra.run.trial016.stdout:Upgrade 2 Packages 2026-02-17T08:20:52.298 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:20:52.299 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 62 M 2026-02-17T08:20:52.299 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:20:52.570 INFO:teuthology.orchestra.run.trial134.stdout:(1/34): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 13 MB/s | 5.5 MB 00:00 2026-02-17T08:20:52.614 INFO:teuthology.orchestra.run.trial134.stdout:(2/34): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 574 kB/s | 25 kB 00:00 2026-02-17T08:20:52.681 INFO:teuthology.orchestra.run.trial134.stdout:(3/34): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 15 MB/s | 1.0 MB 00:00 2026-02-17T08:20:52.739 INFO:teuthology.orchestra.run.trial134.stdout:(4/34): libradosstriper1-19.2.3-705.g04cf6dd4.e 8.4 MB/s | 503 kB 00:00 2026-02-17T08:20:52.784 INFO:teuthology.orchestra.run.trial134.stdout:(5/34): ceph-radosgw-19.2.3-705.g04cf6dd4.el9.x 17 MB/s | 11 MB 00:00 2026-02-17T08:20:52.834 INFO:teuthology.orchestra.run.trial134.stdout:(6/34): python3-ceph-argparse-19.2.3-705.g04cf6 897 kB/s | 45 kB 00:00 2026-02-17T08:20:52.891 INFO:teuthology.orchestra.run.trial134.stdout:(7/34): python3-ceph-common-19.2.3-705.g04cf6dd 2.6 MB/s | 154 kB 00:00 2026-02-17T08:20:52.953 INFO:teuthology.orchestra.run.trial134.stdout:(8/34): python3-cephfs-19.2.3-705.g04cf6dd4.el9 2.6 MB/s | 165 kB 00:00 2026-02-17T08:20:53.020 INFO:teuthology.orchestra.run.trial134.stdout:(9/34): python3-rados-19.2.3-705.g04cf6dd4.el9. 4.7 MB/s | 323 kB 00:00 2026-02-17T08:20:53.031 INFO:teuthology.orchestra.run.trial134.stdout:(10/34): librgw2-19.2.3-705.g04cf6dd4.el9.x86_6 19 MB/s | 5.4 MB 00:00 2026-02-17T08:20:53.069 INFO:teuthology.orchestra.run.trial134.stdout:(11/34): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 6.0 MB/s | 303 kB 00:00 2026-02-17T08:20:53.097 INFO:teuthology.orchestra.run.trial134.stdout:(12/34): ceph-common-19.2.3-705.g04cf6dd4.el9.x 23 MB/s | 22 MB 00:00 2026-02-17T08:20:53.098 INFO:teuthology.orchestra.run.trial134.stdout:(13/34): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 1.5 MB/s | 100 kB 00:00 2026-02-17T08:20:53.124 INFO:teuthology.orchestra.run.trial134.stdout:(14/34): mailcap-2.1.49-5.el9.noarch.rpm 615 kB/s | 33 kB 00:00 2026-02-17T08:20:53.131 INFO:teuthology.orchestra.run.trial134.stdout:(15/34): pciutils-3.7.0-7.el9.x86_64.rpm 2.7 MB/s | 93 kB 00:00 2026-02-17T08:20:53.802 INFO:teuthology.orchestra.run.trial016.stdout:(1/34): ceph-base-19.2.3-705.g04cf6dd4.el9.x86_ 4.4 MB/s | 5.5 MB 00:01 2026-02-17T08:20:53.838 INFO:teuthology.orchestra.run.trial016.stdout:(2/34): ceph-selinux-19.2.3-705.g04cf6dd4.el9.x 692 kB/s | 25 kB 00:00 2026-02-17T08:20:53.948 INFO:teuthology.orchestra.run.trial134.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 196 kB/s | 160 kB 00:00 2026-02-17T08:20:53.949 INFO:teuthology.orchestra.run.trial016.stdout:(3/34): libcephfs2-19.2.3-705.g04cf6dd4.el9.x86 8.9 MB/s | 1.0 MB 00:00 2026-02-17T08:20:53.997 INFO:teuthology.orchestra.run.trial134.stdout:(17/34): boost-program-options-1.75.0-13.el9.x8 116 kB/s | 104 kB 00:00 2026-02-17T08:20:54.022 INFO:teuthology.orchestra.run.trial016.stdout:(4/34): libradosstriper1-19.2.3-705.g04cf6dd4.e 6.7 MB/s | 503 kB 00:00 2026-02-17T08:20:54.263 INFO:teuthology.orchestra.run.trial134.stdout:(18/34): libnbd-1.20.3-4.el9.x86_64.rpm 144 kB/s | 164 kB 00:01 2026-02-17T08:20:54.273 INFO:teuthology.orchestra.run.trial134.stdout:(19/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 139 kB/s | 45 kB 00:00 2026-02-17T08:20:54.285 INFO:teuthology.orchestra.run.trial016.stdout:(5/34): ceph-radosgw-19.2.3-705.g04cf6dd4.el9.x 6.2 MB/s | 11 MB 00:01 2026-02-17T08:20:54.324 INFO:teuthology.orchestra.run.trial016.stdout:(6/34): python3-ceph-argparse-19.2.3-705.g04cf6 1.1 MB/s | 45 kB 00:00 2026-02-17T08:20:54.363 INFO:teuthology.orchestra.run.trial016.stdout:(7/34): python3-ceph-common-19.2.3-705.g04cf6dd 3.8 MB/s | 154 kB 00:00 2026-02-17T08:20:54.402 INFO:teuthology.orchestra.run.trial016.stdout:(8/34): python3-cephfs-19.2.3-705.g04cf6dd4.el9 4.2 MB/s | 165 kB 00:00 2026-02-17T08:20:54.440 INFO:teuthology.orchestra.run.trial016.stdout:(9/34): librgw2-19.2.3-705.g04cf6dd4.el9.x86_64 13 MB/s | 5.4 MB 00:00 2026-02-17T08:20:54.441 INFO:teuthology.orchestra.run.trial016.stdout:(10/34): python3-rados-19.2.3-705.g04cf6dd4.el9 7.9 MB/s | 323 kB 00:00 2026-02-17T08:20:54.479 INFO:teuthology.orchestra.run.trial016.stdout:(11/34): python3-rbd-19.2.3-705.g04cf6dd4.el9.x 7.7 MB/s | 303 kB 00:00 2026-02-17T08:20:54.481 INFO:teuthology.orchestra.run.trial016.stdout:(12/34): python3-rgw-19.2.3-705.g04cf6dd4.el9.x 2.5 MB/s | 100 kB 00:00 2026-02-17T08:20:54.723 INFO:teuthology.orchestra.run.trial016.stdout:(13/34): ceph-common-19.2.3-705.g04cf6dd4.el9.x 10 MB/s | 22 MB 00:02 2026-02-17T08:20:54.744 INFO:teuthology.orchestra.run.trial016.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 4.9 MB/s | 104 kB 00:00 2026-02-17T08:20:54.753 INFO:teuthology.orchestra.run.trial016.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 18 MB/s | 164 kB 00:00 2026-02-17T08:20:54.760 INFO:teuthology.orchestra.run.trial016.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 23 MB/s | 160 kB 00:00 2026-02-17T08:20:54.764 INFO:teuthology.orchestra.run.trial016.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 10 MB/s | 45 kB 00:00 2026-02-17T08:20:54.774 INFO:teuthology.orchestra.run.trial016.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 65 MB/s | 662 kB 00:00 2026-02-17T08:20:54.780 INFO:teuthology.orchestra.run.trial016.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 45 MB/s | 292 kB 00:00 2026-02-17T08:20:54.787 INFO:teuthology.orchestra.run.trial016.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 39 MB/s | 240 kB 00:00 2026-02-17T08:20:54.791 INFO:teuthology.orchestra.run.trial016.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 8.5 MB/s | 37 kB 00:00 2026-02-17T08:20:54.796 INFO:teuthology.orchestra.run.trial016.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 15 MB/s | 66 kB 00:00 2026-02-17T08:20:54.832 INFO:teuthology.orchestra.run.trial016.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 8.3 MB/s | 308 kB 00:00 2026-02-17T08:20:54.853 INFO:teuthology.orchestra.run.trial016.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 212 MB/s | 4.4 MB 00:00 2026-02-17T08:20:54.857 INFO:teuthology.orchestra.run.trial016.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 6.9 MB/s | 25 kB 00:00 2026-02-17T08:20:54.860 INFO:teuthology.orchestra.run.trial016.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 14 MB/s | 49 kB 00:00 2026-02-17T08:20:54.864 INFO:teuthology.orchestra.run.trial016.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 19 MB/s | 67 kB 00:00 2026-02-17T08:20:54.870 INFO:teuthology.orchestra.run.trial016.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 147 MB/s | 838 kB 00:00 2026-02-17T08:20:54.877 INFO:teuthology.orchestra.run.trial016.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 26 MB/s | 191 kB 00:00 2026-02-17T08:20:54.884 INFO:teuthology.orchestra.run.trial016.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 216 MB/s | 1.6 MB 00:00 2026-02-17T08:20:54.890 INFO:teuthology.orchestra.run.trial134.stdout:(20/34): librdkafka-1.6.1-102.el9.x86_64.rpm 742 kB/s | 662 kB 00:00 2026-02-17T08:20:54.942 INFO:teuthology.orchestra.run.trial016.stdout:(31/34): mailcap-2.1.49-5.el9.noarch.rpm 72 kB/s | 33 kB 00:00 2026-02-17T08:20:55.054 INFO:teuthology.orchestra.run.trial134.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 225 kB/s | 37 kB 00:00 2026-02-17T08:20:55.098 INFO:teuthology.orchestra.run.trial016.stdout:(32/34): pciutils-3.7.0-7.el9.x86_64.rpm 151 kB/s | 93 kB 00:00 2026-02-17T08:20:55.107 INFO:teuthology.orchestra.run.trial016.stdout:(33/34): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 19 MB/s | 3.2 MB 00:00 2026-02-17T08:20:55.154 INFO:teuthology.orchestra.run.trial134.stdout:(22/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 328 kB/s | 292 kB 00:00 2026-02-17T08:20:55.167 INFO:teuthology.orchestra.run.trial134.stdout:(23/34): qatlib-25.08.0-2.el9.x86_64.rpm 268 kB/s | 240 kB 00:00 2026-02-17T08:20:55.168 INFO:teuthology.orchestra.run.trial016.stdout:(34/34): librados2-19.2.3-705.g04cf6dd4.el9.x86 12 MB/s | 3.4 MB 00:00 2026-02-17T08:20:55.172 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:20:55.172 INFO:teuthology.orchestra.run.trial016.stdout:Total 22 MB/s | 62 MB 00:02 2026-02-17T08:20:55.220 INFO:teuthology.orchestra.run.trial134.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 400 kB/s | 66 kB 00:00 2026-02-17T08:20:55.273 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:20:55.289 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:20:55.290 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:20:55.416 INFO:teuthology.orchestra.run.trial134.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 127 kB/s | 25 kB 00:00 2026-02-17T08:20:55.518 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:20:55.518 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:20:55.547 INFO:teuthology.orchestra.run.trial134.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 373 kB/s | 49 kB 00:00 2026-02-17T08:20:55.583 INFO:teuthology.orchestra.run.trial134.stdout:(27/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 717 kB/s | 308 kB 00:00 2026-02-17T08:20:55.643 INFO:teuthology.orchestra.run.trial134.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 701 kB/s | 67 kB 00:00 2026-02-17T08:20:55.772 INFO:teuthology.orchestra.run.trial134.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2026-02-17T08:20:55.797 INFO:teuthology.orchestra.run.trial134.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2026-02-17T08:20:55.804 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:20:55.813 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-17T08:20:55.815 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-17T08:20:55.822 INFO:teuthology.orchestra.run.trial134.stdout:(31/34): libarrow-9.0.0-15.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2026-02-17T08:20:55.827 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-17T08:20:55.922 INFO:teuthology.orchestra.run.trial134.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2026-02-17T08:20:55.978 INFO:teuthology.orchestra.run.trial016.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-17T08:20:55.982 INFO:teuthology.orchestra.run.trial016.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-17T08:20:56.010 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-17T08:20:56.054 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/36 2026-02-17T08:20:56.055 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-17T08:20:56.067 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-17T08:20:56.071 INFO:teuthology.orchestra.run.trial016.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-17T08:20:56.080 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/36 2026-02-17T08:20:56.102 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/36 2026-02-17T08:20:56.103 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-17T08:20:56.116 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-17T08:20:56.117 INFO:teuthology.orchestra.run.trial134.stdout:(33/34): librados2-19.2.3-705.g04cf6dd4.el9.x86 11 MB/s | 3.4 MB 00:00 2026-02-17T08:20:56.148 INFO:teuthology.orchestra.run.trial016.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-17T08:20:56.152 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-17T08:20:56.160 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-17T08:20:56.162 INFO:teuthology.orchestra.run.trial016.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-17T08:20:56.165 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-17T08:20:56.170 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-17T08:20:56.308 INFO:teuthology.orchestra.run.trial134.stdout:(34/34): librbd1-19.2.3-705.g04cf6dd4.el9.x86_6 6.5 MB/s | 3.2 MB 00:00 2026-02-17T08:20:56.310 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:20:56.310 INFO:teuthology.orchestra.run.trial134.stdout:Total 14 MB/s | 62 MB 00:04 2026-02-17T08:20:56.312 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-17T08:20:56.314 INFO:teuthology.orchestra.run.trial016.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/36 2026-02-17T08:20:56.340 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/36 2026-02-17T08:20:56.344 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/36 2026-02-17T08:20:56.350 INFO:teuthology.orchestra.run.trial016.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-17T08:20:56.399 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:20:56.417 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:20:56.417 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:20:56.576 INFO:teuthology.orchestra.run.trial016.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-17T08:20:56.577 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/36 2026-02-17T08:20:56.593 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/36 2026-02-17T08:20:56.596 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/36 2026-02-17T08:20:56.601 INFO:teuthology.orchestra.run.trial016.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-17T08:20:56.603 INFO:teuthology.orchestra.run.trial016.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-17T08:20:56.604 INFO:teuthology.orchestra.run.trial016.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T08:20:56.621 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T08:20:56.624 INFO:teuthology.orchestra.run.trial016.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-17T08:20:56.648 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:20:56.649 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:20:56.652 INFO:teuthology.orchestra.run.trial016.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-17T08:20:56.654 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 30/36 2026-02-17T08:20:56.934 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:20:56.942 INFO:teuthology.orchestra.run.trial134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-17T08:20:56.944 INFO:teuthology.orchestra.run.trial134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-17T08:20:56.956 INFO:teuthology.orchestra.run.trial134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-17T08:20:57.105 INFO:teuthology.orchestra.run.trial134.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-17T08:20:57.109 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-17T08:20:57.140 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-17T08:20:57.183 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/36 2026-02-17T08:20:57.184 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-17T08:20:57.197 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-17T08:20:57.201 INFO:teuthology.orchestra.run.trial134.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-17T08:20:57.212 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 9/36 2026-02-17T08:20:57.234 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/36 2026-02-17T08:20:57.235 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-17T08:20:57.248 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-17T08:20:57.279 INFO:teuthology.orchestra.run.trial134.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-17T08:20:57.283 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-17T08:20:57.289 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-17T08:20:57.291 INFO:teuthology.orchestra.run.trial134.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-17T08:20:57.294 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-17T08:20:57.299 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-17T08:20:57.439 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-17T08:20:57.440 INFO:teuthology.orchestra.run.trial134.stdout: Upgrading : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/36 2026-02-17T08:20:57.468 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 19/36 2026-02-17T08:20:57.471 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 20/36 2026-02-17T08:20:57.477 INFO:teuthology.orchestra.run.trial134.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-17T08:20:57.643 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-17T08:20:57.645 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-17T08:20:57.702 INFO:teuthology.orchestra.run.trial134.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-17T08:20:57.704 INFO:teuthology.orchestra.run.trial134.stdout: Installing : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/36 2026-02-17T08:20:57.720 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 23/36 2026-02-17T08:20:57.723 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 24/36 2026-02-17T08:20:57.728 INFO:teuthology.orchestra.run.trial134.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-17T08:20:57.730 INFO:teuthology.orchestra.run.trial134.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-17T08:20:57.731 INFO:teuthology.orchestra.run.trial134.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T08:20:57.749 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T08:20:57.752 INFO:teuthology.orchestra.run.trial134.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-17T08:20:57.781 INFO:teuthology.orchestra.run.trial134.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-17T08:20:57.783 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 30/36 2026-02-17T08:20:57.930 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-17T08:20:57.933 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/36 2026-02-17T08:20:57.970 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/36 2026-02-17T08:20:57.971 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T08:20:57.971 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T08:20:57.971 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:20:57.974 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-17T08:20:58.766 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-17T08:20:58.768 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-17T08:20:59.055 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 31/36 2026-02-17T08:20:59.058 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/36 2026-02-17T08:20:59.099 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 32/36 2026-02-17T08:20:59.099 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T08:20:59.100 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T08:20:59.100 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:20:59.103 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-17T08:21:02.490 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-17T08:21:02.490 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /sys 2026-02-17T08:21:02.490 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /proc 2026-02-17T08:21:02.490 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /mnt 2026-02-17T08:21:02.490 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /var/tmp 2026-02-17T08:21:02.490 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /home 2026-02-17T08:21:02.490 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /root 2026-02-17T08:21:02.491 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /tmp 2026-02-17T08:21:02.491 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:02.944 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/36 2026-02-17T08:21:02.969 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/36 2026-02-17T08:21:02.969 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:02.969 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T08:21:02.969 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:21:02.969 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:21:02.969 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:02.971 INFO:teuthology.orchestra.run.trial016.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T08:21:02.984 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T08:21:02.986 INFO:teuthology.orchestra.run.trial016.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T08:21:03.041 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T08:21:03.041 INFO:teuthology.orchestra.run.trial016.stdout:Creating group 'qat' with GID 992. 2026-02-17T08:21:03.041 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:03.313 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/36 2026-02-17T08:21:03.313 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/36 2026-02-17T08:21:03.313 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/36 2026-02-17T08:21:03.313 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/36 2026-02-17T08:21:03.313 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-17T08:21:03.313 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-17T08:21:03.314 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-17T08:21:03.315 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-17T08:21:03.316 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-17T08:21:03.316 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-17T08:21:03.316 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-17T08:21:03.316 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/36 2026-02-17T08:21:03.373 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T08:21:03.373 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:03.373 INFO:teuthology.orchestra.run.trial016.stdout:Upgraded: 2026-02-17T08:21:03.373 INFO:teuthology.orchestra.run.trial016.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.373 INFO:teuthology.orchestra.run.trial016.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.374 INFO:teuthology.orchestra.run.trial016.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.375 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:03.376 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:03.416 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-test 2026-02-17T08:21:03.595 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-17T08:21:03.596 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /sys 2026-02-17T08:21:03.596 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /proc 2026-02-17T08:21:03.596 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /mnt 2026-02-17T08:21:03.596 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /var/tmp 2026-02-17T08:21:03.596 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /home 2026-02-17T08:21:03.596 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /root 2026-02-17T08:21:03.596 INFO:teuthology.orchestra.run.trial134.stdout:skipping the directory /tmp 2026-02-17T08:21:03.596 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:03.726 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:03.808 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:03.809 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:03.809 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repository Size 2026-02-17T08:21:03.809 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:03.809 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout:Install 5 Packages 2026-02-17T08:21:03.810 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:03.811 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 50 M 2026-02-17T08:21:03.811 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 212 M 2026-02-17T08:21:03.811 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:21:03.981 INFO:teuthology.orchestra.run.trial016.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 2.6 MB/s | 233 kB 00:00 2026-02-17T08:21:04.029 INFO:teuthology.orchestra.run.trial016.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 6.2 MB/s | 303 kB 00:00 2026-02-17T08:21:04.050 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/36 2026-02-17T08:21:04.051 INFO:teuthology.orchestra.run.trial016.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-17T08:21:04.072 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 34/36 2026-02-17T08:21:04.073 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:04.073 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T08:21:04.073 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:21:04.073 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T08:21:04.073 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:04.074 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T08:21:04.087 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T08:21:04.087 INFO:teuthology.orchestra.run.trial134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T08:21:04.139 INFO:teuthology.orchestra.run.trial016.stdout:(4/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 667 kB/s | 163 kB 00:00 2026-02-17T08:21:04.142 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T08:21:04.142 INFO:teuthology.orchestra.run.trial134.stdout:Creating group 'qat' with GID 992. 2026-02-17T08:21:04.142 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:04.415 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/36 2026-02-17T08:21:04.415 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/36 2026-02-17T08:21:04.415 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/36 2026-02-17T08:21:04.415 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 6/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 7/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x 8/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86 9/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 10/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 11/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 12/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 13/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-17T08:21:04.416 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-17T08:21:04.417 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-17T08:21:04.418 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-17T08:21:04.418 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-17T08:21:04.418 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-17T08:21:04.418 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-17T08:21:04.418 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 33/36 2026-02-17T08:21:04.418 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-17T08:21:04.418 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 35/36 2026-02-17T08:21:04.476 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T08:21:04.477 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:04.477 INFO:teuthology.orchestra.run.trial134.stdout:Upgraded: 2026-02-17T08:21:04.477 INFO:teuthology.orchestra.run.trial134.stdout: librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.477 INFO:teuthology.orchestra.run.trial134.stdout: librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.477 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:21:04.477 INFO:teuthology.orchestra.run.trial134.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T08:21:04.477 INFO:teuthology.orchestra.run.trial134.stdout: ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.477 INFO:teuthology.orchestra.run.trial134.stdout: ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.477 INFO:teuthology.orchestra.run.trial134.stdout: ceph-radosgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: ceph-selinux-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: libradosstriper1-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T08:21:04.478 INFO:teuthology.orchestra.run.trial134.stdout: librgw2-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: python3-ceph-argparse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: python3-ceph-common-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:04.479 INFO:teuthology.orchestra.run.trial134.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T08:21:04.480 INFO:teuthology.orchestra.run.trial134.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T08:21:04.480 INFO:teuthology.orchestra.run.trial134.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T08:21:04.480 INFO:teuthology.orchestra.run.trial134.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T08:21:04.480 INFO:teuthology.orchestra.run.trial134.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T08:21:04.480 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:04.480 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:04.518 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-test 2026-02-17T08:21:04.830 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:14 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:04.911 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:04.912 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:04.912 INFO:teuthology.orchestra.run.trial134.stdout: Package Arch Version Repository Size 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout: ceph-test x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 50 M 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout:Installing dependencies: 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout: libcephsqlite x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 163 k 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:21:04.913 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:04.914 INFO:teuthology.orchestra.run.trial134.stdout:Install 5 Packages 2026-02-17T08:21:04.914 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:04.914 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 50 M 2026-02-17T08:21:04.914 INFO:teuthology.orchestra.run.trial134.stdout:Installed size: 212 M 2026-02-17T08:21:04.914 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:21:05.028 INFO:teuthology.orchestra.run.trial134.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.0 MB/s | 233 kB 00:00 2026-02-17T08:21:05.046 INFO:teuthology.orchestra.run.trial134.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 16 MB/s | 303 kB 00:00 2026-02-17T08:21:05.056 INFO:teuthology.orchestra.run.trial134.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 6.5 MB/s | 64 kB 00:00 2026-02-17T08:21:05.450 INFO:teuthology.orchestra.run.trial134.stdout:(4/5): libcephsqlite-19.2.3-705.g04cf6dd4.el9.x 341 kB/s | 163 kB 00:00 2026-02-17T08:21:07.485 INFO:teuthology.orchestra.run.trial016.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 14 MB/s | 50 MB 00:03 2026-02-17T08:21:07.486 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:07.487 INFO:teuthology.orchestra.run.trial016.stdout:Total 14 MB/s | 50 MB 00:03 2026-02-17T08:21:07.514 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:21:07.523 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:21:07.523 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:21:07.710 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:21:07.710 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:21:07.927 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:21:07.933 INFO:teuthology.orchestra.run.trial016.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T08:21:07.937 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T08:21:07.945 INFO:teuthology.orchestra.run.trial016.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T08:21:07.946 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T08:21:08.166 INFO:teuthology.orchestra.run.trial134.stdout:(5/5): ceph-test-19.2.3-705.g04cf6dd4.el9.x86_6 16 MB/s | 50 MB 00:03 2026-02-17T08:21:08.167 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:08.167 INFO:teuthology.orchestra.run.trial134.stdout:Total 15 MB/s | 50 MB 00:03 2026-02-17T08:21:08.194 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:21:08.202 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:21:08.202 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:21:08.392 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:21:08.392 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:21:08.605 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:21:08.611 INFO:teuthology.orchestra.run.trial134.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T08:21:08.615 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T08:21:08.623 INFO:teuthology.orchestra.run.trial134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T08:21:08.624 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T08:21:10.199 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T08:21:10.218 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T08:21:10.433 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T08:21:10.433 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-17T08:21:10.434 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-17T08:21:10.434 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T08:21:10.434 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T08:21:10.486 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T08:21:10.486 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:10.486 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:21:10.486 INFO:teuthology.orchestra.run.trial016.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:10.486 INFO:teuthology.orchestra.run.trial016.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:10.487 INFO:teuthology.orchestra.run.trial016.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T08:21:10.487 INFO:teuthology.orchestra.run.trial016.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T08:21:10.487 INFO:teuthology.orchestra.run.trial016.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T08:21:10.487 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:10.487 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:10.519 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph 2026-02-17T08:21:10.824 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:19 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:10.874 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/5 2026-02-17T08:21:10.892 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T08:21:10.909 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:10.912 INFO:teuthology.orchestra.run.trial016.stdout:====================================================================================== 2026-02-17T08:21:10.912 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repository Size 2026-02-17T08:21:10.912 INFO:teuthology.orchestra.run.trial016.stdout:====================================================================================== 2026-02-17T08:21:10.912 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-17T08:21:10.913 INFO:teuthology.orchestra.run.trial016.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T08:21:10.914 INFO:teuthology.orchestra.run.trial016.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T08:21:10.915 INFO:teuthology.orchestra.run.trial016.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T08:21:10.916 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T08:21:10.917 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T08:21:10.918 INFO:teuthology.orchestra.run.trial016.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T08:21:10.919 INFO:teuthology.orchestra.run.trial016.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout:Installing weak dependencies: 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T08:21:10.920 INFO:teuthology.orchestra.run.trial016.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T08:21:10.921 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:10.921 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:21:10.921 INFO:teuthology.orchestra.run.trial016.stdout:====================================================================================== 2026-02-17T08:21:10.921 INFO:teuthology.orchestra.run.trial016.stdout:Install 98 Packages 2026-02-17T08:21:10.921 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:10.922 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 95 M 2026-02-17T08:21:10.922 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 519 M 2026-02-17T08:21:10.922 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:21:11.132 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/5 2026-02-17T08:21:11.132 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/5 2026-02-17T08:21:11.132 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/5 2026-02-17T08:21:11.133 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T08:21:11.133 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T08:21:11.185 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T08:21:11.185 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:11.185 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:21:11.186 INFO:teuthology.orchestra.run.trial134.stdout: ceph-test-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:11.186 INFO:teuthology.orchestra.run.trial134.stdout: libcephsqlite-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:11.186 INFO:teuthology.orchestra.run.trial134.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T08:21:11.186 INFO:teuthology.orchestra.run.trial134.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T08:21:11.186 INFO:teuthology.orchestra.run.trial134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T08:21:11.186 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:11.186 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:11.224 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph 2026-02-17T08:21:11.494 INFO:teuthology.orchestra.run.trial016.stdout:(1/98): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 27 kB/s | 6.5 kB 00:00 2026-02-17T08:21:11.555 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:21 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:11.640 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:11.643 INFO:teuthology.orchestra.run.trial134.stdout:====================================================================================== 2026-02-17T08:21:11.644 INFO:teuthology.orchestra.run.trial134.stdout: Package Arch Version Repository Size 2026-02-17T08:21:11.644 INFO:teuthology.orchestra.run.trial134.stdout:====================================================================================== 2026-02-17T08:21:11.644 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:21:11.644 INFO:teuthology.orchestra.run.trial134.stdout: ceph x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 6.5 k 2026-02-17T08:21:11.644 INFO:teuthology.orchestra.run.trial134.stdout:Installing dependencies: 2026-02-17T08:21:11.645 INFO:teuthology.orchestra.run.trial134.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T08:21:11.645 INFO:teuthology.orchestra.run.trial134.stdout: ceph-grafana-dashboards noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 31 k 2026-02-17T08:21:11.645 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mds x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 2.4 M 2026-02-17T08:21:11.645 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.1 M 2026-02-17T08:21:11.645 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-modules-core noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 253 k 2026-02-17T08:21:11.645 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mon x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 4.7 M 2026-02-17T08:21:11.646 INFO:teuthology.orchestra.run.trial134.stdout: ceph-osd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 17 M 2026-02-17T08:21:11.646 INFO:teuthology.orchestra.run.trial134.stdout: ceph-prometheus-alerts noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 17 k 2026-02-17T08:21:11.646 INFO:teuthology.orchestra.run.trial134.stdout: cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 769 k 2026-02-17T08:21:11.646 INFO:teuthology.orchestra.run.trial134.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T08:21:11.646 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T08:21:11.646 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T08:21:11.647 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T08:21:11.647 INFO:teuthology.orchestra.run.trial134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T08:21:11.647 INFO:teuthology.orchestra.run.trial134.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T08:21:11.647 INFO:teuthology.orchestra.run.trial134.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T08:21:11.647 INFO:teuthology.orchestra.run.trial134.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T08:21:11.647 INFO:teuthology.orchestra.run.trial134.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T08:21:11.648 INFO:teuthology.orchestra.run.trial134.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T08:21:11.648 INFO:teuthology.orchestra.run.trial134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T08:21:11.648 INFO:teuthology.orchestra.run.trial134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T08:21:11.648 INFO:teuthology.orchestra.run.trial134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T08:21:11.648 INFO:teuthology.orchestra.run.trial134.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T08:21:11.648 INFO:teuthology.orchestra.run.trial134.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T08:21:11.648 INFO:teuthology.orchestra.run.trial134.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T08:21:11.649 INFO:teuthology.orchestra.run.trial134.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T08:21:11.649 INFO:teuthology.orchestra.run.trial134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T08:21:11.649 INFO:teuthology.orchestra.run.trial134.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T08:21:11.649 INFO:teuthology.orchestra.run.trial134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T08:21:11.649 INFO:teuthology.orchestra.run.trial134.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T08:21:11.649 INFO:teuthology.orchestra.run.trial134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T08:21:11.650 INFO:teuthology.orchestra.run.trial134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T08:21:11.650 INFO:teuthology.orchestra.run.trial134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T08:21:11.650 INFO:teuthology.orchestra.run.trial134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T08:21:11.650 INFO:teuthology.orchestra.run.trial134.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T08:21:11.650 INFO:teuthology.orchestra.run.trial134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T08:21:11.650 INFO:teuthology.orchestra.run.trial134.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T08:21:11.651 INFO:teuthology.orchestra.run.trial134.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T08:21:11.651 INFO:teuthology.orchestra.run.trial134.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T08:21:11.651 INFO:teuthology.orchestra.run.trial134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T08:21:11.651 INFO:teuthology.orchestra.run.trial134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T08:21:11.651 INFO:teuthology.orchestra.run.trial134.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T08:21:11.651 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T08:21:11.652 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T08:21:11.652 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T08:21:11.652 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T08:21:11.652 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T08:21:11.652 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T08:21:11.652 INFO:teuthology.orchestra.run.trial134.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T08:21:11.653 INFO:teuthology.orchestra.run.trial134.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T08:21:11.653 INFO:teuthology.orchestra.run.trial134.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T08:21:11.653 INFO:teuthology.orchestra.run.trial134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T08:21:11.653 INFO:teuthology.orchestra.run.trial134.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T08:21:11.653 INFO:teuthology.orchestra.run.trial134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T08:21:11.653 INFO:teuthology.orchestra.run.trial134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T08:21:11.654 INFO:teuthology.orchestra.run.trial134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T08:21:11.654 INFO:teuthology.orchestra.run.trial134.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T08:21:11.654 INFO:teuthology.orchestra.run.trial134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T08:21:11.654 INFO:teuthology.orchestra.run.trial134.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T08:21:11.654 INFO:teuthology.orchestra.run.trial134.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T08:21:11.654 INFO:teuthology.orchestra.run.trial134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T08:21:11.655 INFO:teuthology.orchestra.run.trial134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T08:21:11.655 INFO:teuthology.orchestra.run.trial134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T08:21:11.655 INFO:teuthology.orchestra.run.trial134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T08:21:11.655 INFO:teuthology.orchestra.run.trial134.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T08:21:11.655 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T08:21:11.655 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T08:21:11.656 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T08:21:11.656 INFO:teuthology.orchestra.run.trial134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T08:21:11.656 INFO:teuthology.orchestra.run.trial134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T08:21:11.656 INFO:teuthology.orchestra.run.trial134.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T08:21:11.656 INFO:teuthology.orchestra.run.trial134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T08:21:11.656 INFO:teuthology.orchestra.run.trial134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T08:21:11.656 INFO:teuthology.orchestra.run.trial134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T08:21:11.657 INFO:teuthology.orchestra.run.trial134.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T08:21:11.657 INFO:teuthology.orchestra.run.trial134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T08:21:11.657 INFO:teuthology.orchestra.run.trial134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T08:21:11.657 INFO:teuthology.orchestra.run.trial134.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T08:21:11.657 INFO:teuthology.orchestra.run.trial134.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T08:21:11.657 INFO:teuthology.orchestra.run.trial134.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T08:21:11.657 INFO:teuthology.orchestra.run.trial134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T08:21:11.658 INFO:teuthology.orchestra.run.trial134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T08:21:11.658 INFO:teuthology.orchestra.run.trial134.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T08:21:11.658 INFO:teuthology.orchestra.run.trial134.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T08:21:11.658 INFO:teuthology.orchestra.run.trial134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T08:21:11.658 INFO:teuthology.orchestra.run.trial134.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T08:21:11.658 INFO:teuthology.orchestra.run.trial134.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T08:21:11.658 INFO:teuthology.orchestra.run.trial134.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T08:21:11.659 INFO:teuthology.orchestra.run.trial134.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T08:21:11.659 INFO:teuthology.orchestra.run.trial134.stdout:Installing weak dependencies: 2026-02-17T08:21:11.659 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-cephadm noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 150 k 2026-02-17T08:21:11.659 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-dashboard noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 3.8 M 2026-02-17T08:21:11.659 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 7.4 M 2026-02-17T08:21:11.659 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 22 k 2026-02-17T08:21:11.659 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-rook noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 49 k 2026-02-17T08:21:11.660 INFO:teuthology.orchestra.run.trial134.stdout: ceph-volume noarch 2:19.2.3-705.g04cf6dd4.el9 ceph-noarch 299 k 2026-02-17T08:21:11.660 INFO:teuthology.orchestra.run.trial134.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T08:21:11.660 INFO:teuthology.orchestra.run.trial134.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T08:21:11.660 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:11.660 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:21:11.660 INFO:teuthology.orchestra.run.trial134.stdout:====================================================================================== 2026-02-17T08:21:11.661 INFO:teuthology.orchestra.run.trial134.stdout:Install 98 Packages 2026-02-17T08:21:11.661 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:11.662 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 95 M 2026-02-17T08:21:11.662 INFO:teuthology.orchestra.run.trial134.stdout:Installed size: 519 M 2026-02-17T08:21:11.662 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:21:11.915 INFO:teuthology.orchestra.run.trial016.stdout:(2/98): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 1.6 MB/s | 1.1 MB 00:00 2026-02-17T08:21:12.151 INFO:teuthology.orchestra.run.trial016.stdout:(3/98): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 2.7 MB/s | 2.4 MB 00:00 2026-02-17T08:21:12.175 INFO:teuthology.orchestra.run.trial016.stdout:(4/98): ceph-grafana-dashboards-19.2.3-705.g04c 1.3 MB/s | 31 kB 00:00 2026-02-17T08:21:12.198 INFO:teuthology.orchestra.run.trial016.stdout:(5/98): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 6.4 MB/s | 150 kB 00:00 2026-02-17T08:21:12.316 INFO:teuthology.orchestra.run.trial134.stdout:(1/98): ceph-19.2.3-705.g04cf6dd4.el9.x86_64.rp 65 kB/s | 6.5 kB 00:00 2026-02-17T08:21:12.432 INFO:teuthology.orchestra.run.trial016.stdout:(6/98): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 5.0 MB/s | 4.7 MB 00:00 2026-02-17T08:21:12.525 INFO:teuthology.orchestra.run.trial134.stdout:(2/98): ceph-mgr-19.2.3-705.g04cf6dd4.el9.x86_6 3.5 MB/s | 1.1 MB 00:00 2026-02-17T08:21:12.666 INFO:teuthology.orchestra.run.trial134.stdout:(3/98): ceph-mds-19.2.3-705.g04cf6dd4.el9.x86_6 5.4 MB/s | 2.4 MB 00:00 2026-02-17T08:21:12.717 INFO:teuthology.orchestra.run.trial134.stdout:(4/98): ceph-grafana-dashboards-19.2.3-705.g04c 611 kB/s | 31 kB 00:00 2026-02-17T08:21:12.764 INFO:teuthology.orchestra.run.trial016.stdout:(7/98): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 6.7 MB/s | 3.8 MB 00:00 2026-02-17T08:21:12.771 INFO:teuthology.orchestra.run.trial134.stdout:(5/98): ceph-mgr-cephadm-19.2.3-705.g04cf6dd4.e 2.7 MB/s | 150 kB 00:00 2026-02-17T08:21:12.816 INFO:teuthology.orchestra.run.trial016.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 418 kB/s | 22 kB 00:00 2026-02-17T08:21:12.884 INFO:teuthology.orchestra.run.trial016.stdout:(9/98): ceph-mgr-modules-core-19.2.3-705.g04cf6 3.7 MB/s | 253 kB 00:00 2026-02-17T08:21:12.950 INFO:teuthology.orchestra.run.trial016.stdout:(10/98): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 745 kB/s | 49 kB 00:00 2026-02-17T08:21:13.019 INFO:teuthology.orchestra.run.trial016.stdout:(11/98): ceph-prometheus-alerts-19.2.3-705.g04c 243 kB/s | 17 kB 00:00 2026-02-17T08:21:13.222 INFO:teuthology.orchestra.run.trial134.stdout:(6/98): ceph-mgr-dashboard-19.2.3-705.g04cf6dd4 8.4 MB/s | 3.8 MB 00:00 2026-02-17T08:21:13.261 INFO:teuthology.orchestra.run.trial134.stdout:(7/98): ceph-mon-19.2.3-705.g04cf6dd4.el9.x86_6 5.0 MB/s | 4.7 MB 00:00 2026-02-17T08:21:13.301 INFO:teuthology.orchestra.run.trial134.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-705.g04cf6dd4 553 kB/s | 22 kB 00:00 2026-02-17T08:21:13.344 INFO:teuthology.orchestra.run.trial134.stdout:(9/98): ceph-mgr-modules-core-19.2.3-705.g04cf6 5.8 MB/s | 253 kB 00:00 2026-02-17T08:21:13.384 INFO:teuthology.orchestra.run.trial134.stdout:(10/98): ceph-mgr-rook-19.2.3-705.g04cf6dd4.el9 1.2 MB/s | 49 kB 00:00 2026-02-17T08:21:13.425 INFO:teuthology.orchestra.run.trial134.stdout:(11/98): ceph-prometheus-alerts-19.2.3-705.g04c 409 kB/s | 17 kB 00:00 2026-02-17T08:21:13.502 INFO:teuthology.orchestra.run.trial016.stdout:(12/98): ceph-mgr-diskprediction-local-19.2.3-7 6.9 MB/s | 7.4 MB 00:01 2026-02-17T08:21:13.507 INFO:teuthology.orchestra.run.trial134.stdout:(12/98): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 3.6 MB/s | 299 kB 00:00 2026-02-17T08:21:13.562 INFO:teuthology.orchestra.run.trial016.stdout:(13/98): ceph-volume-19.2.3-705.g04cf6dd4.el9.n 549 kB/s | 299 kB 00:00 2026-02-17T08:21:13.609 INFO:teuthology.orchestra.run.trial016.stdout:(14/98): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 7.0 MB/s | 769 kB 00:00 2026-02-17T08:21:13.620 INFO:teuthology.orchestra.run.trial134.stdout:(13/98): cephadm-19.2.3-705.g04cf6dd4.el9.noarc 6.6 MB/s | 769 kB 00:00 2026-02-17T08:21:13.642 INFO:teuthology.orchestra.run.trial134.stdout:(14/98): cryptsetup-2.8.1-2.el9.x86_64.rpm 16 MB/s | 350 kB 00:00 2026-02-17T08:21:13.652 INFO:teuthology.orchestra.run.trial134.stdout:(15/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 3.8 MB/s | 40 kB 00:00 2026-02-17T08:21:13.657 INFO:teuthology.orchestra.run.trial134.stdout:(16/98): libconfig-1.7.2-9.el9.x86_64.rpm 15 MB/s | 72 kB 00:00 2026-02-17T08:21:13.667 INFO:teuthology.orchestra.run.trial134.stdout:(17/98): libgfortran-11.5.0-14.el9.x86_64.rpm 86 MB/s | 794 kB 00:00 2026-02-17T08:21:13.674 INFO:teuthology.orchestra.run.trial134.stdout:(18/98): libquadmath-11.5.0-14.el9.x86_64.rpm 26 MB/s | 184 kB 00:00 2026-02-17T08:21:13.681 INFO:teuthology.orchestra.run.trial134.stdout:(19/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 36 MB/s | 253 kB 00:00 2026-02-17T08:21:13.696 INFO:teuthology.orchestra.run.trial016.stdout:(15/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 465 kB/s | 40 kB 00:00 2026-02-17T08:21:13.711 INFO:teuthology.orchestra.run.trial134.stdout:(20/98): python3-cryptography-36.0.1-5.el9.x86_ 42 MB/s | 1.2 MB 00:00 2026-02-17T08:21:13.717 INFO:teuthology.orchestra.run.trial134.stdout:(21/98): python3-ply-3.11-14.el9.noarch.rpm 18 MB/s | 106 kB 00:00 2026-02-17T08:21:13.723 INFO:teuthology.orchestra.run.trial134.stdout:(22/98): python3-pycparser-2.20-6.el9.noarch.rp 22 MB/s | 135 kB 00:00 2026-02-17T08:21:13.729 INFO:teuthology.orchestra.run.trial134.stdout:(23/98): python3-requests-2.25.1-10.el9.noarch. 21 MB/s | 126 kB 00:00 2026-02-17T08:21:13.730 INFO:teuthology.orchestra.run.trial016.stdout:(16/98): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.0 MB/s | 350 kB 00:00 2026-02-17T08:21:13.736 INFO:teuthology.orchestra.run.trial134.stdout:(24/98): python3-urllib3-1.26.5-7.el9.noarch.rp 32 MB/s | 218 kB 00:00 2026-02-17T08:21:13.742 INFO:teuthology.orchestra.run.trial134.stdout:(25/98): unzip-6.0-59.el9.x86_64.rpm 26 MB/s | 182 kB 00:00 2026-02-17T08:21:13.755 INFO:teuthology.orchestra.run.trial016.stdout:(17/98): libconfig-1.7.2-9.el9.x86_64.rpm 1.2 MB/s | 72 kB 00:00 2026-02-17T08:21:13.757 INFO:teuthology.orchestra.run.trial134.stdout:(26/98): ceph-mgr-diskprediction-local-19.2.3-7 14 MB/s | 7.4 MB 00:00 2026-02-17T08:21:13.758 INFO:teuthology.orchestra.run.trial134.stdout:(27/98): zip-3.0-35.el9.x86_64.rpm 17 MB/s | 266 kB 00:00 2026-02-17T08:21:13.799 INFO:teuthology.orchestra.run.trial016.stdout:(18/98): libgfortran-11.5.0-14.el9.x86_64.rpm 11 MB/s | 794 kB 00:00 2026-02-17T08:21:13.806 INFO:teuthology.orchestra.run.trial134.stdout:(28/98): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 13 MB/s | 17 MB 00:01 2026-02-17T08:21:13.817 INFO:teuthology.orchestra.run.trial016.stdout:(19/98): libquadmath-11.5.0-14.el9.x86_64.rpm 2.9 MB/s | 184 kB 00:00 2026-02-17T08:21:13.829 INFO:teuthology.orchestra.run.trial016.stdout:(20/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 8.2 MB/s | 253 kB 00:00 2026-02-17T08:21:13.837 INFO:teuthology.orchestra.run.trial134.stdout:(29/98): flexiblas-3.0.4-9.el9.x86_64.rpm 368 kB/s | 30 kB 00:00 2026-02-17T08:21:13.859 INFO:teuthology.orchestra.run.trial016.stdout:(21/98): ceph-osd-19.2.3-705.g04cf6dd4.el9.x86_ 8.8 MB/s | 17 MB 00:01 2026-02-17T08:21:13.860 INFO:teuthology.orchestra.run.trial016.stdout:(22/98): python3-ply-3.11-14.el9.noarch.rpm 3.3 MB/s | 106 kB 00:00 2026-02-17T08:21:13.878 INFO:teuthology.orchestra.run.trial134.stdout:(30/98): flexiblas-openblas-openmp-3.0.4-9.el9. 204 kB/s | 15 kB 00:00 2026-02-17T08:21:13.887 INFO:teuthology.orchestra.run.trial016.stdout:(23/98): python3-requests-2.25.1-10.el9.noarch. 4.6 MB/s | 126 kB 00:00 2026-02-17T08:21:13.914 INFO:teuthology.orchestra.run.trial016.stdout:(24/98): python3-cryptography-36.0.1-5.el9.x86_ 13 MB/s | 1.2 MB 00:00 2026-02-17T08:21:13.916 INFO:teuthology.orchestra.run.trial016.stdout:(25/98): python3-urllib3-1.26.5-7.el9.noarch.rp 7.4 MB/s | 218 kB 00:00 2026-02-17T08:21:13.937 INFO:teuthology.orchestra.run.trial134.stdout:(31/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.4 MB/s | 246 kB 00:00 2026-02-17T08:21:13.941 INFO:teuthology.orchestra.run.trial016.stdout:(26/98): unzip-6.0-59.el9.x86_64.rpm 6.6 MB/s | 182 kB 00:00 2026-02-17T08:21:13.946 INFO:teuthology.orchestra.run.trial016.stdout:(27/98): zip-3.0-35.el9.x86_64.rpm 8.6 MB/s | 266 kB 00:00 2026-02-17T08:21:13.963 INFO:teuthology.orchestra.run.trial134.stdout:(32/98): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-17T08:21:13.976 INFO:teuthology.orchestra.run.trial016.stdout:(28/98): flexiblas-3.0.4-9.el9.x86_64.rpm 856 kB/s | 30 kB 00:00 2026-02-17T08:21:13.980 INFO:teuthology.orchestra.run.trial134.stdout:(33/98): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2026-02-17T08:21:13.985 INFO:teuthology.orchestra.run.trial016.stdout:(29/98): flexiblas-openblas-openmp-3.0.4-9.el9. 1.7 MB/s | 15 kB 00:00 2026-02-17T08:21:13.993 INFO:teuthology.orchestra.run.trial016.stdout:(30/98): python3-pycparser-2.20-6.el9.noarch.rp 1.0 MB/s | 135 kB 00:00 2026-02-17T08:21:14.002 INFO:teuthology.orchestra.run.trial134.stdout:(34/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 12 MB/s | 3.0 MB 00:00 2026-02-17T08:21:14.015 INFO:teuthology.orchestra.run.trial016.stdout:(31/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 8.1 MB/s | 246 kB 00:00 2026-02-17T08:21:14.026 INFO:teuthology.orchestra.run.trial016.stdout:(32/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 37 MB/s | 3.0 MB 00:00 2026-02-17T08:21:14.027 INFO:teuthology.orchestra.run.trial016.stdout:(33/98): openblas-0.3.29-1.el9.x86_64.rpm 3.5 MB/s | 42 kB 00:00 2026-02-17T08:21:14.039 INFO:teuthology.orchestra.run.trial016.stdout:(34/98): lua-5.4.4-4.el9.x86_64.rpm 4.1 MB/s | 188 kB 00:00 2026-02-17T08:21:14.040 INFO:teuthology.orchestra.run.trial016.stdout:(35/98): protobuf-3.14.0-17.el9.x86_64.rpm 75 MB/s | 1.0 MB 00:00 2026-02-17T08:21:14.052 INFO:teuthology.orchestra.run.trial016.stdout:(36/98): python3-devel-3.9.25-2.el9.x86_64.rpm 20 MB/s | 244 kB 00:00 2026-02-17T08:21:14.064 INFO:teuthology.orchestra.run.trial016.stdout:(37/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 21 MB/s | 249 kB 00:00 2026-02-17T08:21:14.077 INFO:teuthology.orchestra.run.trial134.stdout:(35/98): python3-babel-2.9.1-2.el9.noarch.rpm 81 MB/s | 6.0 MB 00:00 2026-02-17T08:21:14.078 INFO:teuthology.orchestra.run.trial016.stdout:(38/98): python3-libstoragemgmt-1.10.1-1.el9.x8 13 MB/s | 177 kB 00:00 2026-02-17T08:21:14.078 INFO:teuthology.orchestra.run.trial134.stdout:(36/98): protobuf-3.14.0-17.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2026-02-17T08:21:14.093 INFO:teuthology.orchestra.run.trial016.stdout:(39/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 79 MB/s | 1.2 MB 00:00 2026-02-17T08:21:14.105 INFO:teuthology.orchestra.run.trial134.stdout:(37/98): python3-devel-3.9.25-2.el9.x86_64.rpm 8.4 MB/s | 244 kB 00:00 2026-02-17T08:21:14.106 INFO:teuthology.orchestra.run.trial016.stdout:(40/98): python3-mako-1.1.4-6.el9.noarch.rpm 13 MB/s | 172 kB 00:00 2026-02-17T08:21:14.107 INFO:teuthology.orchestra.run.trial134.stdout:(38/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.4 MB/s | 249 kB 00:00 2026-02-17T08:21:14.117 INFO:teuthology.orchestra.run.trial016.stdout:(41/98): python3-markupsafe-1.1.1-12.el9.x86_64 3.1 MB/s | 35 kB 00:00 2026-02-17T08:21:14.133 INFO:teuthology.orchestra.run.trial134.stdout:(39/98): python3-libstoragemgmt-1.10.1-1.el9.x8 6.1 MB/s | 177 kB 00:00 2026-02-17T08:21:14.139 INFO:teuthology.orchestra.run.trial134.stdout:(40/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 30 MB/s | 5.3 MB 00:00 2026-02-17T08:21:14.149 INFO:teuthology.orchestra.run.trial016.stdout:(42/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 190 MB/s | 6.1 MB 00:00 2026-02-17T08:21:14.155 INFO:teuthology.orchestra.run.trial016.stdout:(43/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 41 MB/s | 5.3 MB 00:00 2026-02-17T08:21:14.158 INFO:teuthology.orchestra.run.trial134.stdout:(41/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 24 MB/s | 1.2 MB 00:00 2026-02-17T08:21:14.161 INFO:teuthology.orchestra.run.trial134.stdout:(42/98): python3-mako-1.1.4-6.el9.noarch.rpm 6.1 MB/s | 172 kB 00:00 2026-02-17T08:21:14.162 INFO:teuthology.orchestra.run.trial016.stdout:(44/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 35 MB/s | 442 kB 00:00 2026-02-17T08:21:14.165 INFO:teuthology.orchestra.run.trial016.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 7.7 MB/s | 77 kB 00:00 2026-02-17T08:21:14.165 INFO:teuthology.orchestra.run.trial134.stdout:(43/98): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-17T08:21:14.173 INFO:teuthology.orchestra.run.trial016.stdout:(46/98): python3-protobuf-3.14.0-17.el9.noarch. 23 MB/s | 267 kB 00:00 2026-02-17T08:21:14.181 INFO:teuthology.orchestra.run.trial016.stdout:(47/98): python3-babel-2.9.1-2.el9.noarch.rpm 42 MB/s | 6.0 MB 00:00 2026-02-17T08:21:14.182 INFO:teuthology.orchestra.run.trial016.stdout:(48/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 9.2 MB/s | 159 kB 00:00 2026-02-17T08:21:14.185 INFO:teuthology.orchestra.run.trial016.stdout:(49/98): python3-pyasn1-modules-0.4.8-6.el9.noa 23 MB/s | 279 kB 00:00 2026-02-17T08:21:14.190 INFO:teuthology.orchestra.run.trial134.stdout:(44/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-17T08:21:14.191 INFO:teuthology.orchestra.run.trial016.stdout:(50/98): python3-requests-oauthlib-1.3.0-12.el9 5.6 MB/s | 54 kB 00:00 2026-02-17T08:21:14.192 INFO:teuthology.orchestra.run.trial134.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 2.8 MB/s | 77 kB 00:00 2026-02-17T08:21:14.194 INFO:teuthology.orchestra.run.trial016.stdout:(51/98): python3-toml-0.10.2-6.el9.noarch.rpm 4.3 MB/s | 42 kB 00:00 2026-02-17T08:21:14.204 INFO:teuthology.orchestra.run.trial016.stdout:(52/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 15 MB/s | 189 kB 00:00 2026-02-17T08:21:14.204 INFO:teuthology.orchestra.run.trial016.stdout:(53/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 9.2 MB/s | 90 kB 00:00 2026-02-17T08:21:14.219 INFO:teuthology.orchestra.run.trial134.stdout:(46/98): python3-protobuf-3.14.0-17.el9.noarch. 9.0 MB/s | 267 kB 00:00 2026-02-17T08:21:14.222 INFO:teuthology.orchestra.run.trial134.stdout:(47/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.2 MB/s | 159 kB 00:00 2026-02-17T08:21:14.229 INFO:teuthology.orchestra.run.trial016.stdout:(54/98): lua-devel-5.4.4-4.el9.x86_64.rpm 892 kB/s | 22 kB 00:00 2026-02-17T08:21:14.246 INFO:teuthology.orchestra.run.trial016.stdout:(55/98): protobuf-compiler-3.14.0-17.el9.x86_64 20 MB/s | 862 kB 00:00 2026-02-17T08:21:14.251 INFO:teuthology.orchestra.run.trial134.stdout:(48/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 66 MB/s | 6.1 MB 00:00 2026-02-17T08:21:14.252 INFO:teuthology.orchestra.run.trial134.stdout:(49/98): python3-requests-oauthlib-1.3.0-12.el9 1.7 MB/s | 54 kB 00:00 2026-02-17T08:21:14.253 INFO:teuthology.orchestra.run.trial134.stdout:(50/98): python3-pyasn1-modules-0.4.8-6.el9.noa 8.2 MB/s | 279 kB 00:00 2026-02-17T08:21:14.279 INFO:teuthology.orchestra.run.trial134.stdout:(51/98): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-17T08:21:14.281 INFO:teuthology.orchestra.run.trial134.stdout:(52/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 6.7 MB/s | 189 kB 00:00 2026-02-17T08:21:14.307 INFO:teuthology.orchestra.run.trial134.stdout:(53/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.2 MB/s | 90 kB 00:00 2026-02-17T08:21:14.372 INFO:teuthology.orchestra.run.trial016.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 155 kB/s | 19 kB 00:00 2026-02-17T08:21:14.437 INFO:teuthology.orchestra.run.trial134.stdout:(54/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 104 MB/s | 19 MB 00:00 2026-02-17T08:21:14.512 INFO:teuthology.orchestra.run.trial016.stdout:(57/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.9 MB/s | 551 kB 00:00 2026-02-17T08:21:14.528 INFO:teuthology.orchestra.run.trial016.stdout:(58/98): luarocks-3.9.2-5.el9.noarch.rpm 966 kB/s | 151 kB 00:00 2026-02-17T08:21:14.582 INFO:teuthology.orchestra.run.trial016.stdout:(59/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 48 MB/s | 19 MB 00:00 2026-02-17T08:21:14.582 INFO:teuthology.orchestra.run.trial016.stdout:(60/98): python3-autocommand-2.2.2-8.el9.noarch 548 kB/s | 29 kB 00:00 2026-02-17T08:21:14.587 INFO:teuthology.orchestra.run.trial016.stdout:(61/98): python3-asyncssh-2.13.2-5.el9.noarch.r 7.1 MB/s | 548 kB 00:00 2026-02-17T08:21:14.628 INFO:teuthology.orchestra.run.trial016.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 948 kB/s | 43 kB 00:00 2026-02-17T08:21:14.629 INFO:teuthology.orchestra.run.trial016.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 775 kB/s | 32 kB 00:00 2026-02-17T08:21:14.667 INFO:teuthology.orchestra.run.trial134.stdout:(55/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.4 MB/s | 551 kB 00:00 2026-02-17T08:21:14.670 INFO:teuthology.orchestra.run.trial016.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 335 kB/s | 14 kB 00:00 2026-02-17T08:21:14.680 INFO:teuthology.orchestra.run.trial016.stdout:(65/98): python3-cheroot-10.0.1-4.el9.noarch.rp 3.3 MB/s | 173 kB 00:00 2026-02-17T08:21:14.699 INFO:teuthology.orchestra.run.trial134.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 611 kB/s | 19 kB 00:00 2026-02-17T08:21:14.735 INFO:teuthology.orchestra.run.trial134.stdout:(57/98): lua-devel-5.4.4-4.el9.x86_64.rpm 49 kB/s | 22 kB 00:00 2026-02-17T08:21:14.738 INFO:teuthology.orchestra.run.trial016.stdout:(66/98): python3-google-auth-2.45.0-1.el9.noarc 4.3 MB/s | 254 kB 00:00 2026-02-17T08:21:14.738 INFO:teuthology.orchestra.run.trial134.stdout:(58/98): luarocks-3.9.2-5.el9.noarch.rpm 3.7 MB/s | 151 kB 00:00 2026-02-17T08:21:14.742 INFO:teuthology.orchestra.run.trial016.stdout:(67/98): python3-backports-tarfile-1.2.0-1.el9. 374 kB/s | 60 kB 00:00 2026-02-17T08:21:14.771 INFO:teuthology.orchestra.run.trial134.stdout:(59/98): python3-autocommand-2.2.2-8.el9.noarch 910 kB/s | 29 kB 00:00 2026-02-17T08:21:14.775 INFO:teuthology.orchestra.run.trial016.stdout:(68/98): python3-cherrypy-18.6.1-2.el9.noarch.r 3.3 MB/s | 358 kB 00:00 2026-02-17T08:21:14.804 INFO:teuthology.orchestra.run.trial134.stdout:(60/98): python3-backports-tarfile-1.2.0-1.el9. 1.8 MB/s | 60 kB 00:00 2026-02-17T08:21:14.826 INFO:teuthology.orchestra.run.trial016.stdout:(69/98): python3-influxdb-5.3.1-1.el9.noarch.rp 2.7 MB/s | 139 kB 00:00 2026-02-17T08:21:14.836 INFO:teuthology.orchestra.run.trial134.stdout:(61/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2026-02-17T08:21:14.858 INFO:teuthology.orchestra.run.trial016.stdout:(70/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 17 MB/s | 2.0 MB 00:00 2026-02-17T08:21:14.867 INFO:teuthology.orchestra.run.trial016.stdout:(71/98): python3-grpcio-tools-1.46.7-10.el9.x86 1.1 MB/s | 144 kB 00:00 2026-02-17T08:21:14.869 INFO:teuthology.orchestra.run.trial134.stdout:(62/98): python3-cachetools-4.2.4-1.el9.noarch. 1.0 MB/s | 32 kB 00:00 2026-02-17T08:21:14.874 INFO:teuthology.orchestra.run.trial016.stdout:(72/98): python3-isodate-0.6.1-3.el9.noarch.rpm 1.1 MB/s | 56 kB 00:00 2026-02-17T08:21:14.895 INFO:teuthology.orchestra.run.trial016.stdout:(73/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 292 kB/s | 11 kB 00:00 2026-02-17T08:21:14.901 INFO:teuthology.orchestra.run.trial134.stdout:(63/98): python3-certifi-2023.05.07-4.el9.noarc 437 kB/s | 14 kB 00:00 2026-02-17T08:21:14.905 INFO:teuthology.orchestra.run.trial016.stdout:(74/98): python3-jaraco-classes-3.2.1-5.el9.noa 466 kB/s | 18 kB 00:00 2026-02-17T08:21:14.911 INFO:teuthology.orchestra.run.trial016.stdout:(75/98): python3-jaraco-collections-3.0.0-8.el9 626 kB/s | 23 kB 00:00 2026-02-17T08:21:14.932 INFO:teuthology.orchestra.run.trial016.stdout:(76/98): python3-jaraco-context-6.0.1-3.el9.noa 537 kB/s | 20 kB 00:00 2026-02-17T08:21:14.936 INFO:teuthology.orchestra.run.trial134.stdout:(64/98): python3-cheroot-10.0.1-4.el9.noarch.rp 4.9 MB/s | 173 kB 00:00 2026-02-17T08:21:14.937 INFO:teuthology.orchestra.run.trial134.stdout:(65/98): python3-asyncssh-2.13.2-5.el9.noarch.r 2.7 MB/s | 548 kB 00:00 2026-02-17T08:21:14.944 INFO:teuthology.orchestra.run.trial016.stdout:(77/98): python3-jaraco-functools-3.5.0-2.el9.n 509 kB/s | 19 kB 00:00 2026-02-17T08:21:14.955 INFO:teuthology.orchestra.run.trial016.stdout:(78/98): python3-jaraco-text-4.0.0-2.el9.noarch 615 kB/s | 26 kB 00:00 2026-02-17T08:21:14.987 INFO:teuthology.orchestra.run.trial016.stdout:(79/98): python3-kubernetes-26.1.0-3.el9.noarch 19 MB/s | 1.0 MB 00:00 2026-02-17T08:21:14.987 INFO:teuthology.orchestra.run.trial134.stdout:(66/98): python3-cherrypy-18.6.1-2.el9.noarch.r 6.9 MB/s | 358 kB 00:00 2026-02-17T08:21:14.989 INFO:teuthology.orchestra.run.trial134.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 4.8 MB/s | 254 kB 00:00 2026-02-17T08:21:14.996 INFO:teuthology.orchestra.run.trial016.stdout:(80/98): python3-logutils-0.3.5-21.el9.noarch.r 882 kB/s | 46 kB 00:00 2026-02-17T08:21:15.002 INFO:teuthology.orchestra.run.trial016.stdout:(81/98): python3-more-itertools-8.12.0-2.el9.no 1.6 MB/s | 79 kB 00:00 2026-02-17T08:21:15.021 INFO:teuthology.orchestra.run.trial134.stdout:(68/98): python3-grpcio-tools-1.46.7-10.el9.x86 4.5 MB/s | 144 kB 00:00 2026-02-17T08:21:15.025 INFO:teuthology.orchestra.run.trial016.stdout:(82/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2026-02-17T08:21:15.046 INFO:teuthology.orchestra.run.trial016.stdout:(83/98): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2026-02-17T08:21:15.052 INFO:teuthology.orchestra.run.trial134.stdout:(69/98): python3-influxdb-5.3.1-1.el9.noarch.rp 4.3 MB/s | 139 kB 00:00 2026-02-17T08:21:15.063 INFO:teuthology.orchestra.run.trial016.stdout:(84/98): python3-pecan-1.4.2-3.el9.noarch.rpm 4.3 MB/s | 272 kB 00:00 2026-02-17T08:21:15.064 INFO:teuthology.orchestra.run.trial016.stdout:(85/98): python3-portend-3.1.0-2.el9.noarch.rpm 417 kB/s | 16 kB 00:00 2026-02-17T08:21:15.083 INFO:teuthology.orchestra.run.trial134.stdout:(70/98): python3-isodate-0.6.1-3.el9.noarch.rpm 1.8 MB/s | 56 kB 00:00 2026-02-17T08:21:15.093 INFO:teuthology.orchestra.run.trial134.stdout:(71/98): protobuf-compiler-3.14.0-17.el9.x86_64 1.1 MB/s | 862 kB 00:00 2026-02-17T08:21:15.099 INFO:teuthology.orchestra.run.trial016.stdout:(86/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.6 MB/s | 90 kB 00:00 2026-02-17T08:21:15.109 INFO:teuthology.orchestra.run.trial016.stdout:(87/98): python3-repoze-lru-0.7-16.el9.noarch.r 676 kB/s | 31 kB 00:00 2026-02-17T08:21:15.113 INFO:teuthology.orchestra.run.trial134.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 351 kB/s | 11 kB 00:00 2026-02-17T08:21:15.116 INFO:teuthology.orchestra.run.trial134.stdout:(73/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 16 MB/s | 2.0 MB 00:00 2026-02-17T08:21:15.119 INFO:teuthology.orchestra.run.trial016.stdout:(88/98): python3-routes-2.5.1-5.el9.noarch.rpm 3.3 MB/s | 188 kB 00:00 2026-02-17T08:21:15.146 INFO:teuthology.orchestra.run.trial134.stdout:(74/98): python3-jaraco-collections-3.0.0-8.el9 715 kB/s | 23 kB 00:00 2026-02-17T08:21:15.146 INFO:teuthology.orchestra.run.trial134.stdout:(75/98): python3-jaraco-context-6.0.1-3.el9.noa 651 kB/s | 20 kB 00:00 2026-02-17T08:21:15.150 INFO:teuthology.orchestra.run.trial016.stdout:(89/98): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2026-02-17T08:21:15.159 INFO:teuthology.orchestra.run.trial016.stdout:(90/98): python3-saml-1.16.0-1.el9.noarch.rpm 2.4 MB/s | 125 kB 00:00 2026-02-17T08:21:15.164 INFO:teuthology.orchestra.run.trial016.stdout:(91/98): python3-tempora-5.0.0-2.el9.noarch.rpm 795 kB/s | 36 kB 00:00 2026-02-17T08:21:15.176 INFO:teuthology.orchestra.run.trial134.stdout:(76/98): python3-jaraco-text-4.0.0-2.el9.noarch 882 kB/s | 26 kB 00:00 2026-02-17T08:21:15.178 INFO:teuthology.orchestra.run.trial134.stdout:(77/98): python3-jaraco-functools-3.5.0-2.el9.n 603 kB/s | 19 kB 00:00 2026-02-17T08:21:15.179 INFO:teuthology.orchestra.run.trial134.stdout:(78/98): python3-jaraco-classes-3.2.1-5.el9.noa 206 kB/s | 18 kB 00:00 2026-02-17T08:21:15.206 INFO:teuthology.orchestra.run.trial016.stdout:(92/98): python3-typing-extensions-4.15.0-1.el9 1.5 MB/s | 86 kB 00:00 2026-02-17T08:21:15.211 INFO:teuthology.orchestra.run.trial134.stdout:(79/98): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2026-02-17T08:21:15.216 INFO:teuthology.orchestra.run.trial016.stdout:(93/98): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2026-02-17T08:21:15.218 INFO:teuthology.orchestra.run.trial016.stdout:(94/98): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2026-02-17T08:21:15.237 INFO:teuthology.orchestra.run.trial134.stdout:(80/98): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2026-02-17T08:21:15.239 INFO:teuthology.orchestra.run.trial134.stdout:(81/98): python3-kubernetes-26.1.0-3.el9.noarch 16 MB/s | 1.0 MB 00:00 2026-02-17T08:21:15.245 INFO:teuthology.orchestra.run.trial134.stdout:(82/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.5 MB/s | 86 kB 00:00 2026-02-17T08:21:15.261 INFO:teuthology.orchestra.run.trial016.stdout:(95/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.1 MB/s | 48 kB 00:00 2026-02-17T08:21:15.262 INFO:teuthology.orchestra.run.trial016.stdout:(96/98): python3-xmltodict-0.12.0-15.el9.noarch 514 kB/s | 22 kB 00:00 2026-02-17T08:21:15.267 INFO:teuthology.orchestra.run.trial134.stdout:(83/98): python3-natsort-7.1.1-5.el9.noarch.rpm 1.9 MB/s | 58 kB 00:00 2026-02-17T08:21:15.271 INFO:teuthology.orchestra.run.trial134.stdout:(84/98): python3-pecan-1.4.2-3.el9.noarch.rpm 8.3 MB/s | 272 kB 00:00 2026-02-17T08:21:15.277 INFO:teuthology.orchestra.run.trial134.stdout:(85/98): python3-portend-3.1.0-2.el9.noarch.rpm 509 kB/s | 16 kB 00:00 2026-02-17T08:21:15.297 INFO:teuthology.orchestra.run.trial134.stdout:(86/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.9 MB/s | 90 kB 00:00 2026-02-17T08:21:15.298 INFO:teuthology.orchestra.run.trial016.stdout:(97/98): python3-zc-lockfile-2.0-10.el9.noarch. 538 kB/s | 20 kB 00:00 2026-02-17T08:21:15.301 INFO:teuthology.orchestra.run.trial134.stdout:(87/98): python3-repoze-lru-0.7-16.el9.noarch.r 1.0 MB/s | 31 kB 00:00 2026-02-17T08:21:15.307 INFO:teuthology.orchestra.run.trial016.stdout:(98/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2026-02-17T08:21:15.308 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:15.308 INFO:teuthology.orchestra.run.trial016.stdout:Total 22 MB/s | 95 MB 00:04 2026-02-17T08:21:15.311 INFO:teuthology.orchestra.run.trial134.stdout:(88/98): python3-routes-2.5.1-5.el9.noarch.rpm 5.4 MB/s | 188 kB 00:00 2026-02-17T08:21:15.341 INFO:teuthology.orchestra.run.trial134.stdout:(89/98): python3-rsa-4.9-2.el9.noarch.rpm 1.3 MB/s | 59 kB 00:00 2026-02-17T08:21:15.342 INFO:teuthology.orchestra.run.trial134.stdout:(90/98): python3-saml-1.16.0-1.el9.noarch.rpm 3.0 MB/s | 125 kB 00:00 2026-02-17T08:21:15.343 INFO:teuthology.orchestra.run.trial134.stdout:(91/98): python3-tempora-5.0.0-2.el9.noarch.rpm 1.1 MB/s | 36 kB 00:00 2026-02-17T08:21:15.371 INFO:teuthology.orchestra.run.trial134.stdout:(92/98): python3-typing-extensions-4.15.0-1.el9 2.8 MB/s | 86 kB 00:00 2026-02-17T08:21:15.374 INFO:teuthology.orchestra.run.trial134.stdout:(93/98): python3-webob-1.8.8-2.el9.noarch.rpm 7.1 MB/s | 230 kB 00:00 2026-02-17T08:21:15.377 INFO:teuthology.orchestra.run.trial134.stdout:(94/98): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2026-02-17T08:21:15.404 INFO:teuthology.orchestra.run.trial134.stdout:(95/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.6 MB/s | 48 kB 00:00 2026-02-17T08:21:15.409 INFO:teuthology.orchestra.run.trial134.stdout:(96/98): python3-xmltodict-0.12.0-15.el9.noarch 687 kB/s | 22 kB 00:00 2026-02-17T08:21:15.432 INFO:teuthology.orchestra.run.trial134.stdout:(97/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.9 MB/s | 427 kB 00:00 2026-02-17T08:21:15.435 INFO:teuthology.orchestra.run.trial134.stdout:(98/98): python3-zc-lockfile-2.0-10.el9.noarch. 649 kB/s | 20 kB 00:00 2026-02-17T08:21:15.438 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:15.438 INFO:teuthology.orchestra.run.trial134.stdout:Total 25 MB/s | 95 MB 00:03 2026-02-17T08:21:15.724 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:21:15.762 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:21:15.762 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:21:15.874 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:21:15.912 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:21:15.912 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:21:16.176 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:21:16.177 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:21:16.326 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:21:16.326 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:21:16.618 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:21:16.620 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-17T08:21:16.651 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-17T08:21:16.656 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-17T08:21:16.678 INFO:teuthology.orchestra.run.trial016.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-17T08:21:16.689 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-17T08:21:16.694 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-17T08:21:16.727 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-17T08:21:16.737 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-17T08:21:16.742 INFO:teuthology.orchestra.run.trial016.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-17T08:21:16.744 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-17T08:21:16.749 INFO:teuthology.orchestra.run.trial016.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-17T08:21:16.767 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:21:16.769 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-17T08:21:16.772 INFO:teuthology.orchestra.run.trial016.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-17T08:21:16.784 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-17T08:21:16.788 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-17T08:21:16.794 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-17T08:21:16.796 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-17T08:21:16.800 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-17T08:21:16.804 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-17T08:21:16.807 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T08:21:16.813 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-17T08:21:16.826 INFO:teuthology.orchestra.run.trial134.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-17T08:21:16.836 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-17T08:21:16.838 INFO:teuthology.orchestra.run.trial016.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-17T08:21:16.841 INFO:teuthology.orchestra.run.trial016.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-17T08:21:16.842 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-17T08:21:16.848 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-17T08:21:16.873 INFO:teuthology.orchestra.run.trial016.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-17T08:21:16.876 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-17T08:21:16.885 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-17T08:21:16.890 INFO:teuthology.orchestra.run.trial134.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-17T08:21:16.892 INFO:teuthology.orchestra.run.trial134.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-17T08:21:16.897 INFO:teuthology.orchestra.run.trial134.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-17T08:21:16.920 INFO:teuthology.orchestra.run.trial134.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-17T08:21:16.924 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-17T08:21:16.932 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-17T08:21:16.936 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-17T08:21:16.937 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-17T08:21:16.939 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-17T08:21:16.942 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-17T08:21:16.943 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-17T08:21:16.944 INFO:teuthology.orchestra.run.trial016.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-17T08:21:16.949 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-17T08:21:16.954 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-17T08:21:16.954 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T08:21:16.957 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-17T08:21:16.960 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-17T08:21:16.971 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-17T08:21:16.985 INFO:teuthology.orchestra.run.trial134.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-17T08:21:16.988 INFO:teuthology.orchestra.run.trial134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-17T08:21:16.993 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-17T08:21:16.995 INFO:teuthology.orchestra.run.trial134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-17T08:21:16.997 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-17T08:21:17.002 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-17T08:21:17.014 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-17T08:21:17.019 INFO:teuthology.orchestra.run.trial134.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-17T08:21:17.023 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-17T08:21:17.029 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-17T08:21:17.049 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-17T08:21:17.057 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-17T08:21:17.069 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-17T08:21:17.082 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-17T08:21:17.084 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-17T08:21:17.089 INFO:teuthology.orchestra.run.trial134.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-17T08:21:17.094 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-17T08:21:17.099 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-17T08:21:17.102 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-17T08:21:17.112 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-17T08:21:17.116 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-17T08:21:17.125 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-17T08:21:17.137 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-17T08:21:17.140 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-17T08:21:17.141 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-17T08:21:17.145 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-17T08:21:17.146 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-17T08:21:17.153 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-17T08:21:17.157 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-17T08:21:17.166 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-17T08:21:17.173 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-17T08:21:17.192 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-17T08:21:17.193 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-17T08:21:17.200 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-17T08:21:17.254 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-17T08:21:17.266 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-17T08:21:17.281 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-17T08:21:17.285 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-17T08:21:17.293 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-17T08:21:17.333 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-17T08:21:17.521 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-17T08:21:17.531 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-17T08:21:17.534 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-17T08:21:17.540 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-17T08:21:17.542 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-17T08:21:17.570 INFO:teuthology.orchestra.run.trial016.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-17T08:21:17.614 INFO:teuthology.orchestra.run.trial016.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-17T08:21:17.620 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-17T08:21:17.624 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-17T08:21:17.630 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-17T08:21:17.634 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-17T08:21:17.641 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-17T08:21:17.644 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-17T08:21:17.653 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-17T08:21:17.662 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-17T08:21:17.666 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-17T08:21:17.672 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-17T08:21:17.672 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-17T08:21:17.674 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-17T08:21:17.682 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-17T08:21:17.701 INFO:teuthology.orchestra.run.trial134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-17T08:21:17.717 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-17T08:21:17.744 INFO:teuthology.orchestra.run.trial134.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-17T08:21:17.750 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-17T08:21:17.754 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-17T08:21:17.760 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-17T08:21:17.763 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-17T08:21:17.770 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-17T08:21:17.773 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-17T08:21:17.801 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-17T08:21:17.810 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-17T08:21:17.845 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-17T08:21:17.943 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 61/98 2026-02-17T08:21:17.967 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-17T08:21:17.971 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-17T08:21:18.029 INFO:teuthology.orchestra.run.trial016.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-17T08:21:18.031 INFO:teuthology.orchestra.run.trial016.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-17T08:21:18.052 INFO:teuthology.orchestra.run.trial016.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-17T08:21:18.065 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 61/98 2026-02-17T08:21:18.089 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-17T08:21:18.093 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-17T08:21:18.151 INFO:teuthology.orchestra.run.trial134.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-17T08:21:18.153 INFO:teuthology.orchestra.run.trial134.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-17T08:21:18.174 INFO:teuthology.orchestra.run.trial134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-17T08:21:18.379 INFO:teuthology.orchestra.run.trial016.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-17T08:21:18.453 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-17T08:21:18.495 INFO:teuthology.orchestra.run.trial134.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-17T08:21:18.567 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-17T08:21:19.127 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-17T08:21:19.146 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-17T08:21:19.159 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-17T08:21:19.175 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-17T08:21:19.231 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-17T08:21:19.250 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-17T08:21:19.251 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-17T08:21:19.260 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-17T08:21:19.263 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-17T08:21:19.278 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-17T08:21:19.284 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-17T08:21:19.314 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-17T08:21:19.352 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-17T08:21:19.361 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-17T08:21:19.365 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-17T08:21:19.371 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-17T08:21:19.375 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-17T08:21:19.376 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-17T08:21:19.384 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-17T08:21:19.393 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T08:21:19.393 INFO:teuthology.orchestra.run.trial016.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T08:21:19.393 INFO:teuthology.orchestra.run.trial016.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T08:21:19.393 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:19.401 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T08:21:19.414 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-17T08:21:19.426 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T08:21:19.427 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T08:21:19.427 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:19.461 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-17T08:21:19.464 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-17T08:21:19.470 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-17T08:21:19.473 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-17T08:21:19.474 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-17T08:21:19.493 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T08:21:19.493 INFO:teuthology.orchestra.run.trial134.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T08:21:19.493 INFO:teuthology.orchestra.run.trial134.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T08:21:19.493 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:19.500 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T08:21:19.525 INFO:teuthology.orchestra.run.trial016.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 83/98 2026-02-17T08:21:19.527 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T08:21:19.527 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T08:21:19.527 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:19.528 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 84/98 2026-02-17T08:21:19.541 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 84/98 2026-02-17T08:21:19.542 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:19.542 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T08:21:19.542 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:19.561 INFO:teuthology.orchestra.run.trial134.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-17T08:21:19.624 INFO:teuthology.orchestra.run.trial134.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 83/98 2026-02-17T08:21:19.626 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 84/98 2026-02-17T08:21:19.641 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 84/98 2026-02-17T08:21:19.641 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:19.641 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T08:21:19.641 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:20.239 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 85/98 2026-02-17T08:21:20.264 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 85/98 2026-02-17T08:21:20.264 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:20.265 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T08:21:20.265 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T08:21:20.265 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T08:21:20.265 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:20.323 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 86/98 2026-02-17T08:21:20.325 INFO:teuthology.orchestra.run.trial016.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 86/98 2026-02-17T08:21:20.330 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 87/98 2026-02-17T08:21:20.349 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 85/98 2026-02-17T08:21:20.350 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 88/98 2026-02-17T08:21:20.351 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 89/98 2026-02-17T08:21:20.375 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 85/98 2026-02-17T08:21:20.375 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:20.375 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T08:21:20.375 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T08:21:20.375 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T08:21:20.375 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:20.430 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 86/98 2026-02-17T08:21:20.433 INFO:teuthology.orchestra.run.trial134.stdout: Installing : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 86/98 2026-02-17T08:21:20.438 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 87/98 2026-02-17T08:21:20.457 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 88/98 2026-02-17T08:21:20.459 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 89/98 2026-02-17T08:21:20.843 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 89/98 2026-02-17T08:21:20.846 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 90/98 2026-02-17T08:21:20.951 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 89/98 2026-02-17T08:21:20.954 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 90/98 2026-02-17T08:21:21.300 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 90/98 2026-02-17T08:21:21.301 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 91/98 2026-02-17T08:21:21.314 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 91/98 2026-02-17T08:21:21.315 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 92/98 2026-02-17T08:21:21.371 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 92/98 2026-02-17T08:21:21.414 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 90/98 2026-02-17T08:21:21.415 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 91/98 2026-02-17T08:21:21.420 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 93/98 2026-02-17T08:21:21.422 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 94/98 2026-02-17T08:21:21.427 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 91/98 2026-02-17T08:21:21.428 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 92/98 2026-02-17T08:21:21.443 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 94/98 2026-02-17T08:21:21.443 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:21.443 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T08:21:21.443 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T08:21:21.444 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T08:21:21.444 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:21.456 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 95/98 2026-02-17T08:21:21.483 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 92/98 2026-02-17T08:21:21.534 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 93/98 2026-02-17T08:21:21.535 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 94/98 2026-02-17T08:21:21.557 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 94/98 2026-02-17T08:21:21.557 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:21.557 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T08:21:21.557 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T08:21:21.557 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T08:21:21.557 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:21.568 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 95/98 2026-02-17T08:21:21.671 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 95/98 2026-02-17T08:21:21.673 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 96/98 2026-02-17T08:21:21.694 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 96/98 2026-02-17T08:21:21.694 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:21.694 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T08:21:21.694 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T08:21:21.694 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T08:21:21.694 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:21.787 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 95/98 2026-02-17T08:21:21.789 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 96/98 2026-02-17T08:21:21.795 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/98 2026-02-17T08:21:21.811 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 96/98 2026-02-17T08:21:21.811 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:21.811 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T08:21:21.811 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T08:21:21.812 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T08:21:21.812 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:21.815 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/98 2026-02-17T08:21:21.815 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:21.815 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T08:21:21.816 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T08:21:21.816 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T08:21:21.816 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:21.834 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/98 2026-02-17T08:21:21.914 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/98 2026-02-17T08:21:21.935 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 97/98 2026-02-17T08:21:21.935 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:21.935 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T08:21:21.936 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T08:21:21.936 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T08:21:21.936 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:21.953 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/98 2026-02-17T08:21:22.496 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/98 2026-02-17T08:21:22.496 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/98 2026-02-17T08:21:22.496 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/98 2026-02-17T08:21:22.496 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/98 2026-02-17T08:21:22.496 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/98 2026-02-17T08:21:22.496 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/98 2026-02-17T08:21:22.496 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/98 2026-02-17T08:21:22.497 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/98 2026-02-17T08:21:22.497 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/98 2026-02-17T08:21:22.497 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/98 2026-02-17T08:21:22.497 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/98 2026-02-17T08:21:22.497 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/98 2026-02-17T08:21:22.497 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/98 2026-02-17T08:21:22.497 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/98 2026-02-17T08:21:22.497 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/98 2026-02-17T08:21:22.497 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/98 2026-02-17T08:21:22.497 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-17T08:21:22.498 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-17T08:21:22.499 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-17T08:21:22.499 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-17T08:21:22.499 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-17T08:21:22.499 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-17T08:21:22.499 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-17T08:21:22.499 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-17T08:21:22.499 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-17T08:21:22.499 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-17T08:21:22.499 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-17T08:21:22.499 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 38/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-17T08:21:22.500 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-17T08:21:22.501 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-17T08:21:22.502 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-17T08:21:22.503 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-17T08:21:22.504 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T08:21:22.557 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T08:21:22.558 INFO:teuthology.orchestra.run.trial016.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T08:21:22.559 INFO:teuthology.orchestra.run.trial016.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: zip-3.0-35.el9.x86_64 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:22.560 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:22.613 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 98/98 2026-02-17T08:21:22.613 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/98 2026-02-17T08:21:22.613 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 3/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 4/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 5/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9 6/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 7/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noar 8/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6d 9/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noar 10/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.n 11/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 12/98 2026-02-17T08:21:22.614 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9. 13/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 14/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 15/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-17T08:21:22.615 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-17T08:21:22.616 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 38/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-17T08:21:22.617 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-17T08:21:22.618 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-17T08:21:22.619 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-17T08:21:22.620 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-17T08:21:22.621 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-17T08:21:22.622 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-17T08:21:22.622 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-17T08:21:22.622 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-17T08:21:22.622 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-17T08:21:22.622 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-17T08:21:22.623 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-base 2026-02-17T08:21:22.675 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-17T08:21:22.675 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:22.675 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:21:22.676 INFO:teuthology.orchestra.run.trial134.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T08:21:22.676 INFO:teuthology.orchestra.run.trial134.stdout: ceph-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:22.676 INFO:teuthology.orchestra.run.trial134.stdout: ceph-grafana-dashboards-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.676 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mds-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:22.676 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:22.676 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.676 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.676 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.676 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-k8sevents-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-modules-core-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: ceph-mon-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: ceph-osd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: ceph-prometheus-alerts-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T08:21:22.677 INFO:teuthology.orchestra.run.trial134.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T08:21:22.678 INFO:teuthology.orchestra.run.trial134.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T08:21:22.679 INFO:teuthology.orchestra.run.trial134.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T08:21:22.680 INFO:teuthology.orchestra.run.trial134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T08:21:22.680 INFO:teuthology.orchestra.run.trial134.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T08:21:22.680 INFO:teuthology.orchestra.run.trial134.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T08:21:22.680 INFO:teuthology.orchestra.run.trial134.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T08:21:22.680 INFO:teuthology.orchestra.run.trial134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T08:21:22.680 INFO:teuthology.orchestra.run.trial134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T08:21:22.680 INFO:teuthology.orchestra.run.trial134.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T08:21:22.680 INFO:teuthology.orchestra.run.trial134.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T08:21:22.680 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T08:21:22.680 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T08:21:22.681 INFO:teuthology.orchestra.run.trial134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T08:21:22.682 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T08:21:22.683 INFO:teuthology.orchestra.run.trial134.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T08:21:22.684 INFO:teuthology.orchestra.run.trial134.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T08:21:22.685 INFO:teuthology.orchestra.run.trial134.stdout: zip-3.0-35.el9.x86_64 2026-02-17T08:21:22.685 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:22.685 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:22.731 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-base 2026-02-17T08:21:22.936 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:23.002 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:23.019 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:23.020 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:23.020 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:23.042 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install cephadm 2026-02-17T08:21:23.043 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:23.106 INFO:teuthology.orchestra.run.trial134.stdout:Package ceph-base-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:23.123 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:23.124 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:23.124 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:23.144 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install cephadm 2026-02-17T08:21:23.359 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:23.425 INFO:teuthology.orchestra.run.trial016.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:23.443 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:23.443 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:23.444 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:23.455 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:23.465 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T08:21:23.519 INFO:teuthology.orchestra.run.trial134.stdout:Package cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:23.536 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:23.537 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:23.538 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:23.559 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T08:21:23.770 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:23.854 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:23.854 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:23.854 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-17T08:21:23.854 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:23.854 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:21:23.854 INFO:teuthology.orchestra.run.trial016.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-17T08:21:23.855 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:23.855 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:21:23.855 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:23.855 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-17T08:21:23.855 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:23.855 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 145 k 2026-02-17T08:21:23.855 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 431 k 2026-02-17T08:21:23.855 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:21:23.863 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:23.944 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:23.945 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:23.945 INFO:teuthology.orchestra.run.trial134.stdout: Package Arch Version Repo Size 2026-02-17T08:21:23.945 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:23.945 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:21:23.945 INFO:teuthology.orchestra.run.trial134.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 145 k 2026-02-17T08:21:23.946 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:23.946 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:21:23.946 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:23.946 INFO:teuthology.orchestra.run.trial134.stdout:Install 1 Package 2026-02-17T08:21:23.946 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:23.946 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 145 k 2026-02-17T08:21:23.946 INFO:teuthology.orchestra.run.trial134.stdout:Installed size: 431 k 2026-02-17T08:21:23.946 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:21:23.947 INFO:teuthology.orchestra.run.trial016.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 1.6 MB/s | 145 kB 00:00 2026-02-17T08:21:23.947 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:23.947 INFO:teuthology.orchestra.run.trial016.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T08:21:23.947 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:21:23.949 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:21:23.949 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:21:23.981 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:21:23.981 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:21:24.036 INFO:teuthology.orchestra.run.trial134.stdout:ceph-immutable-object-cache-19.2.3-705.g04cf6dd 1.6 MB/s | 145 kB 00:00 2026-02-17T08:21:24.037 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:21:24.037 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:24.037 INFO:teuthology.orchestra.run.trial134.stdout:Total 1.5 MB/s | 145 kB 00:00 2026-02-17T08:21:24.037 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:21:24.038 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T08:21:24.040 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:21:24.040 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:21:24.059 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T08:21:24.059 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:24.060 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T08:21:24.060 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:24.072 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:21:24.072 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:21:24.127 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:21:24.128 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T08:21:24.150 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T08:21:24.150 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:24.150 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T08:21:24.150 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:24.340 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T08:21:24.340 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:24.340 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:21:24.341 INFO:teuthology.orchestra.run.trial016.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:24.341 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:24.341 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:24.367 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr 2026-02-17T08:21:24.453 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.e 1/1 2026-02-17T08:21:24.453 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:24.453 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:21:24.454 INFO:teuthology.orchestra.run.trial134.stdout: ceph-immutable-object-cache-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:24.454 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:24.454 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:24.480 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-mgr 2026-02-17T08:21:24.682 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:24.748 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:24.765 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:24.766 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:24.766 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:24.788 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T08:21:24.792 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:24.857 INFO:teuthology.orchestra.run.trial134.stdout:Package ceph-mgr-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:24.874 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:24.875 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:24.875 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:24.896 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T08:21:25.096 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:25.161 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:25.178 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:25.179 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:25.179 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:25.201 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T08:21:25.212 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:25.276 INFO:teuthology.orchestra.run.trial134.stdout:Package ceph-mgr-dashboard-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:25.293 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:25.293 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:25.294 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:25.315 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T08:21:25.510 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:25.574 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:25.592 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:25.593 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:25.593 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:25.613 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-rook 2026-02-17T08:21:25.623 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:25.688 INFO:teuthology.orchestra.run.trial134.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:25.705 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:25.706 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:25.706 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:25.728 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-mgr-rook 2026-02-17T08:21:25.916 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:25.980 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:25.998 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:25.998 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:25.999 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:26.019 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T08:21:26.042 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:26.107 INFO:teuthology.orchestra.run.trial134.stdout:Package ceph-mgr-rook-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:26.124 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:26.125 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:26.125 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:26.147 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T08:21:26.325 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:26.390 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:26.407 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:26.408 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:26.408 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:26.429 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-fuse 2026-02-17T08:21:26.460 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:26.525 INFO:teuthology.orchestra.run.trial134.stdout:Package ceph-mgr-cephadm-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:26.542 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:26.543 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:26.543 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:26.565 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-fuse 2026-02-17T08:21:26.738 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:26.820 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:26.820 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:26.820 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-17T08:21:26.820 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:26.820 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:21:26.821 INFO:teuthology.orchestra.run.trial016.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-17T08:21:26.821 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:26.821 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:21:26.821 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:26.821 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-17T08:21:26.821 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:26.821 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 1.2 M 2026-02-17T08:21:26.821 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 3.6 M 2026-02-17T08:21:26.821 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:21:26.874 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:26.956 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:26.956 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout: Package Architecture Version Repository Size 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout: ceph-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 1.2 M 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout:Install 1 Package 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 1.2 M 2026-02-17T08:21:26.957 INFO:teuthology.orchestra.run.trial134.stdout:Installed size: 3.6 M 2026-02-17T08:21:26.958 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:21:27.106 INFO:teuthology.orchestra.run.trial016.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 4.0 MB/s | 1.2 MB 00:00 2026-02-17T08:21:27.107 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:27.108 INFO:teuthology.orchestra.run.trial016.stdout:Total 4.0 MB/s | 1.2 MB 00:00 2026-02-17T08:21:27.108 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:21:27.112 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:21:27.112 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:21:27.137 INFO:teuthology.orchestra.run.trial134.stdout:ceph-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 6.4 MB/s | 1.2 MB 00:00 2026-02-17T08:21:27.138 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:27.138 INFO:teuthology.orchestra.run.trial134.stdout:Total 6.3 MB/s | 1.2 MB 00:00 2026-02-17T08:21:27.138 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:21:27.142 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:21:27.142 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:21:27.146 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:21:27.147 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:21:27.178 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:21:27.178 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:21:27.248 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:21:27.265 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:27.279 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:21:27.296 INFO:teuthology.orchestra.run.trial134.stdout: Installing : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:27.472 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:27.523 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:27.528 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:27.528 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:27.528 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:21:27.528 INFO:teuthology.orchestra.run.trial016.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:27.528 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:27.528 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:27.554 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-volume 2026-02-17T08:21:27.581 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:27.581 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:27.581 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:21:27.581 INFO:teuthology.orchestra.run.trial134.stdout: ceph-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:27.581 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:27.581 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:27.609 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install ceph-volume 2026-02-17T08:21:27.862 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:27.926 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:27.929 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:27.944 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:27.944 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:27.944 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:27.965 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librados-devel 2026-02-17T08:21:27.993 INFO:teuthology.orchestra.run.trial134.stdout:Package ceph-volume-2:19.2.3-705.g04cf6dd4.el9.noarch is already installed. 2026-02-17T08:21:28.010 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:28.011 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:28.011 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:28.033 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install librados-devel 2026-02-17T08:21:28.275 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:28.343 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:28.357 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:28.358 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:28.358 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 126 k 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 456 k 2026-02-17T08:21:28.359 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:21:28.424 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:28.425 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:28.425 INFO:teuthology.orchestra.run.trial134.stdout: Package Arch Version Repo Size 2026-02-17T08:21:28.425 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:28.426 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:21:28.426 INFO:teuthology.orchestra.run.trial134.stdout: librados-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 126 k 2026-02-17T08:21:28.426 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:28.426 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:21:28.426 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:28.426 INFO:teuthology.orchestra.run.trial134.stdout:Install 1 Package 2026-02-17T08:21:28.426 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:28.426 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 126 k 2026-02-17T08:21:28.426 INFO:teuthology.orchestra.run.trial134.stdout:Installed size: 456 k 2026-02-17T08:21:28.426 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:21:28.713 INFO:teuthology.orchestra.run.trial016.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 357 kB/s | 126 kB 00:00 2026-02-17T08:21:28.713 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:28.714 INFO:teuthology.orchestra.run.trial016.stdout:Total 356 kB/s | 126 kB 00:00 2026-02-17T08:21:28.714 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:21:28.716 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:21:28.716 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:21:28.748 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:21:28.748 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:21:28.785 INFO:teuthology.orchestra.run.trial134.stdout:librados-devel-19.2.3-705.g04cf6dd4.el9.x86_64. 352 kB/s | 126 kB 00:00 2026-02-17T08:21:28.786 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:28.786 INFO:teuthology.orchestra.run.trial134.stdout:Total 350 kB/s | 126 kB 00:00 2026-02-17T08:21:28.786 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:21:28.789 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:21:28.789 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:21:28.803 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:21:28.820 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:28.822 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:21:28.822 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:21:28.880 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:21:28.896 INFO:teuthology.orchestra.run.trial134.stdout: Installing : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:28.901 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:28.958 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:28.958 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:28.958 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:21:28.958 INFO:teuthology.orchestra.run.trial016.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:28.958 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:28.958 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:28.984 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:28.985 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install libcephfs2 2026-02-17T08:21:29.041 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:29.042 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:29.042 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:21:29.042 INFO:teuthology.orchestra.run.trial134.stdout: librados-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:29.042 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:29.042 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:29.068 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install libcephfs2 2026-02-17T08:21:29.293 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:29.359 INFO:teuthology.orchestra.run.trial016.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:29.376 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:29.377 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:29.377 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:29.383 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:29.398 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install libcephfs-devel 2026-02-17T08:21:29.447 INFO:teuthology.orchestra.run.trial134.stdout:Package libcephfs2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:29.465 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:29.465 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:29.465 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:29.487 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install libcephfs-devel 2026-02-17T08:21:29.707 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:29.789 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:29.790 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:29.790 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-17T08:21:29.790 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:29.790 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:21:29.790 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-17T08:21:29.790 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:29.790 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:21:29.790 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:29.790 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-17T08:21:29.790 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:29.791 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 34 k 2026-02-17T08:21:29.791 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 153 k 2026-02-17T08:21:29.791 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:21:29.800 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:29.869 INFO:teuthology.orchestra.run.trial016.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 422 kB/s | 34 kB 00:00 2026-02-17T08:21:29.870 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:29.870 INFO:teuthology.orchestra.run.trial016.stdout:Total 415 kB/s | 34 kB 00:00 2026-02-17T08:21:29.870 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:21:29.872 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:21:29.872 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:21:29.874 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:21:29.874 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:21:29.881 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:29.882 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:29.882 INFO:teuthology.orchestra.run.trial134.stdout: Package Arch Version Repo Size 2026-02-17T08:21:29.882 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:29.882 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:21:29.882 INFO:teuthology.orchestra.run.trial134.stdout: libcephfs-devel x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 34 k 2026-02-17T08:21:29.882 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:29.882 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:21:29.882 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:29.882 INFO:teuthology.orchestra.run.trial134.stdout:Install 1 Package 2026-02-17T08:21:29.882 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:29.883 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 34 k 2026-02-17T08:21:29.883 INFO:teuthology.orchestra.run.trial134.stdout:Installed size: 153 k 2026-02-17T08:21:29.883 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:21:29.894 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:21:29.911 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:29.944 INFO:teuthology.orchestra.run.trial134.stdout:libcephfs-devel-19.2.3-705.g04cf6dd4.el9.x86_64 543 kB/s | 34 kB 00:00 2026-02-17T08:21:29.945 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:29.945 INFO:teuthology.orchestra.run.trial134.stdout:Total 536 kB/s | 34 kB 00:00 2026-02-17T08:21:29.945 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:21:29.946 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:21:29.946 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:21:29.948 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:21:29.948 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:21:29.965 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:29.969 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:21:29.985 INFO:teuthology.orchestra.run.trial134.stdout: Installing : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:30.021 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:30.021 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:30.021 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:21:30.021 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:30.021 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:30.021 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:30.040 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:30.048 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librados2 2026-02-17T08:21:30.098 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:30.098 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:30.098 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:21:30.098 INFO:teuthology.orchestra.run.trial134.stdout: libcephfs-devel-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:30.098 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:30.098 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:30.125 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install librados2 2026-02-17T08:21:30.359 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:30.423 INFO:teuthology.orchestra.run.trial016.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:30.438 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:30.441 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:30.442 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:30.442 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:30.463 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librbd1 2026-02-17T08:21:30.503 INFO:teuthology.orchestra.run.trial134.stdout:Package librados2-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:30.520 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:30.521 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:30.521 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:30.543 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install librbd1 2026-02-17T08:21:30.771 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:30.836 INFO:teuthology.orchestra.run.trial016.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:30.853 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:30.854 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:30.854 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:30.854 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:30.875 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rados 2026-02-17T08:21:30.916 INFO:teuthology.orchestra.run.trial134.stdout:Package librbd1-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:30.934 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:30.935 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:30.935 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:30.956 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install python3-rados 2026-02-17T08:21:31.185 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:31.250 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:31.267 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:31.268 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:31.268 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:31.269 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:31.290 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rgw 2026-02-17T08:21:31.333 INFO:teuthology.orchestra.run.trial134.stdout:Package python3-rados-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:31.350 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:31.351 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:31.351 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:31.373 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install python3-rgw 2026-02-17T08:21:31.599 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:31.663 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:31.681 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:31.681 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:31.681 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:31.684 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:31.703 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-cephfs 2026-02-17T08:21:31.749 INFO:teuthology.orchestra.run.trial134.stdout:Package python3-rgw-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:31.766 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:31.767 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:31.767 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:31.788 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install python3-cephfs 2026-02-17T08:21:32.015 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:32.079 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:32.096 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:32.097 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:32.097 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:32.097 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:32.118 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rbd 2026-02-17T08:21:32.159 INFO:teuthology.orchestra.run.trial134.stdout:Package python3-cephfs-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:32.177 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:32.177 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:32.178 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:32.200 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install python3-rbd 2026-02-17T08:21:32.424 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:32.488 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:32.506 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:32.506 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-17T08:21:32.506 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:32.511 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:32.527 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-fuse 2026-02-17T08:21:32.575 INFO:teuthology.orchestra.run.trial134.stdout:Package python3-rbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 is already installed. 2026-02-17T08:21:32.593 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:32.594 INFO:teuthology.orchestra.run.trial134.stdout:Nothing to do. 2026-02-17T08:21:32.594 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:32.615 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install rbd-fuse 2026-02-17T08:21:32.834 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:32.916 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:32.916 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 85 k 2026-02-17T08:21:32.917 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 227 k 2026-02-17T08:21:32.918 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:21:32.928 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:32.993 INFO:teuthology.orchestra.run.trial016.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T08:21:32.994 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:32.994 INFO:teuthology.orchestra.run.trial016.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T08:21:32.994 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:21:32.997 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:21:32.997 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:21:33.011 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:33.011 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:33.011 INFO:teuthology.orchestra.run.trial134.stdout: Package Architecture Version Repository Size 2026-02-17T08:21:33.011 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:33.011 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:21:33.011 INFO:teuthology.orchestra.run.trial134.stdout: rbd-fuse x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 85 k 2026-02-17T08:21:33.011 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:33.011 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:21:33.011 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:33.012 INFO:teuthology.orchestra.run.trial134.stdout:Install 1 Package 2026-02-17T08:21:33.012 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:33.012 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 85 k 2026-02-17T08:21:33.012 INFO:teuthology.orchestra.run.trial134.stdout:Installed size: 227 k 2026-02-17T08:21:33.012 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:21:33.031 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:21:33.031 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:21:33.082 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:21:33.085 INFO:teuthology.orchestra.run.trial134.stdout:rbd-fuse-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T08:21:33.086 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:33.086 INFO:teuthology.orchestra.run.trial134.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T08:21:33.086 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:21:33.089 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:21:33.090 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:21:33.098 INFO:teuthology.orchestra.run.trial016.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:33.122 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:21:33.122 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:21:33.173 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:21:33.177 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:33.190 INFO:teuthology.orchestra.run.trial134.stdout: Installing : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:33.235 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:33.235 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:33.236 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:21:33.236 INFO:teuthology.orchestra.run.trial016.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:33.236 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:33.236 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:33.263 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-mirror 2026-02-17T08:21:33.275 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:33.333 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:33.333 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:33.333 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:21:33.333 INFO:teuthology.orchestra.run.trial134.stdout: rbd-fuse-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:33.333 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:33.333 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:33.359 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install rbd-mirror 2026-02-17T08:21:33.571 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:33.653 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:33.654 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 3.1 M 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 13 M 2026-02-17T08:21:33.655 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:21:33.674 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:33.756 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:33.756 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout: Package Arch Version Repo Size 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout: rbd-mirror x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 3.1 M 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout:Install 1 Package 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 3.1 M 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout:Installed size: 13 M 2026-02-17T08:21:33.757 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:21:33.804 INFO:teuthology.orchestra.run.trial016.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T08:21:33.804 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:33.804 INFO:teuthology.orchestra.run.trial016.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T08:21:33.804 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:21:33.808 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:21:33.808 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:21:33.853 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:21:33.853 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:21:33.920 INFO:teuthology.orchestra.run.trial134.stdout:rbd-mirror-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 19 MB/s | 3.1 MB 00:00 2026-02-17T08:21:33.920 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:33.920 INFO:teuthology.orchestra.run.trial134.stdout:Total 19 MB/s | 3.1 MB 00:00 2026-02-17T08:21:33.920 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:21:33.924 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:21:33.924 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:21:33.968 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:21:33.968 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:21:34.050 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:21:34.052 INFO:teuthology.orchestra.run.trial016.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:34.076 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:34.076 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:34.076 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T08:21:34.076 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T08:21:34.076 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T08:21:34.077 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:34.163 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:21:34.165 INFO:teuthology.orchestra.run.trial134.stdout: Installing : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:34.188 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:34.188 INFO:teuthology.orchestra.run.trial134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T08:21:34.188 INFO:teuthology.orchestra.run.trial134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T08:21:34.188 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T08:21:34.188 INFO:teuthology.orchestra.run.trial134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T08:21:34.188 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:34.382 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:34.382 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:34.382 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:21:34.382 INFO:teuthology.orchestra.run.trial016.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:34.382 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:34.382 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:34.411 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-nbd 2026-02-17T08:21:34.500 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:34.500 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:34.500 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:21:34.500 INFO:teuthology.orchestra.run.trial134.stdout: rbd-mirror-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:34.500 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:34.500 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:34.527 DEBUG:teuthology.orchestra.run.trial134:> sudo yum -y install rbd-nbd 2026-02-17T08:21:34.725 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 08:20:51 AM UTC. 2026-02-17T08:21:34.808 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-17T08:21:34.808 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:34.808 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-17T08:21:34.808 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:34.808 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-17T08:21:34.808 INFO:teuthology.orchestra.run.trial016.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-17T08:21:34.808 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:34.808 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-17T08:21:34.809 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-17T08:21:34.809 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-17T08:21:34.809 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:34.809 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 171 k 2026-02-17T08:21:34.809 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 490 k 2026-02-17T08:21:34.809 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-17T08:21:34.835 INFO:teuthology.orchestra.run.trial134.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 08:20:50 AM UTC. 2026-02-17T08:21:34.893 INFO:teuthology.orchestra.run.trial016.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T08:21:34.894 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:34.894 INFO:teuthology.orchestra.run.trial016.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T08:21:34.894 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-17T08:21:34.897 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-17T08:21:34.898 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-17T08:21:34.916 INFO:teuthology.orchestra.run.trial134.stdout:Dependencies resolved. 2026-02-17T08:21:34.917 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:34.917 INFO:teuthology.orchestra.run.trial134.stdout: Package Architecture Version Repository Size 2026-02-17T08:21:34.917 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:34.917 INFO:teuthology.orchestra.run.trial134.stdout:Installing: 2026-02-17T08:21:34.917 INFO:teuthology.orchestra.run.trial134.stdout: rbd-nbd x86_64 2:19.2.3-705.g04cf6dd4.el9 ceph 171 k 2026-02-17T08:21:34.917 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:34.918 INFO:teuthology.orchestra.run.trial134.stdout:Transaction Summary 2026-02-17T08:21:34.918 INFO:teuthology.orchestra.run.trial134.stdout:================================================================================ 2026-02-17T08:21:34.918 INFO:teuthology.orchestra.run.trial134.stdout:Install 1 Package 2026-02-17T08:21:34.918 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:34.918 INFO:teuthology.orchestra.run.trial134.stdout:Total download size: 171 k 2026-02-17T08:21:34.918 INFO:teuthology.orchestra.run.trial134.stdout:Installed size: 490 k 2026-02-17T08:21:34.919 INFO:teuthology.orchestra.run.trial134.stdout:Downloading Packages: 2026-02-17T08:21:34.930 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-17T08:21:34.930 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-17T08:21:34.986 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-17T08:21:35.002 INFO:teuthology.orchestra.run.trial134.stdout:rbd-nbd-19.2.3-705.g04cf6dd4.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T08:21:35.003 INFO:teuthology.orchestra.run.trial016.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:35.003 INFO:teuthology.orchestra.run.trial134.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:35.003 INFO:teuthology.orchestra.run.trial134.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T08:21:35.004 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction check 2026-02-17T08:21:35.007 INFO:teuthology.orchestra.run.trial134.stdout:Transaction check succeeded. 2026-02-17T08:21:35.007 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction test 2026-02-17T08:21:35.038 INFO:teuthology.orchestra.run.trial134.stdout:Transaction test succeeded. 2026-02-17T08:21:35.039 INFO:teuthology.orchestra.run.trial134.stdout:Running transaction 2026-02-17T08:21:35.085 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:35.095 INFO:teuthology.orchestra.run.trial134.stdout: Preparing : 1/1 2026-02-17T08:21:35.112 INFO:teuthology.orchestra.run.trial134.stdout: Installing : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:35.142 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:35.142 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:35.142 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-17T08:21:35.142 INFO:teuthology.orchestra.run.trial016.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:35.142 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:35.142 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-17T08:21:35.174 DEBUG:teuthology.parallel:result is None 2026-02-17T08:21:35.199 INFO:teuthology.orchestra.run.trial134.stdout: Running scriptlet: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:35.257 INFO:teuthology.orchestra.run.trial134.stdout: Verifying : rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 1/1 2026-02-17T08:21:35.257 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:35.257 INFO:teuthology.orchestra.run.trial134.stdout:Installed: 2026-02-17T08:21:35.257 INFO:teuthology.orchestra.run.trial134.stdout: rbd-nbd-2:19.2.3-705.g04cf6dd4.el9.x86_64 2026-02-17T08:21:35.257 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:21:35.257 INFO:teuthology.orchestra.run.trial134.stdout:Complete! 2026-02-17T08:21:35.287 DEBUG:teuthology.parallel:result is None 2026-02-17T08:21:35.288 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:21:35.456 DEBUG:teuthology.orchestra.run.trial016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T08:21:35.477 INFO:teuthology.orchestra.run.trial016.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-17T08:21:35.478 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-17T08:21:35.478 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-17T08:21:35.481 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:21:35.633 DEBUG:teuthology.orchestra.run.trial134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T08:21:35.655 INFO:teuthology.orchestra.run.trial134.stdout:19.2.3-705.g04cf6dd4.el9 2026-02-17T08:21:35.655 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705.g04cf6dd4.el9 2026-02-17T08:21:35.655 INFO:teuthology.task.install:The correct ceph version 19.2.3-705.g04cf6dd4 is installed. 2026-02-17T08:21:35.657 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T08:21:35.658 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:21:35.658 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T08:21:35.682 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:21:35.682 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T08:21:35.720 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T08:21:35.721 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:21:35.721 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T08:21:35.747 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T08:21:35.811 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:21:35.811 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T08:21:35.837 DEBUG:teuthology.orchestra.run.trial134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T08:21:35.902 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T08:21:35.902 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:21:35.902 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T08:21:35.927 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T08:21:35.991 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:21:35.991 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T08:21:36.014 DEBUG:teuthology.orchestra.run.trial134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T08:21:36.076 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T08:21:36.077 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:21:36.077 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T08:21:36.102 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T08:21:36.167 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:21:36.167 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T08:21:36.192 DEBUG:teuthology.orchestra.run.trial134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T08:21:36.256 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-17T08:21:36.390 INFO:tasks.cephadm:Config: {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T08:21:36.390 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:21:36.392 INFO:tasks.cephadm:Cluster fsid is ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:36.392 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-17T08:21:36.392 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.16'} 2026-02-17T08:21:36.392 INFO:tasks.cephadm:First mon is mon.a on trial016 2026-02-17T08:21:36.392 INFO:tasks.cephadm:First mgr is a 2026-02-17T08:21:36.392 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-17T08:21:36.392 DEBUG:teuthology.orchestra.run.trial016:> sudo hostname $(hostname -s) 2026-02-17T08:21:36.417 DEBUG:teuthology.orchestra.run.trial134:> sudo hostname $(hostname -s) 2026-02-17T08:21:36.443 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-17T08:21:36.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:21:36.590 INFO:tasks.cephadm:builder_project result: [{'url': 'https://2.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/flavors/default/', 'ref': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-13 10:53:47.064288', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '19.2.3-705-g04cf6dd4', 'package_manager_version': '19.2.3-705.g04cf6dd4', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2966/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-17T08:21:36.734 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-bharath19-testing-2026-02-13-0903-squid, sha1 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:21:36.735 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/x86_64/flavors/default/cephadm 2026-02-17T08:21:36.736 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/x86_64/flavors/default/cephadm 2026-02-17T08:21:36.736 DEBUG:teuthology.orchestra.run.trial016:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-17T08:21:37.035 INFO:teuthology.orchestra.run.trial016.stdout:-rw-r--r--. 1 ubuntu ubuntu 788257 Feb 17 08:21 /home/ubuntu/cephtest/cephadm 2026-02-17T08:21:37.035 DEBUG:teuthology.orchestra.run.trial134:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-17T08:21:37.340 INFO:teuthology.orchestra.run.trial134.stdout:-rw-r--r--. 1 ubuntu ubuntu 788257 Feb 17 08:21 /home/ubuntu/cephtest/cephadm 2026-02-17T08:21:37.341 DEBUG:teuthology.orchestra.run.trial016:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-17T08:21:37.360 DEBUG:teuthology.orchestra.run.trial134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-17T08:21:37.395 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e on all hosts... 2026-02-17T08:21:37.395 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e pull 2026-02-17T08:21:37.402 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e pull 2026-02-17T08:21:37.546 INFO:teuthology.orchestra.run.trial016.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e... 2026-02-17T08:21:37.567 INFO:teuthology.orchestra.run.trial134.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e... 2026-02-17T08:21:48.733 INFO:teuthology.orchestra.run.trial016.stdout:{ 2026-02-17T08:21:48.734 INFO:teuthology.orchestra.run.trial016.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T08:21:48.734 INFO:teuthology.orchestra.run.trial016.stdout: "image_id": "c14711ab021379ae69df099a7c56897872be92f7e323d46f96413a3a8067c281", 2026-02-17T08:21:48.734 INFO:teuthology.orchestra.run.trial016.stdout: "repo_digests": [ 2026-02-17T08:21:48.734 INFO:teuthology.orchestra.run.trial016.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:3573b5a0b07ea146a54b8706cbab3eb32397c9c5cf8be33835084322dcf44ee1" 2026-02-17T08:21:48.734 INFO:teuthology.orchestra.run.trial016.stdout: ] 2026-02-17T08:21:48.734 INFO:teuthology.orchestra.run.trial016.stdout:} 2026-02-17T08:21:48.779 INFO:teuthology.orchestra.run.trial134.stdout:{ 2026-02-17T08:21:48.779 INFO:teuthology.orchestra.run.trial134.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T08:21:48.779 INFO:teuthology.orchestra.run.trial134.stdout: "image_id": "c14711ab021379ae69df099a7c56897872be92f7e323d46f96413a3a8067c281", 2026-02-17T08:21:48.779 INFO:teuthology.orchestra.run.trial134.stdout: "repo_digests": [ 2026-02-17T08:21:48.779 INFO:teuthology.orchestra.run.trial134.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:3573b5a0b07ea146a54b8706cbab3eb32397c9c5cf8be33835084322dcf44ee1" 2026-02-17T08:21:48.779 INFO:teuthology.orchestra.run.trial134.stdout: ] 2026-02-17T08:21:48.779 INFO:teuthology.orchestra.run.trial134.stdout:} 2026-02-17T08:21:48.797 DEBUG:teuthology.orchestra.run.trial016:> sudo mkdir -p /etc/ceph 2026-02-17T08:21:48.824 DEBUG:teuthology.orchestra.run.trial134:> sudo mkdir -p /etc/ceph 2026-02-17T08:21:48.885 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod 777 /etc/ceph 2026-02-17T08:21:48.910 DEBUG:teuthology.orchestra.run.trial134:> sudo chmod 777 /etc/ceph 2026-02-17T08:21:48.934 INFO:tasks.cephadm:Writing seed config... 2026-02-17T08:21:48.936 INFO:tasks.cephadm: override: [client] debug client = 20 2026-02-17T08:21:48.936 INFO:tasks.cephadm: override: [client] debug mgrc = 20 2026-02-17T08:21:48.936 INFO:tasks.cephadm: override: [client] debug ms = 1 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [mds] debug mgrc = 20 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [mgr] debug client = 20 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2026-02-17T08:21:48.937 INFO:tasks.cephadm: override: [osd] bluestore allocator = stupid 2026-02-17T08:21:48.938 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-17T08:21:48.938 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-17T08:21:48.938 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2026-02-17T08:21:48.938 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2026-02-17T08:21:48.938 INFO:tasks.cephadm: override: [osd] debug mgrc = 20 2026-02-17T08:21:48.938 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-17T08:21:48.938 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-17T08:21:48.938 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2026-02-17T08:21:48.938 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-17T08:21:48.938 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-17T08:21:48.939 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-17T08:21:48.939 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-17T08:21:48.939 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-17T08:21:48.940 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:21:48.940 DEBUG:teuthology.orchestra.run.trial016:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-17T08:21:48.966 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ad06c547-0bd9-11f1-adc2-d404e6e7d460 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = stupid bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug mgrc = 20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug client = 20 debug mgrc = 20 debug ms = 1 [mds] debug mgrc = 20 2026-02-17T08:21:48.967 DEBUG:teuthology.orchestra.run.trial016:mon.a> sudo journalctl -f -n 0 -u ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mon.a.service 2026-02-17T08:21:49.009 DEBUG:teuthology.orchestra.run.trial016:mgr.a> sudo journalctl -f -n 0 -u ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mgr.a.service 2026-02-17T08:21:49.052 INFO:tasks.cephadm:Bootstrapping... 2026-02-17T08:21:49.052 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e -v bootstrap --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.16 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-17T08:21:49.188 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-17T08:21:49.188 INFO:teuthology.orchestra.run.trial016.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', '-v', 'bootstrap', '--fsid', 'ad06c547-0bd9-11f1-adc2-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.16', '--skip-admin-label'] 2026-02-17T08:21:49.189 INFO:teuthology.orchestra.run.trial016.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-17T08:21:49.189 INFO:teuthology.orchestra.run.trial016.stdout:Verifying podman|docker is present... 2026-02-17T08:21:49.203 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stdout 5.6.0 2026-02-17T08:21:49.203 INFO:teuthology.orchestra.run.trial016.stdout:Verifying lvm2 is present... 2026-02-17T08:21:49.204 INFO:teuthology.orchestra.run.trial016.stdout:Verifying time synchronization is in place... 2026-02-17T08:21:49.210 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T08:21:49.210 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T08:21:49.215 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T08:21:49.215 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-17T08:21:49.221 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout enabled 2026-02-17T08:21:49.226 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout active 2026-02-17T08:21:49.226 INFO:teuthology.orchestra.run.trial016.stdout:Unit chronyd.service is enabled and running 2026-02-17T08:21:49.226 INFO:teuthology.orchestra.run.trial016.stdout:Repeating the final host check... 2026-02-17T08:21:49.242 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stdout 5.6.0 2026-02-17T08:21:49.242 INFO:teuthology.orchestra.run.trial016.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-17T08:21:49.242 INFO:teuthology.orchestra.run.trial016.stdout:systemctl is present 2026-02-17T08:21:49.243 INFO:teuthology.orchestra.run.trial016.stdout:lvcreate is present 2026-02-17T08:21:49.247 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T08:21:49.247 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T08:21:49.253 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T08:21:49.253 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-17T08:21:49.259 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout enabled 2026-02-17T08:21:49.264 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout active 2026-02-17T08:21:49.264 INFO:teuthology.orchestra.run.trial016.stdout:Unit chronyd.service is enabled and running 2026-02-17T08:21:49.264 INFO:teuthology.orchestra.run.trial016.stdout:Host looks OK 2026-02-17T08:21:49.264 INFO:teuthology.orchestra.run.trial016.stdout:Cluster fsid: ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:49.264 INFO:teuthology.orchestra.run.trial016.stdout:Acquiring lock 139813954087424 on /run/cephadm/ad06c547-0bd9-11f1-adc2-d404e6e7d460.lock 2026-02-17T08:21:49.264 INFO:teuthology.orchestra.run.trial016.stdout:Lock 139813954087424 acquired on /run/cephadm/ad06c547-0bd9-11f1-adc2-d404e6e7d460.lock 2026-02-17T08:21:49.265 INFO:teuthology.orchestra.run.trial016.stdout:Verifying IP 10.20.193.16 port 3300 ... 2026-02-17T08:21:49.265 INFO:teuthology.orchestra.run.trial016.stdout:Verifying IP 10.20.193.16 port 6789 ... 2026-02-17T08:21:49.265 INFO:teuthology.orchestra.run.trial016.stdout:Base mon IP(s) is [10.20.193.16:3300, 10.20.193.16:6789], mon addrv is [v2:10.20.193.16:3300,v1:10.20.193.16:6789] 2026-02-17T08:21:49.268 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.16 metric 102 2026-02-17T08:21:49.268 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.16 metric 102 2026-02-17T08:21:49.268 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-17T08:21:49.270 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-17T08:21:49.270 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-17T08:21:49.270 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout inet6 fe80::32ea:c75c:2ea1:97c5/64 scope link noprefixroute 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:6004/64 scope link 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:Mon IP `10.20.193.16` is in CIDR network `10.20.192.0/20` 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:Mon IP `10.20.193.16` is in CIDR network `10.20.192.0/20` 2026-02-17T08:21:49.273 INFO:teuthology.orchestra.run.trial016.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-17T08:21:49.274 INFO:teuthology.orchestra.run.trial016.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-17T08:21:49.274 INFO:teuthology.orchestra.run.trial016.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e... 2026-02-17T08:21:49.517 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stdout c14711ab021379ae69df099a7c56897872be92f7e323d46f96413a3a8067c281 2026-02-17T08:21:49.518 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e... 2026-02-17T08:21:49.518 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Getting image source signatures 2026-02-17T08:21:49.518 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Copying blob sha256:5c1727b62f074b91c1b5940e1a5d1c56ebd5e8678bc6c3d263cfccafcfd02191 2026-02-17T08:21:49.518 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Copying blob sha256:f288f3bfe1f1dd15cb8f17590a708af9d9397de617368b4f9c06e9bc583d4a6b 2026-02-17T08:21:49.518 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Copying config sha256:c14711ab021379ae69df099a7c56897872be92f7e323d46f96413a3a8067c281 2026-02-17T08:21:49.518 INFO:teuthology.orchestra.run.trial016.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-17T08:21:49.622 INFO:teuthology.orchestra.run.trial016.stdout:ceph: stdout ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T08:21:49.623 INFO:teuthology.orchestra.run.trial016.stdout:Ceph version: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T08:21:49.623 INFO:teuthology.orchestra.run.trial016.stdout:Extracting ceph user uid/gid from container image... 2026-02-17T08:21:49.758 INFO:teuthology.orchestra.run.trial016.stdout:stat: stdout 167 167 2026-02-17T08:21:49.758 INFO:teuthology.orchestra.run.trial016.stdout:Creating initial keys... 2026-02-17T08:21:49.880 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph-authtool: stdout AQAdJZRpvzS9MhAAI5m51mgmSsfJ01o6/98zYw== 2026-02-17T08:21:50.006 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph-authtool: stdout AQAdJZRpT4ayOhAAjOfJiGPpzAAz+PWo8+FJPw== 2026-02-17T08:21:50.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph-authtool: stdout AQAeJZRpirKoBhAAsUoQanUpWJ/svT58awKrBQ== 2026-02-17T08:21:50.136 INFO:teuthology.orchestra.run.trial016.stdout:Creating initial monmap... 2026-02-17T08:21:50.274 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T08:21:50.274 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-17T08:21:50.275 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:50.275 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T08:21:50.275 INFO:teuthology.orchestra.run.trial016.stdout:monmaptool for a [v2:10.20.193.16:3300,v1:10.20.193.16:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T08:21:50.275 INFO:teuthology.orchestra.run.trial016.stdout:setting min_mon_release = quincy 2026-02-17T08:21:50.275 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: set fsid to ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:50.275 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T08:21:50.275 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:21:50.275 INFO:teuthology.orchestra.run.trial016.stdout:Creating mon... 2026-02-17T08:21:50.396 INFO:teuthology.orchestra.run.trial016.stdout:create mon.a on 2026-02-17T08:21:50.580 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-17T08:21:50.685 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-17T08:21:50.787 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460.target → /etc/systemd/system/ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460.target. 2026-02-17T08:21:50.788 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460.target → /etc/systemd/system/ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460.target. 2026-02-17T08:21:50.910 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mon.a 2026-02-17T08:21:50.910 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mon.a.service: Unit ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mon.a.service not loaded. 2026-02-17T08:21:51.029 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460.target.wants/ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@.service. 2026-02-17T08:21:51.173 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T08:21:51.173 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout disabled 2026-02-17T08:21:51.180 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T08:21:51.180 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-17T08:21:51.180 INFO:teuthology.orchestra.run.trial016.stdout:firewalld.service is not enabled 2026-02-17T08:21:51.180 INFO:teuthology.orchestra.run.trial016.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T08:21:51.180 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mon to start... 2026-02-17T08:21:51.181 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mon... 2026-02-17T08:21:51.188 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 systemd[1]: Started Ceph mon.a for ad06c547-0bd9-11f1-adc2-d404e6e7d460. 2026-02-17T08:21:51.336 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout cluster: 2026-02-17T08:21:51.337 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout id: ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:51.337 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-17T08:21:51.337 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:51.337 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout services: 2026-02-17T08:21:51.337 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.128483s) 2026-02-17T08:21:51.337 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-17T08:21:51.337 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-17T08:21:51.337 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:51.337 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout data: 2026-02-17T08:21:51.337 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout pgs: 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.276+0000 7fd714728640 1 Processor -- start 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.277+0000 7fd714728640 1 -- start start 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.277+0000 7fd714728640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c107270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.277+0000 7fd714728640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1077b0 con 0x7fd70c106e70 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.277+0000 7fd71249d640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.277+0000 7fd71249d640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43706/0 (socket says 10.20.193.16:43706) 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.277+0000 7fd71249d640 1 -- 10.20.193.16:0/3599690494 learned_addr learned my addr 10.20.193.16:0/3599690494 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:51.338 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.277+0000 7fd71249d640 1 -- 10.20.193.16:0/3599690494 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c107fd0 con 0x7fd70c106e70 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd71249d640 1 --2- 10.20.193.16:0/3599690494 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c107270 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009920 tx=0x7fd6fc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b83c81d6387006 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd71149b640 1 -- 10.20.193.16:0/3599690494 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6fc03c070 con 0x7fd70c106e70 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd71149b640 1 -- 10.20.193.16:0/3599690494 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6fc02fae0 con 0x7fd70c106e70 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd71149b640 1 -- 10.20.193.16:0/3599690494 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6fc02fde0 con 0x7fd70c106e70 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd714728640 1 -- 10.20.193.16:0/3599690494 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 msgr2=0x7fd70c107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd714728640 1 --2- 10.20.193.16:0/3599690494 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c107270 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009920 tx=0x7fd6fc02ef20 comp rx=0 tx=0).stop 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd714728640 1 -- 10.20.193.16:0/3599690494 shutdown_connections 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd714728640 1 --2- 10.20.193.16:0/3599690494 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c107270 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd714728640 1 -- 10.20.193.16:0/3599690494 >> 10.20.193.16:0/3599690494 conn(0x7fd70c102640 msgr2=0x7fd70c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd714728640 1 -- 10.20.193.16:0/3599690494 shutdown_connections 2026-02-17T08:21:51.339 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.278+0000 7fd714728640 1 -- 10.20.193.16:0/3599690494 wait complete. 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd714728640 1 Processor -- start 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd714728640 1 -- start start 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd714728640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c19e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd714728640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1084a0 con 0x7fd70c106e70 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd71249d640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c19e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd71249d640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c19e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43720/0 (socket says 10.20.193.16:43720) 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd71249d640 1 -- 10.20.193.16:0/2549467870 learned_addr learned my addr 10.20.193.16:0/2549467870 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd71249d640 1 -- 10.20.193.16:0/2549467870 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c19ebe0 con 0x7fd70c106e70 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd71249d640 1 --2- 10.20.193.16:0/2549467870 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c19e6a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009a50 tx=0x7fd6fc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd6f37fe640 1 -- 10.20.193.16:0/2549467870 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6fc03c050 con 0x7fd70c106e70 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd6f37fe640 1 -- 10.20.193.16:0/2549467870 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6fc048070 con 0x7fd70c106e70 2026-02-17T08:21:51.340 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd6f37fe640 1 -- 10.20.193.16:0/2549467870 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6fc043710 con 0x7fd70c106e70 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd714728640 1 -- 10.20.193.16:0/2549467870 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70c19ee70 con 0x7fd70c106e70 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd714728640 1 -- 10.20.193.16:0/2549467870 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70c1a1b60 con 0x7fd70c106e70 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd6f37fe640 1 -- 10.20.193.16:0/2549467870 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fd6fc0438b0 con 0x7fd70c106e70 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd6f37fe640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd6f37fe640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd6f37fe640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd6f37fe640 4 mgrc reconnect No active mgr available yet 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.279+0000 7fd6f37fe640 1 -- 10.20.193.16:0/2549467870 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd6fc04dc60 con 0x7fd70c106e70 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.280+0000 7fd714728640 1 -- 10.20.193.16:0/2549467870 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd70c108ae0 con 0x7fd70c106e70 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.281+0000 7fd6f37fe640 1 -- 10.20.193.16:0/2549467870 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fd6fc043d60 con 0x7fd70c106e70 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.311+0000 7fd714728640 1 -- 10.20.193.16:0/2549467870 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fd70c197ed0 con 0x7fd70c106e70 2026-02-17T08:21:51.341 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.312+0000 7fd6f37fe640 1 -- 10.20.193.16:0/2549467870 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fd6fc04d460 con 0x7fd70c106e70 2026-02-17T08:21:51.342 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.312+0000 7fd714728640 10 mgrc shutdown 2026-02-17T08:21:51.342 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.312+0000 7fd714728640 1 -- 10.20.193.16:0/2549467870 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 msgr2=0x7fd70c19e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:51.342 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.312+0000 7fd714728640 1 --2- 10.20.193.16:0/2549467870 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c19e6a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009a50 tx=0x7fd6fc0047c0 comp rx=0 tx=0).stop 2026-02-17T08:21:51.342 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.312+0000 7fd714728640 1 -- 10.20.193.16:0/2549467870 shutdown_connections 2026-02-17T08:21:51.342 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.312+0000 7fd714728640 1 --2- 10.20.193.16:0/2549467870 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd70c106e70 0x7fd70c19e6a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:51.342 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.312+0000 7fd714728640 1 -- 10.20.193.16:0/2549467870 >> 10.20.193.16:0/2549467870 conn(0x7fd70c102640 msgr2=0x7fd70c1954f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:51.342 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.312+0000 7fd714728640 1 -- 10.20.193.16:0/2549467870 shutdown_connections 2026-02-17T08:21:51.342 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.312+0000 7fd714728640 1 -- 10.20.193.16:0/2549467870 wait complete. 2026-02-17T08:21:51.342 INFO:teuthology.orchestra.run.trial016.stdout:mon is available 2026-02-17T08:21:51.342 INFO:teuthology.orchestra.run.trial016.stdout:Assimilating anything we can from ceph.conf... 2026-02-17T08:21:51.447 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 ceph-mon[38609]: mkfs ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:51.448 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 ceph-mon[38609]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-17T08:21:51.484 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:51.484 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T08:21:51.485 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout fsid = ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:51.485 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T08:21:51.485 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.16:3300,v1:10.20.193.16:6789] 2026-02-17T08:21:51.485 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T08:21:51.485 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T08:21:51.485 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T08:21:51.485 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T08:21:51.485 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:51.485 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T08:21:51.486 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T08:21:51.486 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:51.486 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T08:21:51.486 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-17T08:21:51.486 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-17T08:21:51.486 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-17T08:21:51.486 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.424+0000 7f8e4f589640 1 Processor -- start 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.424+0000 7f8e4f589640 1 -- start start 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.424+0000 7f8e4f589640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e481094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.424+0000 7f8e4f589640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8e48109aa0 con 0x7f8e481090d0 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.424+0000 7f8e4d2fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e481094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.424+0000 7f8e4d2fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e481094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43734/0 (socket says 10.20.193.16:43734) 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.424+0000 7f8e4d2fe640 1 -- 10.20.193.16:0/4285875949 learned_addr learned my addr 10.20.193.16:0/4285875949 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.424+0000 7f8e4d2fe640 1 -- 10.20.193.16:0/4285875949 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4810a2d0 con 0x7f8e481090d0 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e4d2fe640 1 --2- 10.20.193.16:0/4285875949 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e481094d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009920 tx=0x7f8e3802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0367d4211dc6124 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e37fff640 1 -- 10.20.193.16:0/4285875949 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e3803c070 con 0x7f8e481090d0 2026-02-17T08:21:51.487 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e37fff640 1 -- 10.20.193.16:0/4285875949 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3802fae0 con 0x7f8e481090d0 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e37fff640 1 -- 10.20.193.16:0/4285875949 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e3802fde0 con 0x7f8e481090d0 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e4f589640 1 -- 10.20.193.16:0/4285875949 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 msgr2=0x7f8e481094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e4f589640 1 --2- 10.20.193.16:0/4285875949 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e481094d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009920 tx=0x7f8e3802ef20 comp rx=0 tx=0).stop 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e4f589640 1 -- 10.20.193.16:0/4285875949 shutdown_connections 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e4f589640 1 --2- 10.20.193.16:0/4285875949 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e481094d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e4f589640 1 -- 10.20.193.16:0/4285875949 >> 10.20.193.16:0/4285875949 conn(0x7f8e4807c550 msgr2=0x7f8e4807c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e4f589640 1 -- 10.20.193.16:0/4285875949 shutdown_connections 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.425+0000 7f8e4f589640 1 -- 10.20.193.16:0/4285875949 wait complete. 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4f589640 1 Processor -- start 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4f589640 1 -- start start 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4f589640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e4819e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:51.488 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4f589640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4810a800 con 0x7f8e481090d0 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4d2fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e4819e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4d2fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e4819e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43748/0 (socket says 10.20.193.16:43748) 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4d2fe640 1 -- 10.20.193.16:0/2094705047 learned_addr learned my addr 10.20.193.16:0/2094705047 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4d2fe640 1 -- 10.20.193.16:0/2094705047 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4819ebd0 con 0x7f8e481090d0 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4d2fe640 1 --2- 10.20.193.16:0/2094705047 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e4819e690 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009a50 tx=0x7f8e380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e367fc640 1 -- 10.20.193.16:0/2094705047 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e3803c050 con 0x7f8e481090d0 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e367fc640 1 -- 10.20.193.16:0/2094705047 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e38048070 con 0x7f8e481090d0 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4f589640 1 -- 10.20.193.16:0/2094705047 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4819ee60 con 0x7f8e481090d0 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e367fc640 1 -- 10.20.193.16:0/2094705047 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e38043710 con 0x7f8e481090d0 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e4f589640 1 -- 10.20.193.16:0/2094705047 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e481a1b50 con 0x7f8e481090d0 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e367fc640 1 -- 10.20.193.16:0/2094705047 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f8e380438b0 con 0x7f8e481090d0 2026-02-17T08:21:51.489 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e367fc640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e367fc640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e367fc640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e367fc640 4 mgrc reconnect No active mgr available yet 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.426+0000 7f8e367fc640 1 -- 10.20.193.16:0/2094705047 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8e3804dc70 con 0x7f8e481090d0 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.427+0000 7f8e4f589640 1 -- 10.20.193.16:0/2094705047 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4810ade0 con 0x7f8e481090d0 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.428+0000 7f8e367fc640 1 -- 10.20.193.16:0/2094705047 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f8e38043d60 con 0x7f8e481090d0 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.457+0000 7f8e4f589640 1 -- 10.20.193.16:0/2094705047 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f8e48197730 con 0x7f8e481090d0 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.459+0000 7f8e367fc640 1 -- 10.20.193.16:0/2094705047 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f8e3804d460 con 0x7f8e481090d0 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.460+0000 7f8e367fc640 1 -- 10.20.193.16:0/2094705047 <== mon.0 v2:10.20.193.16:3300/0 8 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f8e3803d040 con 0x7f8e481090d0 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.460+0000 7f8e4f589640 10 mgrc shutdown 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.460+0000 7f8e4f589640 1 -- 10.20.193.16:0/2094705047 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 msgr2=0x7f8e4819e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.460+0000 7f8e4f589640 1 --2- 10.20.193.16:0/2094705047 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e4819e690 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009a50 tx=0x7f8e380047c0 comp rx=0 tx=0).stop 2026-02-17T08:21:51.490 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.460+0000 7f8e4f589640 1 -- 10.20.193.16:0/2094705047 shutdown_connections 2026-02-17T08:21:51.491 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.460+0000 7f8e4f589640 1 --2- 10.20.193.16:0/2094705047 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8e481090d0 0x7f8e4819e690 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:51.491 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.460+0000 7f8e4f589640 1 -- 10.20.193.16:0/2094705047 >> 10.20.193.16:0/2094705047 conn(0x7f8e4807c550 msgr2=0x7f8e481929a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:51.491 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.460+0000 7f8e4f589640 1 -- 10.20.193.16:0/2094705047 shutdown_connections 2026-02-17T08:21:51.491 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.460+0000 7f8e4f589640 1 -- 10.20.193.16:0/2094705047 wait complete. 2026-02-17T08:21:51.491 INFO:teuthology.orchestra.run.trial016.stdout:Generating new minimal ceph.conf... 2026-02-17T08:21:51.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.568+0000 7f6a02c4e640 1 Processor -- start 2026-02-17T08:21:51.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.568+0000 7f6a02c4e640 1 -- start start 2026-02-17T08:21:51.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.568+0000 7f6a02c4e640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc1094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:51.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.568+0000 7f6a02c4e640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc109a80 con 0x7f69fc1090b0 2026-02-17T08:21:51.634 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.568+0000 7f6a009c3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc1094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.569+0000 7f6a009c3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc1094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43764/0 (socket says 10.20.193.16:43764) 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.569+0000 7f6a009c3640 1 -- 10.20.193.16:0/3620341483 learned_addr learned my addr 10.20.193.16:0/3620341483 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.569+0000 7f6a009c3640 1 -- 10.20.193.16:0/3620341483 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc10a2b0 con 0x7f69fc1090b0 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.569+0000 7f6a009c3640 1 --2- 10.20.193.16:0/3620341483 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc1094b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009920 tx=0x7f69ec02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbbd4ae8c227db8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.569+0000 7f69f37fe640 1 -- 10.20.193.16:0/3620341483 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69ec03c070 con 0x7f69fc1090b0 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.569+0000 7f69f37fe640 1 -- 10.20.193.16:0/3620341483 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f69ec037440 con 0x7f69fc1090b0 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.569+0000 7f69f37fe640 1 -- 10.20.193.16:0/3620341483 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69ec035340 con 0x7f69fc1090b0 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3620341483 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 msgr2=0x7f69fc1094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 --2- 10.20.193.16:0/3620341483 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc1094b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009920 tx=0x7f69ec02ef20 comp rx=0 tx=0).stop 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3620341483 shutdown_connections 2026-02-17T08:21:51.635 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 --2- 10.20.193.16:0/3620341483 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc1094b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3620341483 >> 10.20.193.16:0/3620341483 conn(0x7f69fc07c530 msgr2=0x7f69fc07c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3620341483 shutdown_connections 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3620341483 wait complete. 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 Processor -- start 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 -- start start 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a02c4e640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc10d4e0 con 0x7f69fc1090b0 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a009c3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a009c3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc19edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43776/0 (socket says 10.20.193.16:43776) 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a009c3640 1 -- 10.20.193.16:0/3020652361 learned_addr learned my addr 10.20.193.16:0/3020652361 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.570+0000 7f6a009c3640 1 -- 10.20.193.16:0/3020652361 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc19f330 con 0x7f69fc1090b0 2026-02-17T08:21:51.636 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f6a009c3640 1 --2- 10.20.193.16:0/3020652361 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc19edf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69ec006fd0 tx=0x7f69ec037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f69f1ffb640 1 -- 10.20.193.16:0/3020652361 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69ec045070 con 0x7f69fc1090b0 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f69f1ffb640 1 -- 10.20.193.16:0/3020652361 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f69ec040450 con 0x7f69fc1090b0 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3020652361 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69fc19f5c0 con 0x7f69fc1090b0 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f69f1ffb640 1 -- 10.20.193.16:0/3020652361 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69ec03c070 con 0x7f69fc1090b0 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3020652361 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69fc1a22b0 con 0x7f69fc1090b0 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f69f1ffb640 1 -- 10.20.193.16:0/3020652361 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f69ec04a440 con 0x7f69fc1090b0 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f69f1ffb640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f69f1ffb640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f69f1ffb640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f69f1ffb640 4 mgrc reconnect No active mgr available yet 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f69f1ffb640 1 -- 10.20.193.16:0/3020652361 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f69ec049910 con 0x7f69fc1090b0 2026-02-17T08:21:51.637 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.571+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3020652361 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69fc109530 con 0x7f69fc1090b0 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.572+0000 7f69f1ffb640 1 -- 10.20.193.16:0/3020652361 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f69ec049b10 con 0x7f69fc1090b0 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.599+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3020652361 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f69fc1a2690 con 0x7f69fc1090b0 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.599+0000 7f69f1ffb640 1 -- 10.20.193.16:0/3020652361 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f69ec049cf0 con 0x7f69fc1090b0 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.600+0000 7f6a02c4e640 10 mgrc shutdown 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.600+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3020652361 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 msgr2=0x7f69fc19edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.600+0000 7f6a02c4e640 1 --2- 10.20.193.16:0/3020652361 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc19edf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69ec006fd0 tx=0x7f69ec037b70 comp rx=0 tx=0).stop 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.600+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3020652361 shutdown_connections 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.600+0000 7f6a02c4e640 1 --2- 10.20.193.16:0/3020652361 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f69fc1090b0 0x7f69fc19edf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.600+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3020652361 >> 10.20.193.16:0/3020652361 conn(0x7f69fc07c530 msgr2=0x7f69fc106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.600+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3020652361 shutdown_connections 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:51.600+0000 7f6a02c4e640 1 -- 10.20.193.16:0/3020652361 wait complete. 2026-02-17T08:21:51.638 INFO:teuthology.orchestra.run.trial016.stdout:Restarting the monitor... 2026-02-17T08:21:51.704 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 systemd[1]: Stopping Ceph mon.a for ad06c547-0bd9-11f1-adc2-d404e6e7d460... 2026-02-17T08:21:51.960 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mon-a[38605]: 2026-02-17T08:21:51.702+0000 7f62915b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T08:21:51.960 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mon-a[38605]: 2026-02-17T08:21:51.702+0000 7f62915b5640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T08:21:51.960 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 podman[38893]: 2026-02-17 08:21:51.814634913 +0000 UTC m=+0.123500453 container died 6c93b106baa84f3b34d62fd36923f3747b403b4451a8994c7836a3be989dc37e (image=quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, name=ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mon-a, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260209, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, CEPH_REF=wip-bharath19-testing-2026-02-13-0903-squid, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-17T08:21:51.960 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 podman[38893]: 2026-02-17 08:21:51.823675495 +0000 UTC m=+0.132541035 container remove 6c93b106baa84f3b34d62fd36923f3747b403b4451a8994c7836a3be989dc37e (image=quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, name=ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_REF=wip-bharath19-testing-2026-02-13-0903-squid, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_SHA1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-17T08:21:51.960 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 bash[38893]: ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mon-a 2026-02-17T08:21:51.960 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 systemd[1]: ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-17T08:21:51.961 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 systemd[1]: Stopped Ceph mon.a for ad06c547-0bd9-11f1-adc2-d404e6e7d460. 2026-02-17T08:21:51.961 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 systemd[1]: Starting Ceph mon.a for ad06c547-0bd9-11f1-adc2-d404e6e7d460... 2026-02-17T08:21:51.961 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 podman[39022]: 2026-02-17 08:21:51.958334022 +0000 UTC m=+0.014908176 container create 31eb8f08c2857b4ded14833130dff41d9ab06fbd764d08d437900b3edf17f343 (image=quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, name=ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mon-a, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, CEPH_REF=wip-bharath19-testing-2026-02-13-0903-squid, OSD_FLAVOR=default, CEPH_SHA1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) 2026-02-17T08:21:51.992 INFO:teuthology.orchestra.run.trial016.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-17T08:21:52.144 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.087+0000 7efdcc703640 1 Processor -- start 2026-02-17T08:21:52.144 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.087+0000 7efdcc703640 1 -- start start 2026-02-17T08:21:52.144 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.087+0000 7efdcc703640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc41094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:52.144 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.087+0000 7efdcc703640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4109ac0 con 0x7efdc41090f0 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.087+0000 7efdca478640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc41094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.087+0000 7efdca478640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc41094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43786/0 (socket says 10.20.193.16:43786) 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.087+0000 7efdca478640 1 -- 10.20.193.16:0/1765691606 learned_addr learned my addr 10.20.193.16:0/1765691606 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.087+0000 7efdca478640 1 -- 10.20.193.16:0/1765691606 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc410a2f0 con 0x7efdc41090f0 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.088+0000 7efdca478640 1 --2- 10.20.193.16:0/1765691606 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc41094f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009920 tx=0x7efdb402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dec094e0eff538b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.088+0000 7efdc9476640 1 -- 10.20.193.16:0/1765691606 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb403c070 con 0x7efdc41090f0 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.088+0000 7efdc9476640 1 -- 10.20.193.16:0/1765691606 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7efdb4037440 con 0x7efdc41090f0 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.088+0000 7efdc9476640 1 -- 10.20.193.16:0/1765691606 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb4035340 con 0x7efdc41090f0 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 -- 10.20.193.16:0/1765691606 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 msgr2=0x7efdc41094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 --2- 10.20.193.16:0/1765691606 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc41094f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009920 tx=0x7efdb402ef20 comp rx=0 tx=0).stop 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 -- 10.20.193.16:0/1765691606 shutdown_connections 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 --2- 10.20.193.16:0/1765691606 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc41094f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 -- 10.20.193.16:0/1765691606 >> 10.20.193.16:0/1765691606 conn(0x7efdc407c610 msgr2=0x7efdc407ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 -- 10.20.193.16:0/1765691606 shutdown_connections 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 -- 10.20.193.16:0/1765691606 wait complete. 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 Processor -- start 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 -- start start 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:52.145 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdcc703640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7efdc410d520 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdca478640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdca478640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc419ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43800/0 (socket says 10.20.193.16:43800) 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.089+0000 7efdca478640 1 -- 10.20.193.16:0/628444860 learned_addr learned my addr 10.20.193.16:0/628444860 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdca478640 1 -- 10.20.193.16:0/628444860 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc419f3a0 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdca478640 1 --2- 10.20.193.16:0/628444860 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc419ee60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efdb402f4a0 tx=0x7efdb4035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdab7fe640 1 -- 10.20.193.16:0/628444860 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb4045070 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdab7fe640 1 -- 10.20.193.16:0/628444860 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7efdb4040450 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdab7fe640 1 -- 10.20.193.16:0/628444860 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdb403c070 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdcc703640 1 -- 10.20.193.16:0/628444860 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc419f630 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdcc703640 1 -- 10.20.193.16:0/628444860 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc41a2320 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdab7fe640 1 -- 10.20.193.16:0/628444860 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7efdb404a440 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdab7fe640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdab7fe640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdab7fe640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdab7fe640 4 mgrc reconnect No active mgr available yet 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdab7fe640 1 -- 10.20.193.16:0/628444860 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efdb4049870 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.090+0000 7efdcc703640 1 -- 10.20.193.16:0/628444860 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc4109570 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.092+0000 7efdab7fe640 1 -- 10.20.193.16:0/628444860 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7efdb4040600 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.120+0000 7efdcc703640 1 -- 10.20.193.16:0/628444860 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7efdc41a2700 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.121+0000 7efdab7fe640 1 -- 10.20.193.16:0/628444860 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 125+0+0 (secure 0 0 0) 0x7efdb4040950 con 0x7efdc41090f0 2026-02-17T08:21:52.146 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.122+0000 7efdcc703640 10 mgrc shutdown 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.122+0000 7efdcc703640 1 -- 10.20.193.16:0/628444860 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 msgr2=0x7efdc419ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.122+0000 7efdcc703640 1 --2- 10.20.193.16:0/628444860 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc419ee60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efdb402f4a0 tx=0x7efdb4035f80 comp rx=0 tx=0).stop 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.122+0000 7efdcc703640 1 -- 10.20.193.16:0/628444860 shutdown_connections 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.122+0000 7efdcc703640 1 --2- 10.20.193.16:0/628444860 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7efdc41090f0 0x7efdc419ee60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.122+0000 7efdcc703640 1 -- 10.20.193.16:0/628444860 >> 10.20.193.16:0/628444860 conn(0x7efdc407c610 msgr2=0x7efdc4106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.122+0000 7efdcc703640 1 -- 10.20.193.16:0/628444860 shutdown_connections 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.122+0000 7efdcc703640 1 -- 10.20.193.16:0/628444860 wait complete. 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:Creating mgr... 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-17T08:21:52.147 INFO:teuthology.orchestra.run.trial016.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-17T08:21:52.276 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mgr.a 2026-02-17T08:21:52.276 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mgr.a.service: Unit ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mgr.a.service not loaded. 2026-02-17T08:21:52.282 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 podman[39022]: 2026-02-17 08:21:51.984587414 +0000 UTC m=+0.041161508 container init 31eb8f08c2857b4ded14833130dff41d9ab06fbd764d08d437900b3edf17f343 (image=quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, name=ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260209, CEPH_REF=wip-bharath19-testing-2026-02-13-0903-squid, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T08:21:52.282 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 podman[39022]: 2026-02-17 08:21:51.987116228 +0000 UTC m=+0.043690322 container start 31eb8f08c2857b4ded14833130dff41d9ab06fbd764d08d437900b3edf17f343 (image=quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, name=ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mon-a, org.label-schema.build-date=20260209, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e, io.buildah.version=1.41.3, ceph=True, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-bharath19-testing-2026-02-13-0903-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T08:21:52.282 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 bash[39022]: 31eb8f08c2857b4ded14833130dff41d9ab06fbd764d08d437900b3edf17f343 2026-02-17T08:21:52.282 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 podman[39022]: 2026-02-17 08:21:51.952171126 +0000 UTC m=+0.008745220 image pull c14711ab021379ae69df099a7c56897872be92f7e323d46f96413a3a8067c281 quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T08:21:52.282 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:51 trial016 systemd[1]: Started Ceph mon.a for ad06c547-0bd9-11f1-adc2-d404e6e7d460. 2026-02-17T08:21:52.283 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: set uid:gid to 167:167 (ceph:ceph) 2026-02-17T08:21:52.283 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable), process ceph-mon, pid 2 2026-02-17T08:21:52.283 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: pidfile_write: ignore empty --pid-file 2026-02-17T08:21:52.283 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: load: jerasure load: lrc 2026-02-17T08:21:52.283 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: RocksDB version: 7.9.2 2026-02-17T08:21:52.283 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Git sha 0 2026-02-17T08:21:52.283 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Compile date 2026-02-13 10:09:30 2026-02-17T08:21:52.283 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: DB SUMMARY 2026-02-17T08:21:52.283 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: DB Session ID: 5ILCYYQDRD4TDXOLI00C 2026-02-17T08:21:52.283 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: CURRENT file: CURRENT 2026-02-17T08:21:52.284 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: IDENTITY file: IDENTITY 2026-02-17T08:21:52.284 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-17T08:21:52.284 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-17T08:21:52.284 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 82105 ; 2026-02-17T08:21:52.284 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.error_if_exists: 0 2026-02-17T08:21:52.284 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.create_if_missing: 0 2026-02-17T08:21:52.284 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.paranoid_checks: 1 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.env: 0x561f49f66dc0 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.fs: PosixFileSystem 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.info_log: 0x561f4b76d880 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_file_opening_threads: 16 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.statistics: (nil) 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.use_fsync: 0 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_log_file_size: 0 2026-02-17T08:21:52.286 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.keep_log_file_num: 1000 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.recycle_log_file_num: 0 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.allow_fallocate: 1 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.allow_mmap_reads: 0 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.allow_mmap_writes: 0 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.use_direct_reads: 0 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.create_missing_column_families: 0 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.db_log_dir: 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.wal_dir: 2026-02-17T08:21:52.287 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.advise_random_on_open: 1 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.db_write_buffer_size: 0 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.write_buffer_manager: 0x561f4b771900 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-17T08:21:52.288 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.rate_limiter: (nil) 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.wal_recovery_mode: 2 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.enable_thread_tracking: 0 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.enable_pipelined_write: 0 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.unordered_write: 0 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.row_cache: None 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.wal_filter: None 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-17T08:21:52.289 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.allow_ingest_behind: 0 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.two_write_queues: 0 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.manual_wal_flush: 0 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.wal_compression: 0 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.atomic_flush: 0 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.log_readahead_size: 0 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.best_efforts_recovery: 0 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-17T08:21:52.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.allow_data_in_errors: 0 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.db_host_id: __hostname__ 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_background_jobs: 2 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_background_compactions: -1 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_subcompactions: 1 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_total_wal_size: 0 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-17T08:21:52.291 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_open_files: -1 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bytes_per_sync: 0 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_readahead_size: 0 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_background_flushes: -1 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Compression algorithms supported: 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: kZSTD supported: 0 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: kXpressCompression supported: 0 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: kBZip2Compression supported: 0 2026-02-17T08:21:52.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: kLZ4Compression supported: 1 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: kZlibCompression supported: 1 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: kLZ4HCCompression supported: 1 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: kSnappyCompression supported: 1 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.merge_operator: 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_filter: None 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_filter_factory: None 2026-02-17T08:21:52.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.sst_partitioner_factory: None 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561f4b76c480) 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout: cache_index_and_filter_blocks: 1 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout: pin_top_level_index_and_filter: 1 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout: index_type: 0 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout: data_block_index_type: 0 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout: index_shortening: 1 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-17T08:21:52.294 INFO:journalctl@ceph.mon.a.trial016.stdout: checksum: 4 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: no_block_cache: 0 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: block_cache: 0x561f4b791350 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: block_cache_name: BinnedLRUCache 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: block_cache_options: 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: capacity : 536870912 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: num_shard_bits : 4 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: strict_capacity_limit : 0 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: high_pri_pool_ratio: 0.000 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: block_cache_compressed: (nil) 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: persistent_cache: (nil) 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: block_size: 4096 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: block_size_deviation: 10 2026-02-17T08:21:52.295 INFO:journalctl@ceph.mon.a.trial016.stdout: block_restart_interval: 16 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: index_block_restart_interval: 1 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: metadata_block_size: 4096 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: partition_filters: 0 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: use_delta_encoding: 1 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: filter_policy: bloomfilter 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: whole_key_filtering: 1 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: verify_compression: 0 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: read_amp_bytes_per_bit: 0 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: format_version: 5 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: enable_index_compression: 1 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: block_align: 0 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: max_auto_readahead_size: 262144 2026-02-17T08:21:52.296 INFO:journalctl@ceph.mon.a.trial016.stdout: prepopulate_block_cache: 0 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout: initial_auto_readahead_size: 8192 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout: num_file_reads_for_auto_readahead: 2 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.write_buffer_size: 33554432 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_write_buffer_number: 2 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compression: NoCompression 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bottommost_compression: Disabled 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.prefix_extractor: nullptr 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.num_levels: 7 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-17T08:21:52.297 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compression_opts.level: 32767 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compression_opts.strategy: 0 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-17T08:21:52.298 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compression_opts.enabled: false 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.target_file_size_base: 67108864 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-17T08:21:52.299 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.arena_block_size: 1048576 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-17T08:21:52.300 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.disable_auto_compactions: 0 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-17T08:21:52.301 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.inplace_update_support: 0 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.bloom_locality: 0 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.max_successive_merges: 0 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.paranoid_file_checks: 0 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.force_consistency_checks: 1 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.report_bg_io_stats: 0 2026-02-17T08:21:52.302 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.ttl: 2592000 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.enable_blob_files: false 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.min_blob_size: 0 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.blob_file_size: 268435456 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.blob_file_starting_level: 0 2026-02-17T08:21:52.303 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 206af3a3-8375-409d-9e31-d0699f1ed9da 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771316512006208, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771316512007183, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 78541, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 255, "table_properties": {"data_size": 76711, "index_size": 215, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11310, "raw_average_key_size": 50, "raw_value_size": 70489, "raw_average_value_size": 311, "num_data_blocks": 9, "num_entries": 226, "num_filter_entries": 226, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771316512, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "206af3a3-8375-409d-9e31-d0699f1ed9da", "db_session_id": "5ILCYYQDRD4TDXOLI00C", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771316512007243, "job": 1, "event": "recovery_finished"} 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561f4b792e00 2026-02-17T08:21:52.304 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: DB pointer 0x561f4b89e000 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout: ** DB Stats ** 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-17T08:21:52.305 INFO:journalctl@ceph.mon.a.trial016.stdout: ** Compaction Stats [default] ** 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: L0 2/0 78.56 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: Sum 2/0 78.56 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: ** Compaction Stats [default] ** 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 114.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-17T08:21:52.306 INFO:journalctl@ceph.mon.a.trial016.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: Cumulative compaction: 0.00 GB write, 25.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: Interval compaction: 0.00 GB write, 25.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: Block cache BinnedLRUCache@0x561f4b791350#2 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2026-02-17T08:21:52.307 INFO:journalctl@ceph.mon.a.trial016.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: starting mon.a rank 0 at public addrs [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] at bind addrs [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: mon.a@-1(???) e1 preinit fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: mon.a@-1(???).mds e1 new map 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: mon.a@-1(???).mds e1 print_map 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout: e1 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout: btime 2026-02-17T08:21:51:185386+0000 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout: legacy client fscid: -1 2026-02-17T08:21:52.308 INFO:journalctl@ceph.mon.a.trial016.stdout: 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout: No filesystems configured 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: monmap epoch 1 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: last_changed 2026-02-17T08:21:50.249033+0000 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: created 2026-02-17T08:21:50.249033+0000 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: min_mon_release 19 (squid) 2026-02-17T08:21:52.309 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: election_strategy: 1 2026-02-17T08:21:52.310 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: 0: [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] mon.a 2026-02-17T08:21:52.310 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: fsmap 2026-02-17T08:21:52.310 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: osdmap e1: 0 total, 0 up, 0 in 2026-02-17T08:21:52.310 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-mon[39048]: mgrmap e1: no daemons active 2026-02-17T08:21:52.391 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460.target.wants/ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@mgr.a.service → /etc/systemd/system/ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@.service. 2026-02-17T08:21:52.536 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T08:21:52.536 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout disabled 2026-02-17T08:21:52.541 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T08:21:52.541 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-17T08:21:52.541 INFO:teuthology.orchestra.run.trial016.stdout:firewalld.service is not enabled 2026-02-17T08:21:52.541 INFO:teuthology.orchestra.run.trial016.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T08:21:52.548 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T08:21:52.548 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout disabled 2026-02-17T08:21:52.553 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T08:21:52.553 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-17T08:21:52.553 INFO:teuthology.orchestra.run.trial016.stdout:firewalld.service is not enabled 2026-02-17T08:21:52.553 INFO:teuthology.orchestra.run.trial016.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-17T08:21:52.553 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mgr to start... 2026-02-17T08:21:52.553 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mgr... 2026-02-17T08:21:52.579 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:52 trial016 systemd[1]: Started Ceph mgr.a for ad06c547-0bd9-11f1-adc2-d404e6e7d460. 2026-02-17T08:21:52.730 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:52.731 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-17T08:21:52.731 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsid": "ad06c547-0bd9-11f1-adc2-d404e6e7d460", 2026-02-17T08:21:52.731 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T08:21:52.731 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T08:21:52.731 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T08:21:52.731 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T08:21:52.731 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:52.731 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T08:21:52.731 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T08:21:52.731 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 0 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T08:21:52.732 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T08:21:52.733 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T08:21:51:185386+0000", 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T08:21:52.734 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T08:21:51.185962+0000", 2026-02-17T08:21:52.735 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.664+0000 7f7997dcd640 1 Processor -- start 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.664+0000 7f7997dcd640 1 -- start start 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.664+0000 7f7997dcd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f79901094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.664+0000 7f7997dcd640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7990109ac0 con 0x7f79901090f0 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.665+0000 7f7995b42640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f79901094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.665+0000 7f7995b42640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f79901094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43828/0 (socket says 10.20.193.16:43828) 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.665+0000 7f7995b42640 1 -- 10.20.193.16:0/1674764744 learned_addr learned my addr 10.20.193.16:0/1674764744 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.665+0000 7f7995b42640 1 -- 10.20.193.16:0/1674764744 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799010a2f0 con 0x7f79901090f0 2026-02-17T08:21:52.736 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.665+0000 7f7995b42640 1 --2- 10.20.193.16:0/1674764744 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f79901094f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7980009920 tx=0x7f798002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf72b74d0b23cd1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.665+0000 7f7994b40640 1 -- 10.20.193.16:0/1674764744 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798003c070 con 0x7f79901090f0 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7994b40640 1 -- 10.20.193.16:0/1674764744 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f7980037440 con 0x7f79901090f0 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7994b40640 1 -- 10.20.193.16:0/1674764744 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7980035340 con 0x7f79901090f0 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674764744 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 msgr2=0x7f79901094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 --2- 10.20.193.16:0/1674764744 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f79901094f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7980009920 tx=0x7f798002ef20 comp rx=0 tx=0).stop 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674764744 shutdown_connections 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 --2- 10.20.193.16:0/1674764744 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f79901094f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674764744 >> 10.20.193.16:0/1674764744 conn(0x7f799007c610 msgr2=0x7f799007ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674764744 shutdown_connections 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674764744 wait complete. 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 Processor -- start 2026-02-17T08:21:52.737 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 -- start start 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f799019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7997dcd640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f799010d520 con 0x7f79901090f0 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7995b42640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f799019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7995b42640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f799019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43832/0 (socket says 10.20.193.16:43832) 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7995b42640 1 -- 10.20.193.16:0/1674125395 learned_addr learned my addr 10.20.193.16:0/1674125395 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.666+0000 7f7995b42640 1 -- 10.20.193.16:0/1674125395 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799019f3a0 con 0x7f79901090f0 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f7995b42640 1 --2- 10.20.193.16:0/1674125395 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f799019ee60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7980006fd0 tx=0x7f7980035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f797effd640 1 -- 10.20.193.16:0/1674125395 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7980045070 con 0x7f79901090f0 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f797effd640 1 -- 10.20.193.16:0/1674125395 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f7980040450 con 0x7f79901090f0 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f797effd640 1 -- 10.20.193.16:0/1674125395 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f798003c070 con 0x7f79901090f0 2026-02-17T08:21:52.738 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674125395 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799019f630 con 0x7f79901090f0 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674125395 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79901a2320 con 0x7f79901090f0 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f797effd640 1 -- 10.20.193.16:0/1674125395 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f798004a440 con 0x7f79901090f0 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f797effd640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f797effd640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f797effd640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f797effd640 4 mgrc reconnect No active mgr available yet 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f797effd640 1 -- 10.20.193.16:0/1674125395 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7980049950 con 0x7f79901090f0 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.667+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674125395 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7990109570 con 0x7f79901090f0 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.669+0000 7f797effd640 1 -- 10.20.193.16:0/1674125395 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f7980049b50 con 0x7f79901090f0 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.697+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674125395 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f79901a2690 con 0x7f79901090f0 2026-02-17T08:21:52.739 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.698+0000 7f797effd640 1 -- 10.20.193.16:0/1674125395 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f7980049d30 con 0x7f79901090f0 2026-02-17T08:21:52.740 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.698+0000 7f7997dcd640 10 mgrc shutdown 2026-02-17T08:21:52.740 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.698+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674125395 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 msgr2=0x7f799019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:52.740 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.698+0000 7f7997dcd640 1 --2- 10.20.193.16:0/1674125395 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f799019ee60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7980006fd0 tx=0x7f7980035570 comp rx=0 tx=0).stop 2026-02-17T08:21:52.740 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.698+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674125395 shutdown_connections 2026-02-17T08:21:52.740 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.698+0000 7f7997dcd640 1 --2- 10.20.193.16:0/1674125395 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f79901090f0 0x7f799019ee60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:52.740 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.698+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674125395 >> 10.20.193.16:0/1674125395 conn(0x7f799007c610 msgr2=0x7f7990106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:52.740 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.698+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674125395 shutdown_connections 2026-02-17T08:21:52.740 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:52.698+0000 7f7997dcd640 1 -- 10.20.193.16:0/1674125395 wait complete. 2026-02-17T08:21:52.740 INFO:teuthology.orchestra.run.trial016.stdout:mgr not available, waiting (1/15)... 2026-02-17T08:21:53.187 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/628444860' entity='client.admin' 2026-02-17T08:21:53.187 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1674125395' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T08:21:53.188 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:52 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:52.906+0000 7ff7bfef8140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T08:21:53.188 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.048+0000 7ff7bfef8140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T08:21:53.188 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.081+0000 7ff7bfef8140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T08:21:53.188 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.122+0000 7ff7bfef8140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T08:21:53.188 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.152+0000 7ff7bfef8140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T08:21:53.188 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.185+0000 7ff7bfef8140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T08:21:53.451 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.249+0000 7ff7bfef8140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T08:21:53.452 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T08:21:53.452 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T08:21:53.452 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: from numpy import show_config as show_numpy_config 2026-02-17T08:21:53.452 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.322+0000 7ff7bfef8140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T08:21:53.452 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.355+0000 7ff7bfef8140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T08:21:53.452 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.450+0000 7ff7bfef8140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T08:21:53.869 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.506+0000 7ff7bfef8140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T08:21:53.869 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.539+0000 7ff7bfef8140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T08:21:53.869 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.570+0000 7ff7bfef8140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T08:21:53.869 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.603+0000 7ff7bfef8140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T08:21:53.869 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.634+0000 7ff7bfef8140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T08:21:54.149 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.871+0000 7ff7bfef8140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T08:21:54.149 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.968+0000 7ff7bfef8140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T08:21:54.149 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:53.997+0000 7ff7bfef8140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T08:21:54.149 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:54 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:54.027+0000 7ff7bfef8140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T08:21:54.149 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:54 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:54.119+0000 7ff7bfef8140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T08:21:54.149 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:54 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:54.147+0000 7ff7bfef8140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T08:21:54.619 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:54 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:54.237+0000 7ff7bfef8140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T08:21:54.883 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:54.883 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-17T08:21:54.883 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsid": "ad06c547-0bd9-11f1-adc2-d404e6e7d460", 2026-02-17T08:21:54.883 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T08:21:54.883 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T08:21:54.883 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T08:21:54.883 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 0 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:54.884 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T08:21:54.885 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T08:21:54.885 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:54.885 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T08:21:54.885 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:54.885 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T08:21:54.885 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T08:21:54.885 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T08:21:54.885 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T08:21:54.886 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T08:21:54.886 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T08:21:54.886 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:54.886 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T08:21:54.886 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T08:21:54.886 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T08:21:54.886 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T08:21:54.886 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T08:21:54.886 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T08:21:51:185386+0000", 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T08:21:54.887 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T08:21:51.185962+0000", 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T08:21:54.888 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.820+0000 7fa9721d2640 1 Processor -- start 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.820+0000 7fa9721d2640 1 -- start start 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.820+0000 7fa9721d2640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c107250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.820+0000 7fa9721d2640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c107790 con 0x7fa96c106e50 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.820+0000 7fa96b7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.820+0000 7fa96b7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43848/0 (socket says 10.20.193.16:43848) 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.820+0000 7fa96b7fe640 1 -- 10.20.193.16:0/3629104940 learned_addr learned my addr 10.20.193.16:0/3629104940 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.820+0000 7fa96b7fe640 1 -- 10.20.193.16:0/3629104940 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c107fb0 con 0x7fa96c106e50 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa96b7fe640 1 --2- 10.20.193.16:0/3629104940 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c107250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa958009920 tx=0x7fa95802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3c045ed397374f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:54.889 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa96a7fc640 1 -- 10.20.193.16:0/3629104940 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95803c070 con 0x7fa96c106e50 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa96a7fc640 1 -- 10.20.193.16:0/3629104940 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa958037440 con 0x7fa96c106e50 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa96a7fc640 1 -- 10.20.193.16:0/3629104940 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958035340 con 0x7fa96c106e50 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa9721d2640 1 -- 10.20.193.16:0/3629104940 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 msgr2=0x7fa96c107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa9721d2640 1 --2- 10.20.193.16:0/3629104940 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c107250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa958009920 tx=0x7fa95802ef20 comp rx=0 tx=0).stop 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa9721d2640 1 -- 10.20.193.16:0/3629104940 shutdown_connections 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa9721d2640 1 --2- 10.20.193.16:0/3629104940 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c107250 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa9721d2640 1 -- 10.20.193.16:0/3629104940 >> 10.20.193.16:0/3629104940 conn(0x7fa96c102640 msgr2=0x7fa96c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa9721d2640 1 -- 10.20.193.16:0/3629104940 shutdown_connections 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.821+0000 7fa9721d2640 1 -- 10.20.193.16:0/3629104940 wait complete. 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.822+0000 7fa9721d2640 1 Processor -- start 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.822+0000 7fa9721d2640 1 -- start start 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.822+0000 7fa9721d2640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:54.890 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.822+0000 7fa9721d2640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c10b270 con 0x7fa96c106e50 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.822+0000 7fa96b7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.822+0000 7fa96b7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c19ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43856/0 (socket says 10.20.193.16:43856) 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.822+0000 7fa96b7fe640 1 -- 10.20.193.16:0/2055305250 learned_addr learned my addr 10.20.193.16:0/2055305250 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.822+0000 7fa96b7fe640 1 -- 10.20.193.16:0/2055305250 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c19f320 con 0x7fa96c106e50 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.822+0000 7fa96b7fe640 1 --2- 10.20.193.16:0/2055305250 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c19ede0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa958006fd0 tx=0x7fa958035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa968ff9640 1 -- 10.20.193.16:0/2055305250 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa958045070 con 0x7fa96c106e50 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa968ff9640 1 -- 10.20.193.16:0/2055305250 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa958040450 con 0x7fa96c106e50 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa9721d2640 1 -- 10.20.193.16:0/2055305250 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c19f5b0 con 0x7fa96c106e50 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa968ff9640 1 -- 10.20.193.16:0/2055305250 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa95803c070 con 0x7fa96c106e50 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa9721d2640 1 -- 10.20.193.16:0/2055305250 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96c1a22a0 con 0x7fa96c106e50 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa968ff9640 1 -- 10.20.193.16:0/2055305250 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa95804a440 con 0x7fa96c106e50 2026-02-17T08:21:54.891 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa968ff9640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa968ff9640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa968ff9640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa968ff9640 4 mgrc reconnect No active mgr available yet 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa968ff9640 1 -- 10.20.193.16:0/2055305250 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa958049950 con 0x7fa96c106e50 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.823+0000 7fa9721d2640 1 -- 10.20.193.16:0/2055305250 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa96c1072d0 con 0x7fa96c106e50 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.824+0000 7fa968ff9640 1 -- 10.20.193.16:0/2055305250 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fa958040600 con 0x7fa96c106e50 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.853+0000 7fa9721d2640 1 -- 10.20.193.16:0/2055305250 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa96c1a2610 con 0x7fa96c106e50 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.853+0000 7fa968ff9640 1 -- 10.20.193.16:0/2055305250 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fa958049b50 con 0x7fa96c106e50 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.854+0000 7fa9721d2640 10 mgrc shutdown 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.854+0000 7fa9721d2640 1 -- 10.20.193.16:0/2055305250 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 msgr2=0x7fa96c19ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:54.892 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.854+0000 7fa9721d2640 1 --2- 10.20.193.16:0/2055305250 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c19ede0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa958006fd0 tx=0x7fa958035570 comp rx=0 tx=0).stop 2026-02-17T08:21:54.893 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.854+0000 7fa9721d2640 1 -- 10.20.193.16:0/2055305250 shutdown_connections 2026-02-17T08:21:54.893 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.854+0000 7fa9721d2640 1 --2- 10.20.193.16:0/2055305250 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa96c106e50 0x7fa96c19ede0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:54.893 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.854+0000 7fa9721d2640 1 -- 10.20.193.16:0/2055305250 >> 10.20.193.16:0/2055305250 conn(0x7fa96c102640 msgr2=0x7fa96c1031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:54.893 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.854+0000 7fa9721d2640 1 -- 10.20.193.16:0/2055305250 shutdown_connections 2026-02-17T08:21:54.893 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:54.854+0000 7fa9721d2640 1 -- 10.20.193.16:0/2055305250 wait complete. 2026-02-17T08:21:54.893 INFO:teuthology.orchestra.run.trial016.stdout:mgr not available, waiting (2/15)... 2026-02-17T08:21:55.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:54 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/2055305250' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T08:21:55.120 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:54 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:54.693+0000 7ff7bfef8140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T08:21:55.120 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:54 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:54.722+0000 7ff7bfef8140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T08:21:55.619 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:55.119+0000 7ff7bfef8140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T08:21:56.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: Activating manager daemon a 2026-02-17T08:21:56.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: mgrmap e2: a(active, starting, since 0.00233961s) 2026-02-17T08:21:56.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: from='mgr.14100 10.20.193.16:0/3281652815' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T08:21:56.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: from='mgr.14100 10.20.193.16:0/3281652815' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T08:21:56.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: from='mgr.14100 10.20.193.16:0/3281652815' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T08:21:56.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: from='mgr.14100 10.20.193.16:0/3281652815' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T08:21:56.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: from='mgr.14100 10.20.193.16:0/3281652815' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T08:21:56.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: Manager daemon a is now available 2026-02-17T08:21:56.370 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: from='mgr.14100 10.20.193.16:0/3281652815' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T08:21:56.370 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: from='mgr.14100 10.20.193.16:0/3281652815' entity='mgr.a' 2026-02-17T08:21:56.370 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: from='mgr.14100 10.20.193.16:0/3281652815' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T08:21:56.370 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: from='mgr.14100 10.20.193.16:0/3281652815' entity='mgr.a' 2026-02-17T08:21:56.370 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:55 trial016 ceph-mon[39048]: from='mgr.14100 10.20.193.16:0/3281652815' entity='mgr.a' 2026-02-17T08:21:57.128 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:57.128 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-17T08:21:57.128 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsid": "ad06c547-0bd9-11f1-adc2-d404e6e7d460", 2026-02-17T08:21:57.128 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T08:21:57.128 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T08:21:57.128 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T08:21:57.128 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T08:21:57.128 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 0 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T08:21:57.129 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T08:21:57.130 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T08:21:51:185386+0000", 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T08:21:57.131 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ], 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T08:21:57.132 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T08:21:51.185962+0000", 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout }, 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.976+0000 7f948db37640 1 Processor -- start 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.976+0000 7f948db37640 1 -- start start 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.976+0000 7f948db37640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f94881094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.976+0000 7f948db37640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9488109ac0 con 0x7f94881090f0 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.976+0000 7f94877fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f94881094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.976+0000 7f94877fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f94881094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43918/0 (socket says 10.20.193.16:43918) 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.976+0000 7f94877fe640 1 -- 10.20.193.16:0/2858883987 learned_addr learned my addr 10.20.193.16:0/2858883987 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:57.133 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.976+0000 7f94877fe640 1 -- 10.20.193.16:0/2858883987 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948810a2f0 con 0x7f94881090f0 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f94877fe640 1 --2- 10.20.193.16:0/2858883987 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f94881094f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9474009920 tx=0x7f947402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3724a7cc3276e27a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f94867fc640 1 -- 10.20.193.16:0/2858883987 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f947403c070 con 0x7f94881090f0 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f94867fc640 1 -- 10.20.193.16:0/2858883987 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f9474037440 con 0x7f94881090f0 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f94867fc640 1 -- 10.20.193.16:0/2858883987 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9474035340 con 0x7f94881090f0 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f948db37640 1 -- 10.20.193.16:0/2858883987 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 msgr2=0x7f94881094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f948db37640 1 --2- 10.20.193.16:0/2858883987 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f94881094f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9474009920 tx=0x7f947402ef20 comp rx=0 tx=0).stop 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f948db37640 1 -- 10.20.193.16:0/2858883987 shutdown_connections 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f948db37640 1 --2- 10.20.193.16:0/2858883987 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f94881094f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f948db37640 1 -- 10.20.193.16:0/2858883987 >> 10.20.193.16:0/2858883987 conn(0x7f948807c610 msgr2=0x7f948807ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f948db37640 1 -- 10.20.193.16:0/2858883987 shutdown_connections 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f948db37640 1 -- 10.20.193.16:0/2858883987 wait complete. 2026-02-17T08:21:57.134 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.977+0000 7f948db37640 1 Processor -- start 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f948db37640 1 -- start start 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f948db37640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f948819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f948db37640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f948810d520 con 0x7f94881090f0 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f94877fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f948819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f94877fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f948819ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43922/0 (socket says 10.20.193.16:43922) 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f94877fe640 1 -- 10.20.193.16:0/151426823 learned_addr learned my addr 10.20.193.16:0/151426823 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f94877fe640 1 -- 10.20.193.16:0/151426823 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948819f3a0 con 0x7f94881090f0 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f94877fe640 1 --2- 10.20.193.16:0/151426823 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f948819ee60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9474006fd0 tx=0x7f9474035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f9484ff9640 1 -- 10.20.193.16:0/151426823 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9474045070 con 0x7f94881090f0 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f9484ff9640 1 -- 10.20.193.16:0/151426823 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f9474040450 con 0x7f94881090f0 2026-02-17T08:21:57.135 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f948db37640 1 -- 10.20.193.16:0/151426823 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948819f630 con 0x7f94881090f0 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f9484ff9640 1 -- 10.20.193.16:0/151426823 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f947403c070 con 0x7f94881090f0 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.978+0000 7f948db37640 1 -- 10.20.193.16:0/151426823 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94881a2320 con 0x7f94881090f0 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.979+0000 7f9484ff9640 1 -- 10.20.193.16:0/151426823 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 3) ==== 50208+0+0 (secure 0 0 0) 0x7f94740493b0 con 0x7f94881090f0 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.979+0000 7f9484ff9640 20 mgrc handle_mgr_map mgrmap(e 3) 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.979+0000 7f948db37640 1 -- 10.20.193.16:0/151426823 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9488109570 con 0x7f94881090f0 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.979+0000 7f9484ff9640 4 mgrc handle_mgr_map Got map version 3 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.979+0000 7f9484ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.979+0000 7f9484ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.979+0000 7f9484ff9640 1 --2- 10.20.193.16:0/151426823 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f945c03dc20 0x7f945c0400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.979+0000 7f9484ff9640 1 -- 10.20.193.16:0/151426823 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f94740765d0 con 0x7f94881090f0 2026-02-17T08:21:57.136 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.979+0000 7f9486ffd640 1 --2- 10.20.193.16:0/151426823 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f945c03dc20 0x7f945c0400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.979+0000 7f9486ffd640 1 --2- 10.20.193.16:0/151426823 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f945c03dc20 0x7f945c0400e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f94780099c0 tx=0x7f9478006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:56.982+0000 7f9484ff9640 1 -- 10.20.193.16:0/151426823 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f947403c210 con 0x7f94881090f0 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.095+0000 7f948db37640 1 -- 10.20.193.16:0/151426823 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f94881a2780 con 0x7f94881090f0 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.095+0000 7f9484ff9640 1 -- 10.20.193.16:0/151426823 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f947403fe80 con 0x7f94881090f0 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 10 mgrc shutdown 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 1 -- 10.20.193.16:0/151426823 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f945c03dc20 msgr2=0x7f945c0400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 1 --2- 10.20.193.16:0/151426823 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f945c03dc20 0x7f945c0400e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f94780099c0 tx=0x7f9478006eb0 comp rx=0 tx=0).stop 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 1 -- 10.20.193.16:0/151426823 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 msgr2=0x7f948819ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 1 --2- 10.20.193.16:0/151426823 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f948819ee60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9474006fd0 tx=0x7f9474035570 comp rx=0 tx=0).stop 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 1 -- 10.20.193.16:0/151426823 shutdown_connections 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 1 --2- 10.20.193.16:0/151426823 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f945c03dc20 0x7f945c0400e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:57.137 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 1 --2- 10.20.193.16:0/151426823 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94881090f0 0x7f948819ee60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:57.138 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 1 -- 10.20.193.16:0/151426823 >> 10.20.193.16:0/151426823 conn(0x7f948807c610 msgr2=0x7f9488106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:57.138 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 1 -- 10.20.193.16:0/151426823 shutdown_connections 2026-02-17T08:21:57.138 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.096+0000 7f948db37640 1 -- 10.20.193.16:0/151426823 wait complete. 2026-02-17T08:21:57.138 INFO:teuthology.orchestra.run.trial016.stdout:mgr is available 2026-02-17T08:21:57.159 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:57 trial016 ceph-mon[39048]: mgrmap e3: a(active, since 1.00459s) 2026-02-17T08:21:57.159 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:57 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/151426823' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T08:21:57.328 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:57.329 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T08:21:57.329 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout fsid = ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:21:57.329 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T08:21:57.329 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.16:3300,v1:10.20.193.16:6789] 2026-02-17T08:21:57.329 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T08:21:57.329 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T08:21:57.329 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T08:21:57.329 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T08:21:57.329 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:57.329 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.212+0000 7f2bd383f640 1 Processor -- start 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.212+0000 7f2bd383f640 1 -- start start 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.212+0000 7f2bd383f640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc1094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:57.330 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.212+0000 7f2bd383f640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc109ac0 con 0x7f2bcc1090f0 2026-02-17T08:21:57.331 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.212+0000 7f2bd15b4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc1094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:57.331 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.212+0000 7f2bd15b4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc1094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43930/0 (socket says 10.20.193.16:43930) 2026-02-17T08:21:57.331 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.212+0000 7f2bd15b4640 1 -- 10.20.193.16:0/1572273886 learned_addr learned my addr 10.20.193.16:0/1572273886 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:57.331 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.212+0000 7f2bd15b4640 1 -- 10.20.193.16:0/1572273886 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bcc10a2f0 con 0x7f2bcc1090f0 2026-02-17T08:21:57.331 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bd15b4640 1 --2- 10.20.193.16:0/1572273886 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc1094f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009920 tx=0x7f2bbc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8fb5235f3df4f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:57.331 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bbbfff640 1 -- 10.20.193.16:0/1572273886 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bbc03c070 con 0x7f2bcc1090f0 2026-02-17T08:21:57.331 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bbbfff640 1 -- 10.20.193.16:0/1572273886 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f2bbc037440 con 0x7f2bcc1090f0 2026-02-17T08:21:57.332 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bbbfff640 1 -- 10.20.193.16:0/1572273886 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bbc035340 con 0x7f2bcc1090f0 2026-02-17T08:21:57.332 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bd383f640 1 -- 10.20.193.16:0/1572273886 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 msgr2=0x7f2bcc1094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:57.332 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bd383f640 1 --2- 10.20.193.16:0/1572273886 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc1094f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009920 tx=0x7f2bbc02ef20 comp rx=0 tx=0).stop 2026-02-17T08:21:57.332 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bd383f640 1 -- 10.20.193.16:0/1572273886 shutdown_connections 2026-02-17T08:21:57.332 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bd383f640 1 --2- 10.20.193.16:0/1572273886 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc1094f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:57.332 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bd383f640 1 -- 10.20.193.16:0/1572273886 >> 10.20.193.16:0/1572273886 conn(0x7f2bcc07c610 msgr2=0x7f2bcc07ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:57.332 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bd383f640 1 -- 10.20.193.16:0/1572273886 shutdown_connections 2026-02-17T08:21:57.332 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.213+0000 7f2bd383f640 1 -- 10.20.193.16:0/1572273886 wait complete. 2026-02-17T08:21:57.332 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd383f640 1 Processor -- start 2026-02-17T08:21:57.332 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd383f640 1 -- start start 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd383f640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd383f640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc10d520 con 0x7f2bcc1090f0 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd15b4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd15b4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc19ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43944/0 (socket says 10.20.193.16:43944) 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd15b4640 1 -- 10.20.193.16:0/2978555008 learned_addr learned my addr 10.20.193.16:0/2978555008 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd15b4640 1 -- 10.20.193.16:0/2978555008 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bcc19f3a0 con 0x7f2bcc1090f0 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd15b4640 1 --2- 10.20.193.16:0/2978555008 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc19ee60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc006fd0 tx=0x7f2bbc035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bba7fc640 1 -- 10.20.193.16:0/2978555008 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bbc045070 con 0x7f2bcc1090f0 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bba7fc640 1 -- 10.20.193.16:0/2978555008 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f2bbc040450 con 0x7f2bcc1090f0 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd383f640 1 -- 10.20.193.16:0/2978555008 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bcc19f630 con 0x7f2bcc1090f0 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bba7fc640 1 -- 10.20.193.16:0/2978555008 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bbc03c070 con 0x7f2bcc1090f0 2026-02-17T08:21:57.333 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.214+0000 7f2bd383f640 1 -- 10.20.193.16:0/2978555008 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bcc1a2320 con 0x7f2bcc1090f0 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.215+0000 7f2bd383f640 1 -- 10.20.193.16:0/2978555008 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bcc109570 con 0x7f2bcc1090f0 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.215+0000 7f2bba7fc640 1 -- 10.20.193.16:0/2978555008 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 4) ==== 50314+0+0 (secure 0 0 0) 0x7f2bbc0493b0 con 0x7f2bcc1090f0 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.215+0000 7f2bba7fc640 20 mgrc handle_mgr_map mgrmap(e 4) 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.215+0000 7f2bba7fc640 4 mgrc handle_mgr_map Got map version 4 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.215+0000 7f2bba7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.215+0000 7f2bba7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.215+0000 7f2bba7fc640 1 --2- 10.20.193.16:0/2978555008 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f2ba803dd40 0x7f2ba8040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.215+0000 7f2bba7fc640 1 -- 10.20.193.16:0/2978555008 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2bbc076800 con 0x7f2bcc1090f0 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.215+0000 7f2bd0db3640 1 --2- 10.20.193.16:0/2978555008 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f2ba803dd40 0x7f2ba8040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.215+0000 7f2bd0db3640 1 --2- 10.20.193.16:0/2978555008 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f2ba803dd40 0x7f2ba8040200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00099c0 tx=0x7f2bc0006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:57.334 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.218+0000 7f2bba7fc640 1 -- 10.20.193.16:0/2978555008 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2bbc03c210 con 0x7f2bcc1090f0 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.300+0000 7f2bd383f640 1 -- 10.20.193.16:0/2978555008 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f2bcc1a3900 con 0x7f2bcc1090f0 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.301+0000 7f2bba7fc640 1 -- 10.20.193.16:0/2978555008 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+465 (secure 0 0 0) 0x7f2bbc03fe80 con 0x7f2bcc1090f0 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.301+0000 7f2bd383f640 10 mgrc shutdown 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.302+0000 7f2bd383f640 1 -- 10.20.193.16:0/2978555008 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f2ba803dd40 msgr2=0x7f2ba8040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.302+0000 7f2bd383f640 1 --2- 10.20.193.16:0/2978555008 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f2ba803dd40 0x7f2ba8040200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00099c0 tx=0x7f2bc0006eb0 comp rx=0 tx=0).stop 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.302+0000 7f2bd383f640 1 -- 10.20.193.16:0/2978555008 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 msgr2=0x7f2bcc19ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.302+0000 7f2bd383f640 1 --2- 10.20.193.16:0/2978555008 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc19ee60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc006fd0 tx=0x7f2bbc035570 comp rx=0 tx=0).stop 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.302+0000 7f2bd383f640 1 -- 10.20.193.16:0/2978555008 shutdown_connections 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.302+0000 7f2bd383f640 1 --2- 10.20.193.16:0/2978555008 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f2ba803dd40 0x7f2ba8040200 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.302+0000 7f2bd383f640 1 --2- 10.20.193.16:0/2978555008 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2bcc1090f0 0x7f2bcc19ee60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.302+0000 7f2bd383f640 1 -- 10.20.193.16:0/2978555008 >> 10.20.193.16:0/2978555008 conn(0x7f2bcc07c610 msgr2=0x7f2bcc106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:57.335 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.302+0000 7f2bd383f640 1 -- 10.20.193.16:0/2978555008 shutdown_connections 2026-02-17T08:21:57.336 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.302+0000 7f2bd383f640 1 -- 10.20.193.16:0/2978555008 wait complete. 2026-02-17T08:21:57.336 INFO:teuthology.orchestra.run.trial016.stdout:Enabling cephadm module... 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.413+0000 7fb5fbf97640 1 Processor -- start 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.413+0000 7fb5fbf97640 1 -- start start 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.413+0000 7fb5fbf97640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f41094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.413+0000 7fb5fbf97640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f4109aa0 con 0x7fb5f41090d0 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.413+0000 7fb5f9d0c640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f41094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.414+0000 7fb5f9d0c640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f41094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43958/0 (socket says 10.20.193.16:43958) 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.414+0000 7fb5f9d0c640 1 -- 10.20.193.16:0/4149609608 learned_addr learned my addr 10.20.193.16:0/4149609608 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.414+0000 7fb5f9d0c640 1 -- 10.20.193.16:0/4149609608 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f410a2d0 con 0x7fb5f41090d0 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.414+0000 7fb5f9d0c640 1 --2- 10.20.193.16:0/4149609608 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f41094d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009920 tx=0x7fb5e402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695af2a27e74fec9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.414+0000 7fb5f8d0a640 1 -- 10.20.193.16:0/4149609608 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e403c070 con 0x7fb5f41090d0 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.414+0000 7fb5f8d0a640 1 -- 10.20.193.16:0/4149609608 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fb5e4037440 con 0x7fb5f41090d0 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.414+0000 7fb5f8d0a640 1 -- 10.20.193.16:0/4149609608 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4035340 con 0x7fb5f41090d0 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 -- 10.20.193.16:0/4149609608 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 msgr2=0x7fb5f41094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 --2- 10.20.193.16:0/4149609608 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f41094d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009920 tx=0x7fb5e402ef20 comp rx=0 tx=0).stop 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 -- 10.20.193.16:0/4149609608 shutdown_connections 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 --2- 10.20.193.16:0/4149609608 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f41094d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 -- 10.20.193.16:0/4149609608 >> 10.20.193.16:0/4149609608 conn(0x7fb5f407c550 msgr2=0x7fb5f407c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 -- 10.20.193.16:0/4149609608 shutdown_connections 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 -- 10.20.193.16:0/4149609608 wait complete. 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 Processor -- start 2026-02-17T08:21:58.155 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 -- start start 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5fbf97640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f410d500 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5f9d0c640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5f9d0c640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f419ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43968/0 (socket says 10.20.193.16:43968) 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5f9d0c640 1 -- 10.20.193.16:0/3895587395 learned_addr learned my addr 10.20.193.16:0/3895587395 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.415+0000 7fb5f9d0c640 1 -- 10.20.193.16:0/3895587395 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f419f350 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5f9d0c640 1 --2- 10.20.193.16:0/3895587395 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f419ee10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4006fd0 tx=0x7fb5e4037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5e2ffd640 1 -- 10.20.193.16:0/3895587395 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4045070 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5e2ffd640 1 -- 10.20.193.16:0/3895587395 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fb5e4040450 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5fbf97640 1 -- 10.20.193.16:0/3895587395 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f419f5e0 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5e2ffd640 1 -- 10.20.193.16:0/3895587395 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5e403c070 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5fbf97640 1 -- 10.20.193.16:0/3895587395 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f41a22d0 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5fbf97640 1 -- 10.20.193.16:0/3895587395 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f4109550 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5e2ffd640 1 -- 10.20.193.16:0/3895587395 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 4) ==== 50314+0+0 (secure 0 0 0) 0x7fb5e402fae0 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5e2ffd640 20 mgrc handle_mgr_map mgrmap(e 4) 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5e2ffd640 4 mgrc handle_mgr_map Got map version 4 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5e2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5e2ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5e2ffd640 1 --2- 10.20.193.16:0/3895587395 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fb5d003dcf0 0x7fb5d00401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.416+0000 7fb5e2ffd640 1 -- 10.20.193.16:0/3895587395 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb5e40768a0 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.417+0000 7fb5f950b640 1 --2- 10.20.193.16:0/3895587395 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fb5d003dcf0 0x7fb5d00401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.417+0000 7fb5f950b640 1 --2- 10.20.193.16:0/3895587395 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fb5d003dcf0 0x7fb5d00401b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80099c0 tx=0x7fb5e8006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.419+0000 7fb5e2ffd640 1 -- 10.20.193.16:0/3895587395 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb5e40762c0 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:57.522+0000 7fb5fbf97640 1 -- 10.20.193.16:0/3895587395 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fb5f41a2730 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.127+0000 7fb5e2ffd640 1 -- 10.20.193.16:0/3895587395 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fb5e403ad80 con 0x7fb5f41090d0 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 10 mgrc shutdown 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 1 -- 10.20.193.16:0/3895587395 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fb5d003dcf0 msgr2=0x7fb5d00401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 1 --2- 10.20.193.16:0/3895587395 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fb5d003dcf0 0x7fb5d00401b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80099c0 tx=0x7fb5e8006eb0 comp rx=0 tx=0).stop 2026-02-17T08:21:58.156 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 1 -- 10.20.193.16:0/3895587395 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 msgr2=0x7fb5f419ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:58.157 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 1 --2- 10.20.193.16:0/3895587395 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f419ee10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4006fd0 tx=0x7fb5e4037b70 comp rx=0 tx=0).stop 2026-02-17T08:21:58.157 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 1 -- 10.20.193.16:0/3895587395 shutdown_connections 2026-02-17T08:21:58.157 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 1 --2- 10.20.193.16:0/3895587395 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fb5d003dcf0 0x7fb5d00401b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:58.157 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 1 --2- 10.20.193.16:0/3895587395 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb5f41090d0 0x7fb5f419ee10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:58.157 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 1 -- 10.20.193.16:0/3895587395 >> 10.20.193.16:0/3895587395 conn(0x7fb5f407c550 msgr2=0x7fb5f4106650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:58.157 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 1 -- 10.20.193.16:0/3895587395 shutdown_connections 2026-02-17T08:21:58.157 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.128+0000 7fb5fbf97640 1 -- 10.20.193.16:0/3895587395 wait complete. 2026-02-17T08:21:58.383 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-mon[39048]: mgrmap e4: a(active, since 2s) 2026-02-17T08:21:58.383 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/2978555008' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-17T08:21:58.383 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3895587395' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-17T08:21:58.383 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: ignoring --setuser ceph since I am not root 2026-02-17T08:21:58.383 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: ignoring --setgroup ceph since I am not root 2026-02-17T08:21:58.394 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-17T08:21:58.394 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-17T08:21:58.395 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T08:21:58.395 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-17T08:21:58.395 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T08:21:58.395 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-17T08:21:58.395 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.257+0000 7fd0f55c2640 1 Processor -- start 2026-02-17T08:21:58.395 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.257+0000 7fd0f55c2640 1 -- start start 2026-02-17T08:21:58.395 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.257+0000 7fd0f55c2640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f01094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:58.395 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.257+0000 7fd0f55c2640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f0109a80 con 0x7fd0f01090b0 2026-02-17T08:21:58.395 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.257+0000 7fd0eeffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f01094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:58.395 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.257+0000 7fd0eeffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f01094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:43994/0 (socket says 10.20.193.16:43994) 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.257+0000 7fd0eeffd640 1 -- 10.20.193.16:0/1350297690 learned_addr learned my addr 10.20.193.16:0/1350297690 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.257+0000 7fd0eeffd640 1 -- 10.20.193.16:0/1350297690 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f010a2b0 con 0x7fd0f01090b0 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0eeffd640 1 --2- 10.20.193.16:0/1350297690 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f01094b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009920 tx=0x7fd0e402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d5a4afe3096bfd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0edffb640 1 -- 10.20.193.16:0/1350297690 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e403c070 con 0x7fd0f01090b0 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0edffb640 1 -- 10.20.193.16:0/1350297690 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fd0e4037440 con 0x7fd0f01090b0 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0edffb640 1 -- 10.20.193.16:0/1350297690 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e4035340 con 0x7fd0f01090b0 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0f55c2640 1 -- 10.20.193.16:0/1350297690 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 msgr2=0x7fd0f01094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0f55c2640 1 --2- 10.20.193.16:0/1350297690 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f01094b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009920 tx=0x7fd0e402ef20 comp rx=0 tx=0).stop 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0f55c2640 1 -- 10.20.193.16:0/1350297690 shutdown_connections 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0f55c2640 1 --2- 10.20.193.16:0/1350297690 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f01094b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0f55c2640 1 -- 10.20.193.16:0/1350297690 >> 10.20.193.16:0/1350297690 conn(0x7fd0f007c530 msgr2=0x7fd0f007c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:58.396 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0f55c2640 1 -- 10.20.193.16:0/1350297690 shutdown_connections 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.258+0000 7fd0f55c2640 1 -- 10.20.193.16:0/1350297690 wait complete. 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0f55c2640 1 Processor -- start 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0f55c2640 1 -- start start 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0f55c2640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f019edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0f55c2640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f010d4e0 con 0x7fd0f01090b0 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0eeffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f019edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0eeffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f019edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44006/0 (socket says 10.20.193.16:44006) 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0eeffd640 1 -- 10.20.193.16:0/3913621113 learned_addr learned my addr 10.20.193.16:0/3913621113 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0eeffd640 1 -- 10.20.193.16:0/3913621113 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f019f330 con 0x7fd0f01090b0 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0eeffd640 1 --2- 10.20.193.16:0/3913621113 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f019edf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd0e402f4a0 tx=0x7fd0e4035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0cffff640 1 -- 10.20.193.16:0/3913621113 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e4045070 con 0x7fd0f01090b0 2026-02-17T08:21:58.397 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0cffff640 1 -- 10.20.193.16:0/3913621113 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fd0e4040450 con 0x7fd0f01090b0 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0f55c2640 1 -- 10.20.193.16:0/3913621113 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f019f5c0 con 0x7fd0f01090b0 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0cffff640 1 -- 10.20.193.16:0/3913621113 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e403c070 con 0x7fd0f01090b0 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.259+0000 7fd0f55c2640 1 -- 10.20.193.16:0/3913621113 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f01a22b0 con 0x7fd0f01090b0 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.260+0000 7fd0f55c2640 1 -- 10.20.193.16:0/3913621113 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0f0109530 con 0x7fd0f01090b0 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.260+0000 7fd0cffff640 1 -- 10.20.193.16:0/3913621113 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 5) ==== 50325+0+0 (secure 0 0 0) 0x7fd0e40493b0 con 0x7fd0f01090b0 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.260+0000 7fd0cffff640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.260+0000 7fd0cffff640 4 mgrc handle_mgr_map Got map version 5 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.260+0000 7fd0cffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.260+0000 7fd0cffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.260+0000 7fd0cffff640 1 --2- 10.20.193.16:0/3913621113 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fd0c403dd90 0x7fd0c4040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:21:58.398 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.260+0000 7fd0ee7fc640 1 -- 10.20.193.16:0/3913621113 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fd0c403dd90 msgr2=0x7fd0c4040250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.16:6800/1077302716 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.260+0000 7fd0cffff640 1 -- 10.20.193.16:0/3913621113 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd0e40768a0 con 0x7fd0f01090b0 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.260+0000 7fd0ee7fc640 1 --2- 10.20.193.16:0/3913621113 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fd0c403dd90 0x7fd0c4040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.263+0000 7fd0cffff640 1 -- 10.20.193.16:0/3913621113 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd0e403c210 con 0x7fd0f01090b0 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.367+0000 7fd0f55c2640 1 -- 10.20.193.16:0/3913621113 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd0f01a2730 con 0x7fd0f01090b0 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.367+0000 7fd0cffff640 1 -- 10.20.193.16:0/3913621113 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fd0e40762c0 con 0x7fd0f01090b0 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.368+0000 7fd0f55c2640 10 mgrc shutdown 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.368+0000 7fd0f55c2640 1 -- 10.20.193.16:0/3913621113 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fd0c403dd90 msgr2=0x7fd0c4040250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.368+0000 7fd0f55c2640 1 --2- 10.20.193.16:0/3913621113 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fd0c403dd90 0x7fd0c4040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.368+0000 7fd0f55c2640 1 -- 10.20.193.16:0/3913621113 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 msgr2=0x7fd0f019edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.368+0000 7fd0f55c2640 1 --2- 10.20.193.16:0/3913621113 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f019edf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd0e402f4a0 tx=0x7fd0e4035f80 comp rx=0 tx=0).stop 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.368+0000 7fd0f55c2640 1 -- 10.20.193.16:0/3913621113 shutdown_connections 2026-02-17T08:21:58.399 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.368+0000 7fd0f55c2640 1 --2- 10.20.193.16:0/3913621113 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7fd0c403dd90 0x7fd0c4040250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:58.400 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.368+0000 7fd0f55c2640 1 --2- 10.20.193.16:0/3913621113 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd0f01090b0 0x7fd0f019edf0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:21:58.400 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.368+0000 7fd0f55c2640 1 -- 10.20.193.16:0/3913621113 >> 10.20.193.16:0/3913621113 conn(0x7fd0f007c530 msgr2=0x7fd0f0106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:21:58.400 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.369+0000 7fd0f55c2640 1 -- 10.20.193.16:0/3913621113 shutdown_connections 2026-02-17T08:21:58.400 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.369+0000 7fd0f55c2640 1 -- 10.20.193.16:0/3913621113 wait complete. 2026-02-17T08:21:58.400 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for the mgr to restart... 2026-02-17T08:21:58.400 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mgr epoch 5... 2026-02-17T08:21:58.677 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:58.533+0000 7f664e9f4140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T08:21:58.677 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:58.676+0000 7f664e9f4140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T08:21:58.947 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:58.710+0000 7f664e9f4140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T08:21:58.947 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:58.750+0000 7f664e9f4140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T08:21:58.947 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:58.780+0000 7f664e9f4140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T08:21:58.947 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:58.814+0000 7f664e9f4140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T08:21:58.947 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:58.878+0000 7f664e9f4140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T08:21:58.947 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T08:21:58.947 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T08:21:58.947 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: from numpy import show_config as show_numpy_config 2026-02-17T08:21:59.198 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3895587395' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-17T08:21:59.199 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-mon[39048]: mgrmap e5: a(active, since 3s) 2026-02-17T08:21:59.199 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3913621113' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T08:21:59.199 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:58.949+0000 7f664e9f4140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T08:21:59.199 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:58 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:58.982+0000 7f664e9f4140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T08:21:59.199 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.076+0000 7f664e9f4140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T08:21:59.199 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.133+0000 7f664e9f4140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T08:21:59.199 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.166+0000 7f664e9f4140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T08:21:59.492 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.197+0000 7f664e9f4140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T08:21:59.492 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.230+0000 7f664e9f4140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T08:21:59.493 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.260+0000 7f664e9f4140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T08:21:59.493 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.491+0000 7f664e9f4140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T08:21:59.769 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.589+0000 7f664e9f4140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T08:21:59.769 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.618+0000 7f664e9f4140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T08:21:59.769 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.648+0000 7f664e9f4140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T08:21:59.769 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.740+0000 7f664e9f4140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T08:21:59.769 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.768+0000 7f664e9f4140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T08:22:00.119 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:21:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:21:59.858+0000 7f664e9f4140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T08:22:00.618 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:00.312+0000 7f664e9f4140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T08:22:00.619 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:00.341+0000 7f664e9f4140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T08:22:01.119 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:00.729+0000 7f664e9f4140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T08:22:01.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: Active manager daemon a restarted 2026-02-17T08:22:01.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: Activating manager daemon a 2026-02-17T08:22:01.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: osdmap e2: 0 total, 0 up, 0 in 2026-02-17T08:22:01.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: mgrmap e6: a(active, starting, since 0.00246553s) 2026-02-17T08:22:01.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T08:22:01.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T08:22:01.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T08:22:01.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T08:22:01.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T08:22:01.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: Manager daemon a is now available 2026-02-17T08:22:01.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:01.120 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:01.121 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:01.121 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:01.121 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T08:22:01.121 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:00 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T08:22:01.767 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-17T08:22:01.767 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-17T08:22:01.767 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T08:22:01.767 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-17T08:22:01.767 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.494+0000 7f1906055640 1 Processor -- start 2026-02-17T08:22:01.767 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.494+0000 7f1906055640 1 -- start start 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.494+0000 7f1906055640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190007b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.494+0000 7f1906055640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f190007b830 con 0x7f190007ce90 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.494+0000 7f18ff7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190007b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.494+0000 7f18ff7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190007b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44010/0 (socket says 10.20.193.16:44010) 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.494+0000 7f18ff7fe640 1 -- 10.20.193.16:0/3226920710 learned_addr learned my addr 10.20.193.16:0/3226920710 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.495+0000 7f18ff7fe640 1 -- 10.20.193.16:0/3226920710 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190007b9b0 con 0x7f190007ce90 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.495+0000 7f18ff7fe640 1 --2- 10.20.193.16:0/3226920710 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190007b2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009920 tx=0x7f18ec02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911fae5929625121 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.495+0000 7f18fe7fc640 1 -- 10.20.193.16:0/3226920710 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ec03c070 con 0x7f190007ce90 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.495+0000 7f18fe7fc640 1 -- 10.20.193.16:0/3226920710 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f18ec037440 con 0x7f190007ce90 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.495+0000 7f18fe7fc640 1 -- 10.20.193.16:0/3226920710 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ec035340 con 0x7f190007ce90 2026-02-17T08:22:01.768 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 -- 10.20.193.16:0/3226920710 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 msgr2=0x7f190007b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 --2- 10.20.193.16:0/3226920710 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190007b2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009920 tx=0x7f18ec02ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 -- 10.20.193.16:0/3226920710 shutdown_connections 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 --2- 10.20.193.16:0/3226920710 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190007b2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 -- 10.20.193.16:0/3226920710 >> 10.20.193.16:0/3226920710 conn(0x7f1900102600 msgr2=0x7f1900104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 -- 10.20.193.16:0/3226920710 shutdown_connections 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 -- 10.20.193.16:0/3226920710 wait complete. 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 Processor -- start 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 -- start start 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f190010d2e0 con 0x7f190007ce90 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f18ff7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:01.769 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f18ff7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190019ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44016/0 (socket says 10.20.193.16:44016) 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f18ff7fe640 1 -- 10.20.193.16:0/1096418005 learned_addr learned my addr 10.20.193.16:0/1096418005 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f18ff7fe640 1 -- 10.20.193.16:0/1096418005 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190019f340 con 0x7f190007ce90 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f18ff7fe640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190019ee00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18ec006fd0 tx=0x7f18ec035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ec045070 con 0x7f190007ce90 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f18ec040450 con 0x7f190007ce90 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ec03c070 con 0x7f190007ce90 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.496+0000 7f1906055640 1 -- 10.20.193.16:0/1096418005 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190019f5d0 con 0x7f190007ce90 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f1906055640 1 -- 10.20.193.16:0/1096418005 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19001a22c0 con 0x7f190007ce90 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f1906055640 20 mgrc start_tell_command target: cmd: [{"prefix": "get_command_descriptions"}] 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f1906055640 5 mgrc start_tell_command no mgr session (no running mgr daemon?), or not active mgr, waiting 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 5) ==== 50325+0+0 (secure 0 0 0) 0x7f18ec0493b0 con 0x7f190007ce90 2026-02-17T08:22:01.770 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18fcff9640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18fcff9640 4 mgrc handle_mgr_map Got map version 5 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18fcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18fcff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18fcff9640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 0x7f18d4040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18fcff9640 10 mgrc reconnect resending 0 (tell) 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 --> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f18d4040960 con 0x7f18d403dd90 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18feffd640 1 -- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 msgr2=0x7f18d4040250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.16:6800/1077302716 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f18ec0768a0 con 0x7f190007ce90 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.497+0000 7f18feffd640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 0x7f18d4040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.698+0000 7f18feffd640 1 -- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 msgr2=0x7f18d4040250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.16:6800/1077302716 2026-02-17T08:22:01.771 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:58.698+0000 7f18feffd640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 0x7f18d4040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:59.099+0000 7f18feffd640 1 -- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 msgr2=0x7f18d4040250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.16:6800/1077302716 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:59.099+0000 7f18feffd640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 0x7f18d4040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:59.900+0000 7f18feffd640 1 -- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 msgr2=0x7f18d4040250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.16:6800/1077302716 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:21:59.900+0000 7f18feffd640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 0x7f18d4040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:00.732+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mgrmap(e 6) ==== 50092+0+0 (secure 0 0 0) 0x7f18ec075360 con 0x7f190007ce90 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:00.732+0000 7f18fcff9640 20 mgrc handle_mgr_map mgrmap(e 6) 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:00.732+0000 7f18fcff9640 4 mgrc handle_mgr_map Got map version 6 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:00.732+0000 7f18fcff9640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:00.732+0000 7f18fcff9640 4 mgrc reconnect Terminating session with v2:10.20.193.16:6800/1077302716 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:00.732+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 msgr2=0x7f18d4040250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:00.732+0000 7f18fcff9640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 0x7f18d4040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:01.772 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:00.732+0000 7f18fcff9640 4 mgrc reconnect No active mgr available yet 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.732+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7f18ec075a60 con 0x7f190007ce90 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.732+0000 7f18fcff9640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.732+0000 7f18fcff9640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.732+0000 7f18fcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.732+0000 7f18fcff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.732+0000 7f18fcff9640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f18d40416e0 0x7f18d4043ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.732+0000 7f18fcff9640 10 mgrc reconnect resending 0 (tell) 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.732+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 --> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f18ec039ec0 con 0x7f18d40416e0 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.733+0000 7f18feffd640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f18d40416e0 0x7f18d4043ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.733+0000 7f18feffd640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f18d40416e0 0x7f18d4043ad0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f18f0003a80 tx=0x7f18f00092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.733+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 <== mgr.14118 v2:10.20.193.16:6800/2968480635 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f18ec039ec0 con 0x7f18d40416e0 2026-02-17T08:22:01.773 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.733+0000 7f18fcff9640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 20 mgrc start_tell_command target: cmd: [{"prefix": "mgr_status"}] 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 -- 10.20.193.16:0/1096418005 --> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f190007b370 con 0x7f18d40416e0 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f18fcff9640 1 -- 10.20.193.16:0/1096418005 <== mgr.14118 v2:10.20.193.16:6800/2968480635 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f190007b370 con 0x7f18d40416e0 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f18fcff9640 20 mgrc handle_command_reply tid 1 r 0 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 10 mgrc shutdown 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 -- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f18d40416e0 msgr2=0x7f18d4043ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f18d40416e0 0x7f18d4043ad0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f18f0003a80 tx=0x7f18f00092b0 comp rx=0 tx=0).stop 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 -- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 msgr2=0x7f190019ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190019ee00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18ec006fd0 tx=0x7f18ec035570 comp rx=0 tx=0).stop 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 -- 10.20.193.16:0/1096418005 shutdown_connections 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f18d40416e0 0x7f18d4043ad0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:01.774 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:6800/1077302716,v1:10.20.193.16:6801/1077302716] conn(0x7f18d403dd90 0x7f18d4040250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:01.775 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 --2- 10.20.193.16:0/1096418005 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f190007ce90 0x7f190019ee00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:01.775 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 -- 10.20.193.16:0/1096418005 >> 10.20.193.16:0/1096418005 conn(0x7f1900102600 msgr2=0x7f19001031b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:01.775 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 -- 10.20.193.16:0/1096418005 shutdown_connections 2026-02-17T08:22:01.775 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.737+0000 7f1906055640 1 -- 10.20.193.16:0/1096418005 wait complete. 2026-02-17T08:22:01.775 INFO:teuthology.orchestra.run.trial016.stdout:mgr epoch 5 is available 2026-02-17T08:22:01.775 INFO:teuthology.orchestra.run.trial016.stdout:Setting orchestrator backend to cephadm... 2026-02-17T08:22:01.986 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:01 trial016 ceph-mon[39048]: Found migration_current of "None". Setting to last migration. 2026-02-17T08:22:01.987 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:01 trial016 ceph-mon[39048]: mgrmap e7: a(active, since 1.00302s) 2026-02-17T08:22:01.999 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.857+0000 7f1a562d4640 1 Processor -- start 2026-02-17T08:22:01.999 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.857+0000 7f1a562d4640 1 -- start start 2026-02-17T08:22:01.999 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.857+0000 7f1a562d4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a50109320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.857+0000 7f1a562d4640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a50109860 con 0x7f1a50108f20 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.857+0000 7f1a552d2640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a50109320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.857+0000 7f1a552d2640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a50109320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47156/0 (socket says 10.20.193.16:47156) 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.857+0000 7f1a552d2640 1 -- 10.20.193.16:0/1309703652 learned_addr learned my addr 10.20.193.16:0/1309703652 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a552d2640 1 -- 10.20.193.16:0/1309703652 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5010a080 con 0x7f1a50108f20 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a552d2640 1 --2- 10.20.193.16:0/1309703652 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a50109320 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009920 tx=0x7f1a4002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c87230a05feefdd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a3ffff640 1 -- 10.20.193.16:0/1309703652 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a4003c070 con 0x7f1a50108f20 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a3ffff640 1 -- 10.20.193.16:0/1309703652 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f1a40037440 con 0x7f1a50108f20 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a3ffff640 1 -- 10.20.193.16:0/1309703652 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a40035340 con 0x7f1a50108f20 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a562d4640 1 -- 10.20.193.16:0/1309703652 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 msgr2=0x7f1a50109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.000 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a562d4640 1 --2- 10.20.193.16:0/1309703652 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a50109320 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009920 tx=0x7f1a4002ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a562d4640 1 -- 10.20.193.16:0/1309703652 shutdown_connections 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a562d4640 1 --2- 10.20.193.16:0/1309703652 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a50109320 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a562d4640 1 -- 10.20.193.16:0/1309703652 >> 10.20.193.16:0/1309703652 conn(0x7f1a5007c3f0 msgr2=0x7f1a5007c800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a562d4640 1 -- 10.20.193.16:0/1309703652 shutdown_connections 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.858+0000 7f1a562d4640 1 -- 10.20.193.16:0/1309703652 wait complete. 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a562d4640 1 Processor -- start 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a562d4640 1 -- start start 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a562d4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a5019ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a562d4640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5010d340 con 0x7f1a50108f20 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a552d2640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a5019ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a552d2640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a5019ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47162/0 (socket says 10.20.193.16:47162) 2026-02-17T08:22:02.001 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a552d2640 1 -- 10.20.193.16:0/3517176920 learned_addr learned my addr 10.20.193.16:0/3517176920 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a552d2640 1 -- 10.20.193.16:0/3517176920 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5019f170 con 0x7f1a50108f20 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a552d2640 1 --2- 10.20.193.16:0/3517176920 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a5019ec30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006fd0 tx=0x7f1a40035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a3e7fc640 1 -- 10.20.193.16:0/3517176920 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a40045070 con 0x7f1a50108f20 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a3e7fc640 1 -- 10.20.193.16:0/3517176920 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f1a40040450 con 0x7f1a50108f20 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a562d4640 1 -- 10.20.193.16:0/3517176920 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5019f400 con 0x7f1a50108f20 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a3e7fc640 1 -- 10.20.193.16:0/3517176920 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a4003c070 con 0x7f1a50108f20 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.859+0000 7f1a562d4640 1 -- 10.20.193.16:0/3517176920 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a501a20f0 con 0x7f1a50108f20 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.860+0000 7f1a562d4640 1 -- 10.20.193.16:0/3517176920 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a501093a0 con 0x7f1a50108f20 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.860+0000 7f1a3e7fc640 1 -- 10.20.193.16:0/3517176920 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7f1a4002fae0 con 0x7f1a50108f20 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.860+0000 7f1a3e7fc640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.860+0000 7f1a3e7fc640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T08:22:02.002 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.860+0000 7f1a3e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.860+0000 7f1a3e7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.860+0000 7f1a3e7fc640 1 --2- 10.20.193.16:0/3517176920 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f1a2c03dc70 0x7f1a2c040130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.860+0000 7f1a3e7fc640 1 -- 10.20.193.16:0/3517176920 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1a400766e0 con 0x7f1a50108f20 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.860+0000 7f1a54ad1640 1 --2- 10.20.193.16:0/3517176920 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f1a2c03dc70 0x7f1a2c040130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.860+0000 7f1a54ad1640 1 --2- 10.20.193.16:0/3517176920 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f1a2c03dc70 0x7f1a2c040130 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1a440099c0 tx=0x7f1a44006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.863+0000 7f1a3e7fc640 1 -- 10.20.193.16:0/3517176920 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1a40033200 con 0x7f1a50108f20 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.953+0000 7f1a562d4640 20 mgrc start_command cmd: [{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.953+0000 7f1a562d4640 1 -- 10.20.193.16:0/3517176920 --> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f1a50106d60 con 0x7f1a2c03dc70 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.956+0000 7f1a3e7fc640 1 -- 10.20.193.16:0/3517176920 <== mgr.14118 v2:10.20.193.16:6800/2968480635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1a50106d60 con 0x7f1a2c03dc70 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.956+0000 7f1a3e7fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:02.003 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 10 mgrc shutdown 2026-02-17T08:22:02.004 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 1 -- 10.20.193.16:0/3517176920 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f1a2c03dc70 msgr2=0x7f1a2c040130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.004 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 1 --2- 10.20.193.16:0/3517176920 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f1a2c03dc70 0x7f1a2c040130 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1a440099c0 tx=0x7f1a44006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.004 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 1 -- 10.20.193.16:0/3517176920 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 msgr2=0x7f1a5019ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.004 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 1 --2- 10.20.193.16:0/3517176920 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a5019ec30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a40006fd0 tx=0x7f1a40035f80 comp rx=0 tx=0).stop 2026-02-17T08:22:02.004 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 1 -- 10.20.193.16:0/3517176920 shutdown_connections 2026-02-17T08:22:02.004 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 1 --2- 10.20.193.16:0/3517176920 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f1a2c03dc70 0x7f1a2c040130 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.004 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 1 --2- 10.20.193.16:0/3517176920 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1a50108f20 0x7f1a5019ec30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.004 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 1 -- 10.20.193.16:0/3517176920 >> 10.20.193.16:0/3517176920 conn(0x7f1a5007c3f0 msgr2=0x7f1a50106650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:02.004 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 1 -- 10.20.193.16:0/3517176920 shutdown_connections 2026-02-17T08:22:02.004 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:01.957+0000 7f1a562d4640 1 -- 10.20.193.16:0/3517176920 wait complete. 2026-02-17T08:22:02.213 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-17T08:22:02.214 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.098+0000 7f5e291a2640 1 Processor -- start 2026-02-17T08:22:02.214 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.098+0000 7f5e291a2640 1 -- start start 2026-02-17T08:22:02.214 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.098+0000 7f5e291a2640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e241094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.214 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.098+0000 7f5e291a2640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5e24109a80 con 0x7f5e241090b0 2026-02-17T08:22:02.214 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.098+0000 7f5e22d76640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e241094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.214 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.098+0000 7f5e22d76640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e241094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47170/0 (socket says 10.20.193.16:47170) 2026-02-17T08:22:02.214 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.098+0000 7f5e22d76640 1 -- 10.20.193.16:0/2020822174 learned_addr learned my addr 10.20.193.16:0/2020822174 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.098+0000 7f5e22d76640 1 -- 10.20.193.16:0/2020822174 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2410a2b0 con 0x7f5e241090b0 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e22d76640 1 --2- 10.20.193.16:0/2020822174 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e241094b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009920 tx=0x7f5e1802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc184aa4cd76d29 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e21d74640 1 -- 10.20.193.16:0/2020822174 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e1803c070 con 0x7f5e241090b0 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e21d74640 1 -- 10.20.193.16:0/2020822174 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f5e18037440 con 0x7f5e241090b0 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e21d74640 1 -- 10.20.193.16:0/2020822174 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18035340 con 0x7f5e241090b0 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e291a2640 1 -- 10.20.193.16:0/2020822174 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 msgr2=0x7f5e241094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e291a2640 1 --2- 10.20.193.16:0/2020822174 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e241094b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009920 tx=0x7f5e1802ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e291a2640 1 -- 10.20.193.16:0/2020822174 shutdown_connections 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e291a2640 1 --2- 10.20.193.16:0/2020822174 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e241094b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e291a2640 1 -- 10.20.193.16:0/2020822174 >> 10.20.193.16:0/2020822174 conn(0x7f5e2407c530 msgr2=0x7f5e2407c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:02.215 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e291a2640 1 -- 10.20.193.16:0/2020822174 shutdown_connections 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.099+0000 7f5e291a2640 1 -- 10.20.193.16:0/2020822174 wait complete. 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e291a2640 1 Processor -- start 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e291a2640 1 -- start start 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e291a2640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e2419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e291a2640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2410d4e0 con 0x7f5e241090b0 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e22d76640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e2419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e22d76640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e2419edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47184/0 (socket says 10.20.193.16:47184) 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e22d76640 1 -- 10.20.193.16:0/1325687900 learned_addr learned my addr 10.20.193.16:0/1325687900 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e22d76640 1 -- 10.20.193.16:0/1325687900 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2419f330 con 0x7f5e241090b0 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e22d76640 1 --2- 10.20.193.16:0/1325687900 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e2419edf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e18006fd0 tx=0x7f5e18037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e03fff640 1 -- 10.20.193.16:0/1325687900 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e18045070 con 0x7f5e241090b0 2026-02-17T08:22:02.216 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e03fff640 1 -- 10.20.193.16:0/1325687900 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f5e18040450 con 0x7f5e241090b0 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e291a2640 1 -- 10.20.193.16:0/1325687900 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2419f5c0 con 0x7f5e241090b0 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e03fff640 1 -- 10.20.193.16:0/1325687900 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e1803c070 con 0x7f5e241090b0 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.100+0000 7f5e291a2640 1 -- 10.20.193.16:0/1325687900 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e241a22b0 con 0x7f5e241090b0 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.101+0000 7f5e291a2640 1 -- 10.20.193.16:0/1325687900 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e24109530 con 0x7f5e241090b0 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.101+0000 7f5e03fff640 1 -- 10.20.193.16:0/1325687900 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7f5e180493b0 con 0x7f5e241090b0 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.101+0000 7f5e03fff640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.101+0000 7f5e03fff640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.101+0000 7f5e03fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.101+0000 7f5e03fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.101+0000 7f5e03fff640 1 --2- 10.20.193.16:0/1325687900 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5df803dc20 0x7f5df80400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.101+0000 7f5e03fff640 1 -- 10.20.193.16:0/1325687900 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5e18076780 con 0x7f5e241090b0 2026-02-17T08:22:02.217 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.101+0000 7f5e22575640 1 --2- 10.20.193.16:0/1325687900 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5df803dc20 0x7f5df80400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.101+0000 7f5e22575640 1 --2- 10.20.193.16:0/1325687900 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5df803dc20 0x7f5df80400e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0099c0 tx=0x7f5e0c006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.104+0000 7f5e03fff640 1 -- 10.20.193.16:0/1325687900 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5e1803c210 con 0x7f5e241090b0 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.187+0000 7f5e291a2640 20 mgrc start_command cmd: [{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.187+0000 7f5e291a2640 1 -- 10.20.193.16:0/1325687900 --> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f5e241a2480 con 0x7f5df803dc20 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.188+0000 7f5e03fff640 1 -- 10.20.193.16:0/1325687900 <== mgr.14118 v2:10.20.193.16:6800/2968480635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f5e241a2480 con 0x7f5df803dc20 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.188+0000 7f5e03fff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 10 mgrc shutdown 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 1 -- 10.20.193.16:0/1325687900 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5df803dc20 msgr2=0x7f5df80400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 1 --2- 10.20.193.16:0/1325687900 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5df803dc20 0x7f5df80400e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0099c0 tx=0x7f5e0c006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 1 -- 10.20.193.16:0/1325687900 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 msgr2=0x7f5e2419edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 1 --2- 10.20.193.16:0/1325687900 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e2419edf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5e18006fd0 tx=0x7f5e18037b70 comp rx=0 tx=0).stop 2026-02-17T08:22:02.218 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 1 -- 10.20.193.16:0/1325687900 shutdown_connections 2026-02-17T08:22:02.219 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 1 --2- 10.20.193.16:0/1325687900 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5df803dc20 0x7f5df80400e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.219 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 1 --2- 10.20.193.16:0/1325687900 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5e241090b0 0x7f5e2419edf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.219 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 1 -- 10.20.193.16:0/1325687900 >> 10.20.193.16:0/1325687900 conn(0x7f5e2407c530 msgr2=0x7f5e241066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:02.219 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 1 -- 10.20.193.16:0/1325687900 shutdown_connections 2026-02-17T08:22:02.219 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.189+0000 7f5e291a2640 1 -- 10.20.193.16:0/1325687900 wait complete. 2026-02-17T08:22:02.219 INFO:teuthology.orchestra.run.trial016.stdout:Generating ssh key... 2026-02-17T08:22:02.444 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.302+0000 7f8c21a58640 1 Processor -- start 2026-02-17T08:22:02.444 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.302+0000 7f8c21a58640 1 -- start start 2026-02-17T08:22:02.444 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.303+0000 7f8c21a58640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c1094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.444 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.303+0000 7f8c21a58640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c109ac0 con 0x7f8c1c1090f0 2026-02-17T08:22:02.444 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.303+0000 7f8c1affd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c1094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.444 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.303+0000 7f8c1affd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c1094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47194/0 (socket says 10.20.193.16:47194) 2026-02-17T08:22:02.444 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.303+0000 7f8c1affd640 1 -- 10.20.193.16:0/2465487415 learned_addr learned my addr 10.20.193.16:0/2465487415 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.303+0000 7f8c1affd640 1 -- 10.20.193.16:0/2465487415 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c10a2f0 con 0x7f8c1c1090f0 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.303+0000 7f8c1affd640 1 --2- 10.20.193.16:0/2465487415 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c1094f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009920 tx=0x7f8c1002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b71ad55baccd51 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.303+0000 7f8c19ffb640 1 -- 10.20.193.16:0/2465487415 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c1003c070 con 0x7f8c1c1090f0 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c19ffb640 1 -- 10.20.193.16:0/2465487415 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f8c10037440 con 0x7f8c1c1090f0 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c19ffb640 1 -- 10.20.193.16:0/2465487415 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c10035340 con 0x7f8c1c1090f0 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c21a58640 1 -- 10.20.193.16:0/2465487415 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 msgr2=0x7f8c1c1094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c21a58640 1 --2- 10.20.193.16:0/2465487415 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c1094f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009920 tx=0x7f8c1002ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c21a58640 1 -- 10.20.193.16:0/2465487415 shutdown_connections 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c21a58640 1 --2- 10.20.193.16:0/2465487415 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c1094f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c21a58640 1 -- 10.20.193.16:0/2465487415 >> 10.20.193.16:0/2465487415 conn(0x7f8c1c07c610 msgr2=0x7f8c1c07ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:02.445 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c21a58640 1 -- 10.20.193.16:0/2465487415 shutdown_connections 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c21a58640 1 -- 10.20.193.16:0/2465487415 wait complete. 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c21a58640 1 Processor -- start 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.304+0000 7f8c21a58640 1 -- start start 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c21a58640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c21a58640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c10d520 con 0x7f8c1c1090f0 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c1affd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c1affd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c19ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47200/0 (socket says 10.20.193.16:47200) 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c1affd640 1 -- 10.20.193.16:0/2817624467 learned_addr learned my addr 10.20.193.16:0/2817624467 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c1affd640 1 -- 10.20.193.16:0/2817624467 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c19f3a0 con 0x7f8c1c1090f0 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c1affd640 1 --2- 10.20.193.16:0/2817624467 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c19ee60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8c1002f4a0 tx=0x7f8c10035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.446 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c20a56640 1 -- 10.20.193.16:0/2817624467 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c10045070 con 0x7f8c1c1090f0 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c20a56640 1 -- 10.20.193.16:0/2817624467 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f8c10040450 con 0x7f8c1c1090f0 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c21a58640 1 -- 10.20.193.16:0/2817624467 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c19f630 con 0x7f8c1c1090f0 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c20a56640 1 -- 10.20.193.16:0/2817624467 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c1003c070 con 0x7f8c1c1090f0 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c21a58640 1 -- 10.20.193.16:0/2817624467 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c1a2320 con 0x7f8c1c1090f0 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c21a58640 1 -- 10.20.193.16:0/2817624467 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c109570 con 0x7f8c1c1090f0 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c20a56640 1 -- 10.20.193.16:0/2817624467 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7f8c1002fae0 con 0x7f8c1c1090f0 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.305+0000 7f8c20a56640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.306+0000 7f8c20a56640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.306+0000 7f8c20a56640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.306+0000 7f8c20a56640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:02.447 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.306+0000 7f8c20a56640 1 --2- 10.20.193.16:0/2817624467 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f8bf003dc70 0x7f8bf0040130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.306+0000 7f8c20a56640 1 -- 10.20.193.16:0/2817624467 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8c100766f0 con 0x7f8c1c1090f0 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.306+0000 7f8c1a7fc640 1 --2- 10.20.193.16:0/2817624467 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f8bf003dc70 0x7f8bf0040130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.306+0000 7f8c1a7fc640 1 --2- 10.20.193.16:0/2817624467 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f8bf003dc70 0x7f8bf0040130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c040099c0 tx=0x7f8c04006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.308+0000 7f8c20a56640 1 -- 10.20.193.16:0/2817624467 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8c100363a0 con 0x7f8c1c1090f0 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.394+0000 7f8c21a58640 20 mgrc start_command cmd: [{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.394+0000 7f8c21a58640 1 -- 10.20.193.16:0/2817624467 --> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f8c1c1a24f0 con 0x7f8bf003dc70 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.416+0000 7f8c20a56640 1 -- 10.20.193.16:0/2817624467 <== mgr.14118 v2:10.20.193.16:6800/2968480635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8c1c1a24f0 con 0x7f8bf003dc70 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.416+0000 7f8c20a56640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 10 mgrc shutdown 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 1 -- 10.20.193.16:0/2817624467 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f8bf003dc70 msgr2=0x7f8bf0040130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.448 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 1 --2- 10.20.193.16:0/2817624467 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f8bf003dc70 0x7f8bf0040130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c040099c0 tx=0x7f8c04006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.449 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 1 -- 10.20.193.16:0/2817624467 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 msgr2=0x7f8c1c19ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.449 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 1 --2- 10.20.193.16:0/2817624467 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c19ee60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8c1002f4a0 tx=0x7f8c10035f80 comp rx=0 tx=0).stop 2026-02-17T08:22:02.449 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 1 -- 10.20.193.16:0/2817624467 shutdown_connections 2026-02-17T08:22:02.449 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 1 --2- 10.20.193.16:0/2817624467 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f8bf003dc70 0x7f8bf0040130 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.449 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 1 --2- 10.20.193.16:0/2817624467 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f8c1c1090f0 0x7f8c1c19ee60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.449 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 1 -- 10.20.193.16:0/2817624467 >> 10.20.193.16:0/2817624467 conn(0x7f8c1c07c610 msgr2=0x7f8c1c106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:02.449 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 1 -- 10.20.193.16:0/2817624467 shutdown_connections 2026-02-17T08:22:02.449 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.417+0000 7f8c21a58640 1 -- 10.20.193.16:0/2817624467 wait complete. 2026-02-17T08:22:02.534 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: Generating public/private ed25519 key pair. 2026-02-17T08:22:02.535 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: Your identification has been saved in /tmp/tmpd4skhi8p/key 2026-02-17T08:22:02.535 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: Your public key has been saved in /tmp/tmpd4skhi8p/key.pub 2026-02-17T08:22:02.535 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: The key fingerprint is: 2026-02-17T08:22:02.535 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: SHA256:mHfIqqz3N65Vr+2GAFc2pJ1hI0ds6gkZtk7BT1FBQgs ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:22:02.535 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: The key's randomart image is: 2026-02-17T08:22:02.535 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: +--[ED25519 256]--+ 2026-02-17T08:22:02.535 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: | .E.=B@. | 2026-02-17T08:22:02.535 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: | =..O*+ | 2026-02-17T08:22:02.536 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: | . Bo=o. | 2026-02-17T08:22:02.536 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: | *++. | 2026-02-17T08:22:02.536 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: | oo=S.o | 2026-02-17T08:22:02.536 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: | .o+o . | 2026-02-17T08:22:02.536 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: | . .. .. | 2026-02-17T08:22:02.536 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: | ... .o .o. | 2026-02-17T08:22:02.536 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: | .oo.o+...oo | 2026-02-17T08:22:02.536 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: +----[SHA256]-----+ 2026-02-17T08:22:02.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDgWLXMMF4p4fE606xR/QNzosspLK/er0VlcIpG1PqKE ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:22:02.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.533+0000 7fd1e70be640 1 Processor -- start 2026-02-17T08:22:02.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.533+0000 7fd1e70be640 1 -- start start 2026-02-17T08:22:02.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.533+0000 7fd1e70be640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e01094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.533+0000 7fd1e70be640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e0109ac0 con 0x7fd1e01090f0 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.533+0000 7fd1e4e33640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e01094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.533+0000 7fd1e4e33640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e01094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47204/0 (socket says 10.20.193.16:47204) 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.533+0000 7fd1e4e33640 1 -- 10.20.193.16:0/1569122814 learned_addr learned my addr 10.20.193.16:0/1569122814 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1e4e33640 1 -- 10.20.193.16:0/1569122814 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e010a2f0 con 0x7fd1e01090f0 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1e4e33640 1 --2- 10.20.193.16:0/1569122814 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e01094f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009920 tx=0x7fd1d002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb7b86246777b1f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1d77fe640 1 -- 10.20.193.16:0/1569122814 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d003c070 con 0x7fd1e01090f0 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1d77fe640 1 -- 10.20.193.16:0/1569122814 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fd1d0037440 con 0x7fd1e01090f0 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1d77fe640 1 -- 10.20.193.16:0/1569122814 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d0035340 con 0x7fd1e01090f0 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1e70be640 1 -- 10.20.193.16:0/1569122814 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 msgr2=0x7fd1e01094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1e70be640 1 --2- 10.20.193.16:0/1569122814 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e01094f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009920 tx=0x7fd1d002ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:02.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1e70be640 1 -- 10.20.193.16:0/1569122814 shutdown_connections 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1e70be640 1 --2- 10.20.193.16:0/1569122814 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e01094f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1e70be640 1 -- 10.20.193.16:0/1569122814 >> 10.20.193.16:0/1569122814 conn(0x7fd1e007c610 msgr2=0x7fd1e007ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1e70be640 1 -- 10.20.193.16:0/1569122814 shutdown_connections 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.534+0000 7fd1e70be640 1 -- 10.20.193.16:0/1569122814 wait complete. 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e70be640 1 Processor -- start 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e70be640 1 -- start start 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e70be640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e70be640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e010d520 con 0x7fd1e01090f0 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e4e33640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e4e33640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47212/0 (socket says 10.20.193.16:47212) 2026-02-17T08:22:02.652 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e4e33640 1 -- 10.20.193.16:0/3464273393 learned_addr learned my addr 10.20.193.16:0/3464273393 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e4e33640 1 -- 10.20.193.16:0/3464273393 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e019f3a0 con 0x7fd1e01090f0 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e4e33640 1 --2- 10.20.193.16:0/3464273393 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e019ee60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0006fd0 tx=0x7fd1d0035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1d5ffb640 1 -- 10.20.193.16:0/3464273393 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d0045070 con 0x7fd1e01090f0 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1d5ffb640 1 -- 10.20.193.16:0/3464273393 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fd1d0040450 con 0x7fd1e01090f0 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e70be640 1 -- 10.20.193.16:0/3464273393 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e019f630 con 0x7fd1e01090f0 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1d5ffb640 1 -- 10.20.193.16:0/3464273393 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1d003c070 con 0x7fd1e01090f0 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.535+0000 7fd1e70be640 1 -- 10.20.193.16:0/3464273393 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e01a2320 con 0x7fd1e01090f0 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.536+0000 7fd1e70be640 1 -- 10.20.193.16:0/3464273393 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e0109570 con 0x7fd1e01090f0 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.536+0000 7fd1d5ffb640 1 -- 10.20.193.16:0/3464273393 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7fd1d00493b0 con 0x7fd1e01090f0 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.536+0000 7fd1d5ffb640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.536+0000 7fd1d5ffb640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T08:22:02.653 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.536+0000 7fd1d5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.536+0000 7fd1d5ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.536+0000 7fd1d5ffb640 1 --2- 10.20.193.16:0/3464273393 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fd1bc03dc10 0x7fd1bc0400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.536+0000 7fd1d5ffb640 1 -- 10.20.193.16:0/3464273393 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd1d00767f0 con 0x7fd1e01090f0 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.536+0000 7fd1d7fff640 1 --2- 10.20.193.16:0/3464273393 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fd1bc03dc10 0x7fd1bc0400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.536+0000 7fd1d7fff640 1 --2- 10.20.193.16:0/3464273393 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fd1bc03dc10 0x7fd1bc0400d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80099c0 tx=0x7fd1c8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.539+0000 7fd1d5ffb640 1 -- 10.20.193.16:0/3464273393 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd1d0049c90 con 0x7fd1e01090f0 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.623+0000 7fd1e70be640 20 mgrc start_command cmd: [{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.623+0000 7fd1e70be640 1 -- 10.20.193.16:0/3464273393 --> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fd1e0106da0 con 0x7fd1bc03dc10 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.624+0000 7fd1d5ffb640 1 -- 10.20.193.16:0/3464273393 <== mgr.14118 v2:10.20.193.16:6800/2968480635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+123 (secure 0 0 0) 0x7fd1e0106da0 con 0x7fd1bc03dc10 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.624+0000 7fd1d5ffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 10 mgrc shutdown 2026-02-17T08:22:02.654 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 1 -- 10.20.193.16:0/3464273393 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fd1bc03dc10 msgr2=0x7fd1bc0400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 1 --2- 10.20.193.16:0/3464273393 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fd1bc03dc10 0x7fd1bc0400d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80099c0 tx=0x7fd1c8006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 1 -- 10.20.193.16:0/3464273393 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 msgr2=0x7fd1e019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 1 --2- 10.20.193.16:0/3464273393 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e019ee60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0006fd0 tx=0x7fd1d0035570 comp rx=0 tx=0).stop 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 1 -- 10.20.193.16:0/3464273393 shutdown_connections 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 1 --2- 10.20.193.16:0/3464273393 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fd1bc03dc10 0x7fd1bc0400d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 1 --2- 10.20.193.16:0/3464273393 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd1e01090f0 0x7fd1e019ee60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 1 -- 10.20.193.16:0/3464273393 >> 10.20.193.16:0/3464273393 conn(0x7fd1e007c610 msgr2=0x7fd1e0106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 1 -- 10.20.193.16:0/3464273393 shutdown_connections 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.625+0000 7fd1e70be640 1 -- 10.20.193.16:0/3464273393 wait complete. 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:Adding key to root@localhost authorized_keys... 2026-02-17T08:22:02.655 INFO:teuthology.orchestra.run.trial016.stdout:Adding host trial016... 2026-02-17T08:22:03.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-mon[39048]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T08:22:03.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-mon[39048]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T08:22:03.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:03.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:03.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-mon[39048]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:03.067 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:03.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:03.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:03.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:03.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:02 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:04.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:04.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:04.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: Generating ssh key... 2026-02-17T08:22:04.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: [17/Feb/2026:08:22:02] ENGINE Bus STARTING 2026-02-17T08:22:04.068 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: [17/Feb/2026:08:22:02] ENGINE Serving on https://10.20.193.16:7150 2026-02-17T08:22:04.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: [17/Feb/2026:08:22:02] ENGINE Client ('10.20.193.16', 33216) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T08:22:04.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: [17/Feb/2026:08:22:02] ENGINE Serving on http://10.20.193.16:8765 2026-02-17T08:22:04.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: [17/Feb/2026:08:22:02] ENGINE Bus STARTED 2026-02-17T08:22:04.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:04.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial016", "addr": "10.20.193.16", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:04.069 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:03 trial016 ceph-mon[39048]: mgrmap e8: a(active, since 2s) 2026-02-17T08:22:04.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout Added host 'trial016' with addr '10.20.193.16' 2026-02-17T08:22:04.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.737+0000 7f6875858640 1 Processor -- start 2026-02-17T08:22:04.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.737+0000 7f6875858640 1 -- start start 2026-02-17T08:22:04.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.737+0000 7f6875858640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f68701094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:04.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.737+0000 7f6875858640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6870109ac0 con 0x7f68701090f0 2026-02-17T08:22:04.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.737+0000 7f686effd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f68701094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:04.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.737+0000 7f686effd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f68701094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47220/0 (socket says 10.20.193.16:47220) 2026-02-17T08:22:04.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.737+0000 7f686effd640 1 -- 10.20.193.16:0/4163349523 learned_addr learned my addr 10.20.193.16:0/4163349523 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.737+0000 7f686effd640 1 -- 10.20.193.16:0/4163349523 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687010a2f0 con 0x7f68701090f0 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f686effd640 1 --2- 10.20.193.16:0/4163349523 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f68701094f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6864009920 tx=0x7f686402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbecbf8ff878dd94 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f686dffb640 1 -- 10.20.193.16:0/4163349523 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f686403c070 con 0x7f68701090f0 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f686dffb640 1 -- 10.20.193.16:0/4163349523 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f6864037440 con 0x7f68701090f0 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f686dffb640 1 -- 10.20.193.16:0/4163349523 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6864035340 con 0x7f68701090f0 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f6875858640 1 -- 10.20.193.16:0/4163349523 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 msgr2=0x7f68701094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f6875858640 1 --2- 10.20.193.16:0/4163349523 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f68701094f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6864009920 tx=0x7f686402ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f6875858640 1 -- 10.20.193.16:0/4163349523 shutdown_connections 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f6875858640 1 --2- 10.20.193.16:0/4163349523 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f68701094f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f6875858640 1 -- 10.20.193.16:0/4163349523 >> 10.20.193.16:0/4163349523 conn(0x7f687007c610 msgr2=0x7f687007ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f6875858640 1 -- 10.20.193.16:0/4163349523 shutdown_connections 2026-02-17T08:22:04.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f6875858640 1 -- 10.20.193.16:0/4163349523 wait complete. 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f6875858640 1 Processor -- start 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.738+0000 7f6875858640 1 -- start start 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f6875858640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f687019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f6875858640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f687010d520 con 0x7f68701090f0 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f686effd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f687019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f686effd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f687019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47236/0 (socket says 10.20.193.16:47236) 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f686effd640 1 -- 10.20.193.16:0/3157095032 learned_addr learned my addr 10.20.193.16:0/3157095032 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f686effd640 1 -- 10.20.193.16:0/3157095032 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687019f3a0 con 0x7f68701090f0 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f686effd640 1 --2- 10.20.193.16:0/3157095032 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f687019ee60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f686402f4a0 tx=0x7f6864035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f6874856640 1 -- 10.20.193.16:0/3157095032 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6864045070 con 0x7f68701090f0 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f6874856640 1 -- 10.20.193.16:0/3157095032 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f6864040450 con 0x7f68701090f0 2026-02-17T08:22:04.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f6874856640 1 -- 10.20.193.16:0/3157095032 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f686403c070 con 0x7f68701090f0 2026-02-17T08:22:04.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f6875858640 1 -- 10.20.193.16:0/3157095032 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687019f630 con 0x7f68701090f0 2026-02-17T08:22:04.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.739+0000 7f6875858640 1 -- 10.20.193.16:0/3157095032 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68701a2320 con 0x7f68701090f0 2026-02-17T08:22:04.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.740+0000 7f6875858640 1 -- 10.20.193.16:0/3157095032 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6870109570 con 0x7f68701090f0 2026-02-17T08:22:04.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.740+0000 7f6874856640 1 -- 10.20.193.16:0/3157095032 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 7) ==== 50219+0+0 (secure 0 0 0) 0x7f686402fae0 con 0x7f68701090f0 2026-02-17T08:22:04.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.740+0000 7f6874856640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T08:22:04.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.740+0000 7f6874856640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T08:22:04.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.740+0000 7f6874856640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:04.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.740+0000 7f6874856640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:04.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.740+0000 7f6874856640 1 --2- 10.20.193.16:0/3157095032 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f684403dc70 0x7f6844040130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.740+0000 7f6874856640 1 -- 10.20.193.16:0/3157095032 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f68640766b0 con 0x7f68701090f0 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.740+0000 7f686e7fc640 1 --2- 10.20.193.16:0/3157095032 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f684403dc70 0x7f6844040130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.740+0000 7f686e7fc640 1 --2- 10.20.193.16:0/3157095032 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f684403dc70 0x7f6844040130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f68580099c0 tx=0x7f6858006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.742+0000 7f6874856640 1 -- 10.20.193.16:0/3157095032 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f68640363a0 con 0x7f68701090f0 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.827+0000 7f6875858640 20 mgrc start_command cmd: [{"prefix": "orch host add", "hostname": "trial016", "addr": "10.20.193.16", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:02.827+0000 7f6875858640 1 -- 10.20.193.16:0/3157095032 --> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial016", "addr": "10.20.193.16", "target": ["mon-mgr", ""]}) -- 0x7f68701a24f0 con 0x7f684403dc70 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:03.417+0000 7f6874856640 1 -- 10.20.193.16:0/3157095032 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7f6864036cc0 con 0x7f68701090f0 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:03.417+0000 7f6874856640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:03.417+0000 7f6874856640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:03.417+0000 7f6874856640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:04.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.270+0000 7f6874856640 1 -- 10.20.193.16:0/3157095032 <== mgr.14118 v2:10.20.193.16:6800/2968480635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f68701a24f0 con 0x7f684403dc70 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.270+0000 7f6874856640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 10 mgrc shutdown 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 1 -- 10.20.193.16:0/3157095032 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f684403dc70 msgr2=0x7f6844040130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 1 --2- 10.20.193.16:0/3157095032 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f684403dc70 0x7f6844040130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f68580099c0 tx=0x7f6858006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 1 -- 10.20.193.16:0/3157095032 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 msgr2=0x7f687019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 1 --2- 10.20.193.16:0/3157095032 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f687019ee60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f686402f4a0 tx=0x7f6864035f80 comp rx=0 tx=0).stop 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 1 -- 10.20.193.16:0/3157095032 shutdown_connections 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 1 --2- 10.20.193.16:0/3157095032 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f684403dc70 0x7f6844040130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 1 --2- 10.20.193.16:0/3157095032 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f68701090f0 0x7f687019ee60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 1 -- 10.20.193.16:0/3157095032 >> 10.20.193.16:0/3157095032 conn(0x7f687007c610 msgr2=0x7f6870106690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 1 -- 10.20.193.16:0/3157095032 shutdown_connections 2026-02-17T08:22:04.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.273+0000 7f6875858640 1 -- 10.20.193.16:0/3157095032 wait complete. 2026-02-17T08:22:04.325 INFO:teuthology.orchestra.run.trial016.stdout:Deploying unmanaged mon service... 2026-02-17T08:22:04.554 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-17T08:22:04.554 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.420+0000 7ff470faf640 1 Processor -- start 2026-02-17T08:22:04.554 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.420+0000 7ff470faf640 1 -- start start 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.420+0000 7ff470faf640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c1094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.420+0000 7ff470faf640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c109aa0 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.420+0000 7ff46a575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c1094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.420+0000 7ff46a575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c1094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47246/0 (socket says 10.20.193.16:47246) 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.420+0000 7ff46a575640 1 -- 10.20.193.16:0/2534620470 learned_addr learned my addr 10.20.193.16:0/2534620470 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.420+0000 7ff46a575640 1 -- 10.20.193.16:0/2534620470 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c10a2d0 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.421+0000 7ff46a575640 1 --2- 10.20.193.16:0/2534620470 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c1094d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff460009920 tx=0x7ff46002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5819cf30af21d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.421+0000 7ff469573640 1 -- 10.20.193.16:0/2534620470 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff46003c070 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.421+0000 7ff469573640 1 -- 10.20.193.16:0/2534620470 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7ff460037440 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.421+0000 7ff469573640 1 -- 10.20.193.16:0/2534620470 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff460035340 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.421+0000 7ff470faf640 1 -- 10.20.193.16:0/2534620470 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 msgr2=0x7ff46c1094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.421+0000 7ff470faf640 1 --2- 10.20.193.16:0/2534620470 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c1094d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff460009920 tx=0x7ff46002ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.421+0000 7ff470faf640 1 -- 10.20.193.16:0/2534620470 shutdown_connections 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff470faf640 1 --2- 10.20.193.16:0/2534620470 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c1094d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff470faf640 1 -- 10.20.193.16:0/2534620470 >> 10.20.193.16:0/2534620470 conn(0x7ff46c07c550 msgr2=0x7ff46c07c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff470faf640 1 -- 10.20.193.16:0/2534620470 shutdown_connections 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff470faf640 1 -- 10.20.193.16:0/2534620470 wait complete. 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff470faf640 1 Processor -- start 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff470faf640 1 -- start start 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff470faf640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c19ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff470faf640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c10d500 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff46a575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c19ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff46a575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c19ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47262/0 (socket says 10.20.193.16:47262) 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff46a575640 1 -- 10.20.193.16:0/3647984973 learned_addr learned my addr 10.20.193.16:0/3647984973 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff46a575640 1 -- 10.20.193.16:0/3647984973 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c19f350 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff46a575640 1 --2- 10.20.193.16:0/3647984973 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c19ee10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff460006fd0 tx=0x7ff460037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.422+0000 7ff4537fe640 1 -- 10.20.193.16:0/3647984973 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff460045070 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff4537fe640 1 -- 10.20.193.16:0/3647984973 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7ff460040450 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff4537fe640 1 -- 10.20.193.16:0/3647984973 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff46003c070 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff470faf640 1 -- 10.20.193.16:0/3647984973 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46c19f5e0 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff470faf640 1 -- 10.20.193.16:0/3647984973 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46c1a22d0 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff470faf640 1 -- 10.20.193.16:0/3647984973 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff46c109550 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff4537fe640 1 -- 10.20.193.16:0/3647984973 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7ff4600493b0 con 0x7ff46c1090d0 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff4537fe640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T08:22:04.555 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff4537fe640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff4537fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff4537fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff4537fe640 1 --2- 10.20.193.16:0/3647984973 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7ff44403dd40 0x7ff444040200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff4537fe640 1 -- 10.20.193.16:0/3647984973 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff460076930 con 0x7ff46c1090d0 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.423+0000 7ff469d74640 1 --2- 10.20.193.16:0/3647984973 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7ff44403dd40 0x7ff444040200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.424+0000 7ff469d74640 1 --2- 10.20.193.16:0/3647984973 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7ff44403dd40 0x7ff444040200 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff4540099c0 tx=0x7ff454006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.426+0000 7ff4537fe640 1 -- 10.20.193.16:0/3647984973 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff46003c210 con 0x7ff46c1090d0 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.513+0000 7ff470faf640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}] 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.513+0000 7ff470faf640 1 -- 10.20.193.16:0/3647984973 --> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff46c106d60 con 0x7ff44403dd40 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.517+0000 7ff4537fe640 1 -- 10.20.193.16:0/3647984973 <== mgr.14118 v2:10.20.193.16:6800/2968480635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff46c106d60 con 0x7ff44403dd40 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.517+0000 7ff4537fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.517+0000 7ff470faf640 10 mgrc shutdown 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.517+0000 7ff470faf640 1 -- 10.20.193.16:0/3647984973 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7ff44403dd40 msgr2=0x7ff444040200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.517+0000 7ff470faf640 1 --2- 10.20.193.16:0/3647984973 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7ff44403dd40 0x7ff444040200 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff4540099c0 tx=0x7ff454006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.518+0000 7ff470faf640 1 -- 10.20.193.16:0/3647984973 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 msgr2=0x7ff46c19ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.518+0000 7ff470faf640 1 --2- 10.20.193.16:0/3647984973 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c19ee10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff460006fd0 tx=0x7ff460037b70 comp rx=0 tx=0).stop 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.518+0000 7ff470faf640 1 -- 10.20.193.16:0/3647984973 shutdown_connections 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.518+0000 7ff470faf640 1 --2- 10.20.193.16:0/3647984973 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7ff44403dd40 0x7ff444040200 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.518+0000 7ff470faf640 1 --2- 10.20.193.16:0/3647984973 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff46c1090d0 0x7ff46c19ee10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.518+0000 7ff470faf640 1 -- 10.20.193.16:0/3647984973 >> 10.20.193.16:0/3647984973 conn(0x7ff46c07c550 msgr2=0x7ff46c106650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.518+0000 7ff470faf640 1 -- 10.20.193.16:0/3647984973 shutdown_connections 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.518+0000 7ff470faf640 1 -- 10.20.193.16:0/3647984973 wait complete. 2026-02-17T08:22:04.556 INFO:teuthology.orchestra.run.trial016.stdout:Deploying unmanaged mgr service... 2026-02-17T08:22:04.852 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:04 trial016 ceph-mon[39048]: Deploying cephadm binary to trial016 2026-02-17T08:22:04.853 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:04 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:04.853 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:04 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:04.853 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:04 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:04.853 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:04 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:04.873 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-17T08:22:04.874 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.649+0000 7fb942c23640 1 Processor -- start 2026-02-17T08:22:04.874 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.649+0000 7fb942c23640 1 -- start start 2026-02-17T08:22:04.874 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.649+0000 7fb942c23640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c107270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:04.874 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.650+0000 7fb942c23640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c1077b0 con 0x7fb93c106e70 2026-02-17T08:22:04.874 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.650+0000 7fb940998640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:04.874 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.650+0000 7fb940998640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47274/0 (socket says 10.20.193.16:47274) 2026-02-17T08:22:04.874 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.650+0000 7fb940998640 1 -- 10.20.193.16:0/124054696 learned_addr learned my addr 10.20.193.16:0/124054696 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:04.874 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.650+0000 7fb940998640 1 -- 10.20.193.16:0/124054696 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c107fd0 con 0x7fb93c106e70 2026-02-17T08:22:04.874 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.650+0000 7fb940998640 1 --2- 10.20.193.16:0/124054696 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c107270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009920 tx=0x7fb92c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cfebf541d9285d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.650+0000 7fb9337fe640 1 -- 10.20.193.16:0/124054696 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb92c03c070 con 0x7fb93c106e70 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.650+0000 7fb9337fe640 1 -- 10.20.193.16:0/124054696 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fb92c037440 con 0x7fb93c106e70 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.650+0000 7fb9337fe640 1 -- 10.20.193.16:0/124054696 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb92c035340 con 0x7fb93c106e70 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 -- 10.20.193.16:0/124054696 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 msgr2=0x7fb93c107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 --2- 10.20.193.16:0/124054696 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c107270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009920 tx=0x7fb92c02ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 -- 10.20.193.16:0/124054696 shutdown_connections 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 --2- 10.20.193.16:0/124054696 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c107270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 -- 10.20.193.16:0/124054696 >> 10.20.193.16:0/124054696 conn(0x7fb93c1025e0 msgr2=0x7fb93c104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 -- 10.20.193.16:0/124054696 shutdown_connections 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 -- 10.20.193.16:0/124054696 wait complete. 2026-02-17T08:22:04.875 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 Processor -- start 2026-02-17T08:22:04.876 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 -- start start 2026-02-17T08:22:04.876 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c07cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:04.876 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb942c23640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c10b290 con 0x7fb93c106e70 2026-02-17T08:22:04.876 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb940998640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c07cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:04.876 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb940998640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c07cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47276/0 (socket says 10.20.193.16:47276) 2026-02-17T08:22:04.876 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb940998640 1 -- 10.20.193.16:0/1590080646 learned_addr learned my addr 10.20.193.16:0/1590080646 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:04.876 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.651+0000 7fb940998640 1 -- 10.20.193.16:0/1590080646 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c07d0c0 con 0x7fb93c106e70 2026-02-17T08:22:04.876 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.652+0000 7fb940998640 1 --2- 10.20.193.16:0/1590080646 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c07cb80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb92c006fd0 tx=0x7fb92c035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:04.876 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.652+0000 7fb931ffb640 1 -- 10.20.193.16:0/1590080646 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb92c045070 con 0x7fb93c106e70 2026-02-17T08:22:04.876 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.652+0000 7fb931ffb640 1 -- 10.20.193.16:0/1590080646 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fb92c040450 con 0x7fb93c106e70 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.652+0000 7fb931ffb640 1 -- 10.20.193.16:0/1590080646 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb92c03c070 con 0x7fb93c106e70 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.652+0000 7fb942c23640 1 -- 10.20.193.16:0/1590080646 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93c07b2b0 con 0x7fb93c106e70 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.652+0000 7fb942c23640 1 -- 10.20.193.16:0/1590080646 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93c07b790 con 0x7fb93c106e70 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.652+0000 7fb942c23640 1 -- 10.20.193.16:0/1590080646 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb93c1072f0 con 0x7fb93c106e70 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.652+0000 7fb931ffb640 1 -- 10.20.193.16:0/1590080646 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7fb92c02fae0 con 0x7fb93c106e70 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.652+0000 7fb931ffb640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.653+0000 7fb931ffb640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.653+0000 7fb931ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.653+0000 7fb931ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.653+0000 7fb931ffb640 1 --2- 10.20.193.16:0/1590080646 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fb91803dd90 0x7fb918040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.653+0000 7fb931ffb640 1 -- 10.20.193.16:0/1590080646 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb92c076840 con 0x7fb93c106e70 2026-02-17T08:22:04.877 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.653+0000 7fb933fff640 1 --2- 10.20.193.16:0/1590080646 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fb91803dd90 0x7fb918040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.653+0000 7fb933fff640 1 --2- 10.20.193.16:0/1590080646 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fb91803dd90 0x7fb918040250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb9240099c0 tx=0x7fb924006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.655+0000 7fb931ffb640 1 -- 10.20.193.16:0/1590080646 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb92c033200 con 0x7fb93c106e70 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.746+0000 7fb942c23640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}] 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.746+0000 7fb942c23640 1 -- 10.20.193.16:0/1590080646 --> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fb93c07be00 con 0x7fb91803dd90 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.749+0000 7fb931ffb640 1 -- 10.20.193.16:0/1590080646 <== mgr.14118 v2:10.20.193.16:6800/2968480635 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb93c07be00 con 0x7fb91803dd90 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.749+0000 7fb931ffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 10 mgrc shutdown 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 1 -- 10.20.193.16:0/1590080646 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fb91803dd90 msgr2=0x7fb918040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 1 --2- 10.20.193.16:0/1590080646 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fb91803dd90 0x7fb918040250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb9240099c0 tx=0x7fb924006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 1 -- 10.20.193.16:0/1590080646 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 msgr2=0x7fb93c07cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:04.878 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 1 --2- 10.20.193.16:0/1590080646 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c07cb80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb92c006fd0 tx=0x7fb92c035f80 comp rx=0 tx=0).stop 2026-02-17T08:22:04.879 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 1 -- 10.20.193.16:0/1590080646 shutdown_connections 2026-02-17T08:22:04.879 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 1 --2- 10.20.193.16:0/1590080646 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fb91803dd90 0x7fb918040250 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.879 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 1 --2- 10.20.193.16:0/1590080646 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb93c106e70 0x7fb93c07cb80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:04.879 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 1 -- 10.20.193.16:0/1590080646 >> 10.20.193.16:0/1590080646 conn(0x7fb93c1025e0 msgr2=0x7fb93c103100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:04.879 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 1 -- 10.20.193.16:0/1590080646 shutdown_connections 2026-02-17T08:22:04.879 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.751+0000 7fb942c23640 1 -- 10.20.193.16:0/1590080646 wait complete. 2026-02-17T08:22:05.095 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.971+0000 7f4640954640 1 Processor -- start 2026-02-17T08:22:05.095 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.971+0000 7f4640954640 1 -- start start 2026-02-17T08:22:05.095 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.971+0000 7f4640954640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:05.095 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.971+0000 7f4640954640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f463807b830 con 0x7f463807ce90 2026-02-17T08:22:05.095 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.971+0000 7f463e6c9640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:05.095 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.971+0000 7f463e6c9640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463807b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47284/0 (socket says 10.20.193.16:47284) 2026-02-17T08:22:05.095 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.971+0000 7f463e6c9640 1 -- 10.20.193.16:0/3627777815 learned_addr learned my addr 10.20.193.16:0/3627777815 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:05.096 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.971+0000 7f463e6c9640 1 -- 10.20.193.16:0/3627777815 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463807b9b0 con 0x7f463807ce90 2026-02-17T08:22:05.096 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f463e6c9640 1 --2- 10.20.193.16:0/3627777815 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463807b2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4630009920 tx=0x7f463002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24147a4a687fdfb2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:05.096 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f463d6c7640 1 -- 10.20.193.16:0/3627777815 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f463003c070 con 0x7f463807ce90 2026-02-17T08:22:05.096 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f463d6c7640 1 -- 10.20.193.16:0/3627777815 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f4630037440 con 0x7f463807ce90 2026-02-17T08:22:05.096 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f463d6c7640 1 -- 10.20.193.16:0/3627777815 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46300354d0 con 0x7f463807ce90 2026-02-17T08:22:05.096 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f4640954640 1 -- 10.20.193.16:0/3627777815 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 msgr2=0x7f463807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:05.096 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f4640954640 1 --2- 10.20.193.16:0/3627777815 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463807b2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4630009920 tx=0x7f463002ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:05.096 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f4640954640 1 -- 10.20.193.16:0/3627777815 shutdown_connections 2026-02-17T08:22:05.096 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f4640954640 1 --2- 10.20.193.16:0/3627777815 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463807b2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f4640954640 1 -- 10.20.193.16:0/3627777815 >> 10.20.193.16:0/3627777815 conn(0x7f46381025a0 msgr2=0x7f4638104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f4640954640 1 -- 10.20.193.16:0/3627777815 shutdown_connections 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.972+0000 7f4640954640 1 -- 10.20.193.16:0/3627777815 wait complete. 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f4640954640 1 Processor -- start 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f4640954640 1 -- start start 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f4640954640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463819ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f4640954640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f463810d270 con 0x7f463807ce90 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f463e6c9640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463819ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f463e6c9640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463819ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47288/0 (socket says 10.20.193.16:47288) 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f463e6c9640 1 -- 10.20.193.16:0/3051550252 learned_addr learned my addr 10.20.193.16:0/3051550252 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f463e6c9640 1 -- 10.20.193.16:0/3051550252 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463819f340 con 0x7f463807ce90 2026-02-17T08:22:05.097 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f463e6c9640 1 --2- 10.20.193.16:0/3051550252 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463819ee00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4630002410 tx=0x7f463002fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f46237fe640 1 -- 10.20.193.16:0/3051550252 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4630047070 con 0x7f463807ce90 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f46237fe640 1 -- 10.20.193.16:0/3051550252 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f4630042440 con 0x7f463807ce90 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f4640954640 1 -- 10.20.193.16:0/3051550252 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f463819f5d0 con 0x7f463807ce90 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f46237fe640 1 -- 10.20.193.16:0/3051550252 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f463003c070 con 0x7f463807ce90 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.973+0000 7f4640954640 1 -- 10.20.193.16:0/3051550252 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46381a22c0 con 0x7f463807ce90 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.974+0000 7f4640954640 1 -- 10.20.193.16:0/3051550252 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f463807b370 con 0x7f463807ce90 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.974+0000 7f46237fe640 1 -- 10.20.193.16:0/3051550252 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7f4630035b10 con 0x7f463807ce90 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.974+0000 7f46237fe640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.974+0000 7f46237fe640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.974+0000 7f46237fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.974+0000 7f46237fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:05.098 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.974+0000 7f46237fe640 1 --2- 10.20.193.16:0/3051550252 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f461403dd90 0x7f4614040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:05.099 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.974+0000 7f46237fe640 1 -- 10.20.193.16:0/3051550252 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4630076a80 con 0x7f463807ce90 2026-02-17T08:22:05.099 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.974+0000 7f463dec8640 1 --2- 10.20.193.16:0/3051550252 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f461403dd90 0x7f4614040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:05.099 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.974+0000 7f463dec8640 1 --2- 10.20.193.16:0/3051550252 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f461403dd90 0x7f4614040250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f46240099c0 tx=0x7f4624006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:05.099 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:04.976+0000 7f46237fe640 1 -- 10.20.193.16:0/3051550252 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f463004f120 con 0x7f463807ce90 2026-02-17T08:22:05.099 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.065+0000 7f4640954640 1 -- 10.20.193.16:0/3051550252 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f46381a2720 con 0x7f463807ce90 2026-02-17T08:22:05.099 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.067+0000 7f46237fe640 1 -- 10.20.193.16:0/3051550252 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f4630035e30 con 0x7f463807ce90 2026-02-17T08:22:05.099 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 10 mgrc shutdown 2026-02-17T08:22:05.099 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 1 -- 10.20.193.16:0/3051550252 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f461403dd90 msgr2=0x7f4614040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:05.099 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 1 --2- 10.20.193.16:0/3051550252 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f461403dd90 0x7f4614040250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f46240099c0 tx=0x7f4624006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:05.099 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 1 -- 10.20.193.16:0/3051550252 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 msgr2=0x7f463819ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:05.100 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 1 --2- 10.20.193.16:0/3051550252 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463819ee00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4630002410 tx=0x7f463002fcb0 comp rx=0 tx=0).stop 2026-02-17T08:22:05.100 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 1 -- 10.20.193.16:0/3051550252 shutdown_connections 2026-02-17T08:22:05.100 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 1 --2- 10.20.193.16:0/3051550252 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f461403dd90 0x7f4614040250 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:05.100 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 1 --2- 10.20.193.16:0/3051550252 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f463807ce90 0x7f463819ee00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:05.100 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 1 -- 10.20.193.16:0/3051550252 >> 10.20.193.16:0/3051550252 conn(0x7f46381025a0 msgr2=0x7f4638103190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:05.100 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 1 -- 10.20.193.16:0/3051550252 shutdown_connections 2026-02-17T08:22:05.100 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.068+0000 7f4640954640 1 -- 10.20.193.16:0/3051550252 wait complete. 2026-02-17T08:22:05.318 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.195+0000 7f5eedb60640 1 Processor -- start 2026-02-17T08:22:05.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.195+0000 7f5eedb60640 1 -- start start 2026-02-17T08:22:05.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.196+0000 7f5eedb60640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee807b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:05.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.196+0000 7f5eedb60640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee807b810 con 0x7f5ee807ce70 2026-02-17T08:22:05.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.196+0000 7f5ee77fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee807b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:05.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.196+0000 7f5ee77fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee807b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47302/0 (socket says 10.20.193.16:47302) 2026-02-17T08:22:05.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.196+0000 7f5ee77fe640 1 -- 10.20.193.16:0/192115156 learned_addr learned my addr 10.20.193.16:0/192115156 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:05.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.196+0000 7f5ee77fe640 1 -- 10.20.193.16:0/192115156 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee807b990 con 0x7f5ee807ce70 2026-02-17T08:22:05.319 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.196+0000 7f5ee77fe640 1 --2- 10.20.193.16:0/192115156 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee807b2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009920 tx=0x7f5ed402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bdba0cbf0f886f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.196+0000 7f5ee67fc640 1 -- 10.20.193.16:0/192115156 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ed403c070 con 0x7f5ee807ce70 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.196+0000 7f5ee67fc640 1 -- 10.20.193.16:0/192115156 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f5ed4037440 con 0x7f5ee807ce70 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.196+0000 7f5ee67fc640 1 -- 10.20.193.16:0/192115156 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ed40354d0 con 0x7f5ee807ce70 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 -- 10.20.193.16:0/192115156 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 msgr2=0x7f5ee807b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 --2- 10.20.193.16:0/192115156 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee807b2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009920 tx=0x7f5ed402ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 -- 10.20.193.16:0/192115156 shutdown_connections 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 --2- 10.20.193.16:0/192115156 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee807b2d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 -- 10.20.193.16:0/192115156 >> 10.20.193.16:0/192115156 conn(0x7f5ee81025e0 msgr2=0x7f5ee8104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 -- 10.20.193.16:0/192115156 shutdown_connections 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 -- 10.20.193.16:0/192115156 wait complete. 2026-02-17T08:22:05.320 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 Processor -- start 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 -- start start 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.197+0000 7f5eedb60640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee810d2b0 con 0x7f5ee807ce70 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5ee77fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5ee77fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee819ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47318/0 (socket says 10.20.193.16:47318) 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5ee77fe640 1 -- 10.20.193.16:0/1223856214 learned_addr learned my addr 10.20.193.16:0/1223856214 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5ee77fe640 1 -- 10.20.193.16:0/1223856214 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee819f370 con 0x7f5ee807ce70 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5ee77fe640 1 --2- 10.20.193.16:0/1223856214 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee819ee30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4002410 tx=0x7f5ed402fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5ee4ff9640 1 -- 10.20.193.16:0/1223856214 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ed4047070 con 0x7f5ee807ce70 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5ee4ff9640 1 -- 10.20.193.16:0/1223856214 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f5ed4042440 con 0x7f5ee807ce70 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5eedb60640 1 -- 10.20.193.16:0/1223856214 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee819f600 con 0x7f5ee807ce70 2026-02-17T08:22:05.321 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5ee4ff9640 1 -- 10.20.193.16:0/1223856214 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ed403c070 con 0x7f5ee807ce70 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5eedb60640 1 -- 10.20.193.16:0/1223856214 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee81a22f0 con 0x7f5ee807ce70 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5eedb60640 1 -- 10.20.193.16:0/1223856214 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee807b350 con 0x7f5ee807ce70 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5ee4ff9640 1 -- 10.20.193.16:0/1223856214 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7f5ed4035b10 con 0x7f5ee807ce70 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.198+0000 7f5ee4ff9640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.199+0000 7f5ee4ff9640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.199+0000 7f5ee4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.199+0000 7f5ee4ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.199+0000 7f5ee4ff9640 1 --2- 10.20.193.16:0/1223856214 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5ebc03dd90 0x7f5ebc040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.199+0000 7f5ee4ff9640 1 -- 10.20.193.16:0/1223856214 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5ed4076a80 con 0x7f5ee807ce70 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.199+0000 7f5ee6ffd640 1 --2- 10.20.193.16:0/1223856214 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5ebc03dd90 0x7f5ebc040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:05.322 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.199+0000 7f5ee6ffd640 1 --2- 10.20.193.16:0/1223856214 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5ebc03dd90 0x7f5ebc040250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80099c0 tx=0x7f5ed8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.201+0000 7f5ee4ff9640 1 -- 10.20.193.16:0/1223856214 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5ed404f120 con 0x7f5ee807ce70 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.289+0000 7f5eedb60640 1 -- 10.20.193.16:0/1223856214 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f5ee81a27c0 con 0x7f5ee807ce70 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.290+0000 7f5ee4ff9640 1 -- 10.20.193.16:0/1223856214 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f5ed4035e30 con 0x7f5ee807ce70 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 10 mgrc shutdown 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 1 -- 10.20.193.16:0/1223856214 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5ebc03dd90 msgr2=0x7f5ebc040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 1 --2- 10.20.193.16:0/1223856214 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5ebc03dd90 0x7f5ebc040250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80099c0 tx=0x7f5ed8006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 1 -- 10.20.193.16:0/1223856214 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 msgr2=0x7f5ee819ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 1 --2- 10.20.193.16:0/1223856214 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee819ee30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4002410 tx=0x7f5ed402fcb0 comp rx=0 tx=0).stop 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 1 -- 10.20.193.16:0/1223856214 shutdown_connections 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 1 --2- 10.20.193.16:0/1223856214 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f5ebc03dd90 0x7f5ebc040250 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 1 --2- 10.20.193.16:0/1223856214 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f5ee807ce70 0x7f5ee819ee30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:05.323 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 1 -- 10.20.193.16:0/1223856214 >> 10.20.193.16:0/1223856214 conn(0x7f5ee81025e0 msgr2=0x7f5ee8103110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:05.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 1 -- 10.20.193.16:0/1223856214 shutdown_connections 2026-02-17T08:22:05.324 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.292+0000 7f5eedb60640 1 -- 10.20.193.16:0/1223856214 wait complete. 2026-02-17T08:22:05.324 INFO:teuthology.orchestra.run.trial016.stdout:Enabling the dashboard module... 2026-02-17T08:22:06.306 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: Added host trial016 2026-02-17T08:22:06.306 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:06.307 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: Saving service mon spec with placement count:5 2026-02-17T08:22:06.307 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:06.307 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: Saving service mgr spec with placement count:2 2026-02-17T08:22:06.307 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:06.307 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:06.307 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3051550252' entity='client.admin' 2026-02-17T08:22:06.307 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1223856214' entity='client.admin' 2026-02-17T08:22:06.307 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:06.307 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/564145669' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-17T08:22:06.307 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:05 trial016 ceph-mon[39048]: from='mgr.14118 10.20.193.16:0/3548609881' entity='mgr.a' 2026-02-17T08:22:06.407 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.414+0000 7feb34a18640 1 Processor -- start 2026-02-17T08:22:06.407 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.414+0000 7feb34a18640 1 -- start start 2026-02-17T08:22:06.407 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.414+0000 7feb34a18640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3007b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:06.407 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.414+0000 7feb34a18640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7feb3007b830 con 0x7feb3007ce90 2026-02-17T08:22:06.407 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.414+0000 7feb2e575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3007b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.414+0000 7feb2e575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3007b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47328/0 (socket says 10.20.193.16:47328) 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.414+0000 7feb2e575640 1 -- 10.20.193.16:0/966344289 learned_addr learned my addr 10.20.193.16:0/966344289 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb2e575640 1 -- 10.20.193.16:0/966344289 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3007b9b0 con 0x7feb3007ce90 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb2e575640 1 --2- 10.20.193.16:0/966344289 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3007b2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb24009920 tx=0x7feb2402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a963851d63e54df8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb2d573640 1 -- 10.20.193.16:0/966344289 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb2403c070 con 0x7feb3007ce90 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb2d573640 1 -- 10.20.193.16:0/966344289 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7feb24037440 con 0x7feb3007ce90 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb2d573640 1 -- 10.20.193.16:0/966344289 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb240354d0 con 0x7feb3007ce90 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb34a18640 1 -- 10.20.193.16:0/966344289 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 msgr2=0x7feb3007b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb34a18640 1 --2- 10.20.193.16:0/966344289 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3007b2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb24009920 tx=0x7feb2402ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb34a18640 1 -- 10.20.193.16:0/966344289 shutdown_connections 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb34a18640 1 --2- 10.20.193.16:0/966344289 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3007b2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:06.408 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb34a18640 1 -- 10.20.193.16:0/966344289 >> 10.20.193.16:0/966344289 conn(0x7feb301025a0 msgr2=0x7feb30104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb34a18640 1 -- 10.20.193.16:0/966344289 shutdown_connections 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.415+0000 7feb34a18640 1 -- 10.20.193.16:0/966344289 wait complete. 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb34a18640 1 Processor -- start 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb34a18640 1 -- start start 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb34a18640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb34a18640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7feb3010d270 con 0x7feb3007ce90 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb2e575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb2e575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3019ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47336/0 (socket says 10.20.193.16:47336) 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb2e575640 1 -- 10.20.193.16:0/564145669 learned_addr learned my addr 10.20.193.16:0/564145669 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb2e575640 1 -- 10.20.193.16:0/564145669 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3019f340 con 0x7feb3007ce90 2026-02-17T08:22:06.409 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb2e575640 1 --2- 10.20.193.16:0/564145669 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3019ee00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb24002410 tx=0x7feb2402fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb177fe640 1 -- 10.20.193.16:0/564145669 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb24047070 con 0x7feb3007ce90 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb177fe640 1 -- 10.20.193.16:0/564145669 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7feb24042440 con 0x7feb3007ce90 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb177fe640 1 -- 10.20.193.16:0/564145669 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb2403c070 con 0x7feb3007ce90 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb34a18640 1 -- 10.20.193.16:0/564145669 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3019f5d0 con 0x7feb3007ce90 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.416+0000 7feb34a18640 1 -- 10.20.193.16:0/564145669 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb301a22c0 con 0x7feb3007ce90 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.417+0000 7feb34a18640 1 -- 10.20.193.16:0/564145669 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3007b370 con 0x7feb3007ce90 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.417+0000 7feb177fe640 1 -- 10.20.193.16:0/564145669 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 8) ==== 50325+0+0 (secure 0 0 0) 0x7feb24035b10 con 0x7feb3007ce90 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.417+0000 7feb177fe640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.417+0000 7feb177fe640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.417+0000 7feb177fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.417+0000 7feb177fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.417+0000 7feb177fe640 1 --2- 10.20.193.16:0/564145669 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7feb0803dd90 0x7feb08040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:06.410 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.417+0000 7feb177fe640 1 -- 10.20.193.16:0/564145669 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7feb24076a80 con 0x7feb3007ce90 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.417+0000 7feb2dd74640 1 --2- 10.20.193.16:0/564145669 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7feb0803dd90 0x7feb08040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.418+0000 7feb2dd74640 1 --2- 10.20.193.16:0/564145669 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7feb0803dd90 0x7feb08040250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feb180099c0 tx=0x7feb18006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.420+0000 7feb177fe640 1 -- 10.20.193.16:0/564145669 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7feb2404f120 con 0x7feb3007ce90 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:05.524+0000 7feb34a18640 1 -- 10.20.193.16:0/564145669 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7feb301a2720 con 0x7feb3007ce90 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.374+0000 7feb177fe640 1 -- 10.20.193.16:0/564145669 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7feb24035e30 con 0x7feb3007ce90 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.375+0000 7feb177fe640 1 -- 10.20.193.16:0/564145669 <== mon.0 v2:10.20.193.16:3300/0 8 ==== mgrmap(e 9) ==== 50338+0+0 (secure 0 0 0) 0x7feb240363a0 con 0x7feb3007ce90 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.375+0000 7feb177fe640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.375+0000 7feb177fe640 4 mgrc handle_mgr_map Got map version 9 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.375+0000 7feb177fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 10 mgrc shutdown 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 1 -- 10.20.193.16:0/564145669 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7feb0803dd90 msgr2=0x7feb08040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:06.411 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 1 --2- 10.20.193.16:0/564145669 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7feb0803dd90 0x7feb08040250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feb180099c0 tx=0x7feb18006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:06.412 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 1 -- 10.20.193.16:0/564145669 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 msgr2=0x7feb3019ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:06.412 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 1 --2- 10.20.193.16:0/564145669 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3019ee00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feb24002410 tx=0x7feb2402fcb0 comp rx=0 tx=0).stop 2026-02-17T08:22:06.412 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 1 -- 10.20.193.16:0/564145669 shutdown_connections 2026-02-17T08:22:06.412 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 1 --2- 10.20.193.16:0/564145669 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7feb0803dd90 0x7feb08040250 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:06.412 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 1 --2- 10.20.193.16:0/564145669 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7feb3007ce90 0x7feb3019ee00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:06.412 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 1 -- 10.20.193.16:0/564145669 >> 10.20.193.16:0/564145669 conn(0x7feb301025a0 msgr2=0x7feb30103140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:06.412 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 1 -- 10.20.193.16:0/564145669 shutdown_connections 2026-02-17T08:22:06.412 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.379+0000 7feb34a18640 1 -- 10.20.193.16:0/564145669 wait complete. 2026-02-17T08:22:06.618 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:06 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: ignoring --setuser ceph since I am not root 2026-02-17T08:22:06.618 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:06 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: ignoring --setgroup ceph since I am not root 2026-02-17T08:22:06.645 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-17T08:22:06.645 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-17T08:22:06.646 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T08:22:06.646 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-17T08:22:06.646 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T08:22:06.646 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-17T08:22:06.646 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.506+0000 7f30e9ae8640 1 Processor -- start 2026-02-17T08:22:06.646 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.506+0000 7f30e9ae8640 1 -- start start 2026-02-17T08:22:06.646 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.506+0000 7f30e9ae8640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e41094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:06.646 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.506+0000 7f30e9ae8640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f30e4109aa0 con 0x7f30e41090d0 2026-02-17T08:22:06.646 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.507+0000 7f30e37fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e41094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:06.646 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.507+0000 7f30e37fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e41094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47368/0 (socket says 10.20.193.16:47368) 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.507+0000 7f30e37fe640 1 -- 10.20.193.16:0/2388353189 learned_addr learned my addr 10.20.193.16:0/2388353189 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.507+0000 7f30e37fe640 1 -- 10.20.193.16:0/2388353189 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e410a2d0 con 0x7f30e41090d0 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.507+0000 7f30e37fe640 1 --2- 10.20.193.16:0/2388353189 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e41094d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009920 tx=0x7f30d002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4404023fb67bc7d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.507+0000 7f30e27fc640 1 -- 10.20.193.16:0/2388353189 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30d003c070 con 0x7f30e41090d0 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.507+0000 7f30e27fc640 1 -- 10.20.193.16:0/2388353189 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f30d0037440 con 0x7f30e41090d0 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.507+0000 7f30e27fc640 1 -- 10.20.193.16:0/2388353189 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30d00354d0 con 0x7f30e41090d0 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2388353189 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 msgr2=0x7f30e41094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 --2- 10.20.193.16:0/2388353189 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e41094d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009920 tx=0x7f30d002ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2388353189 shutdown_connections 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 --2- 10.20.193.16:0/2388353189 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e41094d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:06.647 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2388353189 >> 10.20.193.16:0/2388353189 conn(0x7f30e407c550 msgr2=0x7f30e407c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2388353189 shutdown_connections 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2388353189 wait complete. 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 Processor -- start 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 -- start start 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e419ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e9ae8640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f30e410b160 con 0x7f30e41090d0 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.508+0000 7f30e37fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e419ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.509+0000 7f30e37fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e419ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47376/0 (socket says 10.20.193.16:47376) 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.509+0000 7f30e37fe640 1 -- 10.20.193.16:0/2912520749 learned_addr learned my addr 10.20.193.16:0/2912520749 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.509+0000 7f30e37fe640 1 -- 10.20.193.16:0/2912520749 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e419f340 con 0x7f30e41090d0 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.509+0000 7f30e37fe640 1 --2- 10.20.193.16:0/2912520749 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e419ee00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f30d0037d90 tx=0x7f30d002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:06.648 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.509+0000 7f30e0ff9640 1 -- 10.20.193.16:0/2912520749 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30d0047070 con 0x7f30e41090d0 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.509+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2912520749 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e419f5d0 con 0x7f30e41090d0 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.509+0000 7f30e0ff9640 1 -- 10.20.193.16:0/2912520749 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f30d0035c20 con 0x7f30e41090d0 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.509+0000 7f30e0ff9640 1 -- 10.20.193.16:0/2912520749 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30d003c070 con 0x7f30e41090d0 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.509+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2912520749 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e41a22c0 con 0x7f30e41090d0 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.509+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2912520749 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e4109550 con 0x7f30e41090d0 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.510+0000 7f30e0ff9640 1 -- 10.20.193.16:0/2912520749 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 9) ==== 50338+0+0 (secure 0 0 0) 0x7f30d0042440 con 0x7f30e41090d0 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.510+0000 7f30e0ff9640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.510+0000 7f30e0ff9640 4 mgrc handle_mgr_map Got map version 9 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.510+0000 7f30e0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.510+0000 7f30e0ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.510+0000 7f30e0ff9640 1 --2- 10.20.193.16:0/2912520749 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f30b803dd90 0x7f30b8040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:06.649 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.510+0000 7f30e2ffd640 1 -- 10.20.193.16:0/2912520749 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f30b803dd90 msgr2=0x7f30b8040250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.16:6800/2968480635 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.510+0000 7f30e0ff9640 1 -- 10.20.193.16:0/2912520749 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f30d0076c80 con 0x7f30e41090d0 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.510+0000 7f30e2ffd640 1 --2- 10.20.193.16:0/2912520749 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f30b803dd90 0x7f30b8040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.512+0000 7f30e0ff9640 1 -- 10.20.193.16:0/2912520749 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f30d004be80 con 0x7f30e41090d0 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.617+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2912520749 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f30e41a2720 con 0x7f30e41090d0 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.617+0000 7f30e0ff9640 1 -- 10.20.193.16:0/2912520749 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f30d0045120 con 0x7f30e41090d0 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.619+0000 7f30e9ae8640 10 mgrc shutdown 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.619+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2912520749 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f30b803dd90 msgr2=0x7f30b8040250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.619+0000 7f30e9ae8640 1 --2- 10.20.193.16:0/2912520749 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f30b803dd90 0x7f30b8040250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.619+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2912520749 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 msgr2=0x7f30e419ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.619+0000 7f30e9ae8640 1 --2- 10.20.193.16:0/2912520749 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e419ee00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f30d0037d90 tx=0x7f30d002fd40 comp rx=0 tx=0).stop 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.619+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2912520749 shutdown_connections 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.619+0000 7f30e9ae8640 1 --2- 10.20.193.16:0/2912520749 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7f30b803dd90 0x7f30b8040250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:06.650 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.619+0000 7f30e9ae8640 1 --2- 10.20.193.16:0/2912520749 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f30e41090d0 0x7f30e419ee00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:06.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.619+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2912520749 >> 10.20.193.16:0/2912520749 conn(0x7f30e407c550 msgr2=0x7f30e41065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:06.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.619+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2912520749 shutdown_connections 2026-02-17T08:22:06.651 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.620+0000 7f30e9ae8640 1 -- 10.20.193.16:0/2912520749 wait complete. 2026-02-17T08:22:06.651 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for the mgr to restart... 2026-02-17T08:22:06.651 INFO:teuthology.orchestra.run.trial016.stdout:Waiting for mgr epoch 9... 2026-02-17T08:22:06.868 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:06 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:06.792+0000 7ff9101ec140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T08:22:07.206 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:06 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:06.934+0000 7ff9101ec140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T08:22:07.206 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:06 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:06.968+0000 7ff9101ec140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T08:22:07.206 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.008+0000 7ff9101ec140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T08:22:07.206 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.038+0000 7ff9101ec140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T08:22:07.206 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.072+0000 7ff9101ec140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T08:22:07.206 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.137+0000 7ff9101ec140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T08:22:07.207 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T08:22:07.207 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T08:22:07.207 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: from numpy import show_config as show_numpy_config 2026-02-17T08:22:07.459 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/564145669' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-17T08:22:07.459 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-mon[39048]: mgrmap e9: a(active, since 5s) 2026-02-17T08:22:07.459 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/2912520749' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T08:22:07.459 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.209+0000 7ff9101ec140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T08:22:07.459 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.242+0000 7ff9101ec140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T08:22:07.459 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.336+0000 7ff9101ec140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T08:22:07.459 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.393+0000 7ff9101ec140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T08:22:07.459 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.426+0000 7ff9101ec140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T08:22:07.459 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.458+0000 7ff9101ec140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T08:22:07.753 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.491+0000 7ff9101ec140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T08:22:07.754 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.521+0000 7ff9101ec140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T08:22:07.754 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.752+0000 7ff9101ec140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T08:22:08.031 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.851+0000 7ff9101ec140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T08:22:08.031 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.880+0000 7ff9101ec140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T08:22:08.031 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:07 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:07.910+0000 7ff9101ec140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T08:22:08.031 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:08 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:08.002+0000 7ff9101ec140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T08:22:08.031 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:08 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:08.030+0000 7ff9101ec140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T08:22:08.368 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:08 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:08.120+0000 7ff9101ec140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T08:22:08.868 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:08 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:08.585+0000 7ff9101ec140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T08:22:08.869 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:08 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:08.614+0000 7ff9101ec140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T08:22:09.354 INFO:journalctl@ceph.mgr.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-mgr-a[39310]: 2026-02-17T08:22:09.004+0000 7ff9101ec140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T08:22:09.354 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: Active manager daemon a restarted 2026-02-17T08:22:09.354 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: Activating manager daemon a 2026-02-17T08:22:09.354 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: osdmap e3: 0 total, 0 up, 0 in 2026-02-17T08:22:09.354 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: mgrmap e10: a(active, starting, since 0.00245567s) 2026-02-17T08:22:09.354 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T08:22:09.355 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T08:22:09.355 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T08:22:09.355 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T08:22:09.355 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T08:22:09.355 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: Manager daemon a is now available 2026-02-17T08:22:09.355 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:09.355 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T08:22:09.355 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:09 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T08:22:10.687 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:10 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:10.687 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:10 trial016 ceph-mon[39048]: [17/Feb/2026:08:22:09] ENGINE Bus STARTING 2026-02-17T08:22:10.687 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:10 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:10.687 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:10 trial016 ceph-mon[39048]: [17/Feb/2026:08:22:09] ENGINE Serving on https://10.20.193.16:7150 2026-02-17T08:22:10.687 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:10 trial016 ceph-mon[39048]: [17/Feb/2026:08:22:09] ENGINE Client ('10.20.193.16', 33228) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T08:22:10.687 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:10 trial016 ceph-mon[39048]: [17/Feb/2026:08:22:09] ENGINE Serving on http://10.20.193.16:8765 2026-02-17T08:22:10.687 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:10 trial016 ceph-mon[39048]: [17/Feb/2026:08:22:09] ENGINE Bus STARTED 2026-02-17T08:22:10.687 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:10 trial016 ceph-mon[39048]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T08:22:10.687 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:10 trial016 ceph-mon[39048]: mgrmap e11: a(active, since 1.00471s) 2026-02-17T08:22:10.687 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:10 trial016 ceph-mon[39048]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T08:22:10.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout { 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout } 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.747+0000 7fa72f882640 1 Processor -- start 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.747+0000 7fa72f882640 1 -- start start 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.747+0000 7fa72f882640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa728110450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.747+0000 7fa72f882640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa728081670 con 0x7fa72810e060 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.747+0000 7fa72d5f7640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa728110450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.747+0000 7fa72d5f7640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa728110450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47390/0 (socket says 10.20.193.16:47390) 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.747+0000 7fa72d5f7640 1 -- 10.20.193.16:0/1721141706 learned_addr learned my addr 10.20.193.16:0/1721141706 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa72d5f7640 1 -- 10.20.193.16:0/1721141706 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa728110990 con 0x7fa72810e060 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa72d5f7640 1 --2- 10.20.193.16:0/1721141706 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa728110450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa718009920 tx=0x7fa71802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0826183bda4c6f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa717fff640 1 -- 10.20.193.16:0/1721141706 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa71803c070 con 0x7fa72810e060 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa717fff640 1 -- 10.20.193.16:0/1721141706 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa718037440 con 0x7fa72810e060 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa717fff640 1 -- 10.20.193.16:0/1721141706 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7180354d0 con 0x7fa72810e060 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa72f882640 1 -- 10.20.193.16:0/1721141706 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 msgr2=0x7fa728110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa72f882640 1 --2- 10.20.193.16:0/1721141706 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa728110450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa718009920 tx=0x7fa71802ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa72f882640 1 -- 10.20.193.16:0/1721141706 shutdown_connections 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa72f882640 1 --2- 10.20.193.16:0/1721141706 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa728110450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa72f882640 1 -- 10.20.193.16:0/1721141706 >> 10.20.193.16:0/1721141706 conn(0x7fa72807c5e0 msgr2=0x7fa72807ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa72f882640 1 -- 10.20.193.16:0/1721141706 shutdown_connections 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.748+0000 7fa72f882640 1 -- 10.20.193.16:0/1721141706 wait complete. 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.749+0000 7fa72f882640 1 Processor -- start 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.749+0000 7fa72f882640 1 -- start start 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.749+0000 7fa72f882640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa7281a3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.749+0000 7fa72f882640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa7281117c0 con 0x7fa72810e060 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.749+0000 7fa72d5f7640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa7281a3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.749+0000 7fa72d5f7640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa7281a3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:47400/0 (socket says 10.20.193.16:47400) 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.749+0000 7fa72d5f7640 1 -- 10.20.193.16:0/86003181 learned_addr learned my addr 10.20.193.16:0/86003181 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.749+0000 7fa72d5f7640 1 -- 10.20.193.16:0/86003181 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7281a3880 con 0x7fa72810e060 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.749+0000 7fa72d5f7640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa7281a3340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa718002410 tx=0x7fa71802fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa718047070 con 0x7fa72810e060 2026-02-17T08:22:10.692 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa718042440 con 0x7fa72810e060 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa72f882640 1 -- 10.20.193.16:0/86003181 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7281a3b10 con 0x7fa72810e060 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa71803c070 con 0x7fa72810e060 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa72f882640 1 -- 10.20.193.16:0/86003181 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7281a6800 con 0x7fa72810e060 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa72f882640 20 mgrc start_tell_command target: cmd: [{"prefix": "get_command_descriptions"}] 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa72f882640 5 mgrc start_tell_command no mgr session (no running mgr daemon?), or not active mgr, waiting 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 9) ==== 50338+0+0 (secure 0 0 0) 0x7fa718035b10 con 0x7fa72810e060 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 4 mgrc handle_mgr_map Got map version 9 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 0x7fa7040402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 10 mgrc reconnect resending 0 (tell) 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 --> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa7040409b0 con 0x7fa70403dde0 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa72cdf6640 1 -- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 msgr2=0x7fa7040402a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.16:6800/2968480635 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa718076b00 con 0x7fa72810e060 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.750+0000 7fa72cdf6640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 0x7fa7040402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.951+0000 7fa72cdf6640 1 -- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 msgr2=0x7fa7040402a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.16:6800/2968480635 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:06.951+0000 7fa72cdf6640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 0x7fa7040402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:07.352+0000 7fa72cdf6640 1 -- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 msgr2=0x7fa7040402a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.16:6800/2968480635 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:07.352+0000 7fa72cdf6640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 0x7fa7040402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:08.153+0000 7fa72cdf6640 1 -- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 msgr2=0x7fa7040402a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.16:6800/2968480635 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:08.153+0000 7fa72cdf6640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 0x7fa7040402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:09.007+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mgrmap(e 10) ==== 50105+0+0 (secure 0 0 0) 0x7fa718075900 con 0x7fa72810e060 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:09.007+0000 7fa7167fc640 20 mgrc handle_mgr_map mgrmap(e 10) 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:09.007+0000 7fa7167fc640 4 mgrc handle_mgr_map Got map version 10 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:09.007+0000 7fa7167fc640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:09.007+0000 7fa7167fc640 4 mgrc reconnect Terminating session with v2:10.20.193.16:6800/2968480635 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:09.007+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 msgr2=0x7fa7040402a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:09.007+0000 7fa7167fc640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 0x7fa7040402a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:09.007+0000 7fa7167fc640 4 mgrc reconnect No active mgr available yet 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.008+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mgrmap(e 11) ==== 50232+0+0 (secure 0 0 0) 0x7fa718076000 con 0x7fa72810e060 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.008+0000 7fa7167fc640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.009+0000 7fa7167fc640 4 mgrc handle_mgr_map Got map version 11 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.009+0000 7fa7167fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.009+0000 7fa7167fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.009+0000 7fa7167fc640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa7040418c0 0x7fa704043cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.009+0000 7fa7167fc640 10 mgrc reconnect resending 0 (tell) 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.009+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa718033d10 con 0x7fa7040418c0 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.009+0000 7fa72cdf6640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa7040418c0 0x7fa704043cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.009+0000 7fa72cdf6640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa7040418c0 0x7fa704043cb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa71c003a80 tx=0x7fa71c0092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.010+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7fa718033d10 con 0x7fa7040418c0 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.010+0000 7fa7167fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.013+0000 7fa72f882640 20 mgrc start_tell_command target: cmd: [{"prefix": "mgr_status"}] 2026-02-17T08:22:10.693 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 -- 10.20.193.16:0/86003181 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa7281a3ff0 con 0x7fa7040418c0 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa7167fc640 1 -- 10.20.193.16:0/86003181 <== mgr.14150 v2:10.20.193.16:6800/2397623389 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fa7281a3ff0 con 0x7fa7040418c0 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa7167fc640 20 mgrc handle_command_reply tid 1 r 0 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 10 mgrc shutdown 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 -- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa7040418c0 msgr2=0x7fa704043cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa7040418c0 0x7fa704043cb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa71c003a80 tx=0x7fa71c0092b0 comp rx=0 tx=0).stop 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 -- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 msgr2=0x7fa7281a3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa7281a3340 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa718002410 tx=0x7fa71802fcb0 comp rx=0 tx=0).stop 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 -- 10.20.193.16:0/86003181 shutdown_connections 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa7040418c0 0x7fa704043cb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:6800/2968480635,v1:10.20.193.16:6801/2968480635] conn(0x7fa70403dde0 0x7fa7040402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 --2- 10.20.193.16:0/86003181 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa72810e060 0x7fa7281a3340 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 -- 10.20.193.16:0/86003181 >> 10.20.193.16:0/86003181 conn(0x7fa72807c5e0 msgr2=0x7fa72807d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 -- 10.20.193.16:0/86003181 shutdown_connections 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.014+0000 7fa72f882640 1 -- 10.20.193.16:0/86003181 wait complete. 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:mgr epoch 9 is available 2026-02-17T08:22:10.694 INFO:teuthology.orchestra.run.trial016.stdout:Generating a dashboard self-signed certificate... 2026-02-17T08:22:11.061 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-17T08:22:11.061 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.789+0000 7f6e95823640 1 Processor -- start 2026-02-17T08:22:11.061 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.789+0000 7f6e95823640 1 -- start start 2026-02-17T08:22:11.061 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.789+0000 7f6e95823640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e901094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.061 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.789+0000 7f6e95823640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90109ac0 con 0x7f6e901090f0 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.789+0000 7f6e8effd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e901094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.789+0000 7f6e8effd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e901094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44770/0 (socket says 10.20.193.16:44770) 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.789+0000 7f6e8effd640 1 -- 10.20.193.16:0/3065534029 learned_addr learned my addr 10.20.193.16:0/3065534029 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e8effd640 1 -- 10.20.193.16:0/3065534029 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9010a2f0 con 0x7f6e901090f0 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e8effd640 1 --2- 10.20.193.16:0/3065534029 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e901094f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009920 tx=0x7f6e8402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1a781db71e7f83 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e8dffb640 1 -- 10.20.193.16:0/3065534029 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e8403c070 con 0x7f6e901090f0 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e8dffb640 1 -- 10.20.193.16:0/3065534029 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f6e84037440 con 0x7f6e901090f0 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e8dffb640 1 -- 10.20.193.16:0/3065534029 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e840354d0 con 0x7f6e901090f0 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e95823640 1 -- 10.20.193.16:0/3065534029 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 msgr2=0x7f6e901094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e95823640 1 --2- 10.20.193.16:0/3065534029 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e901094f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009920 tx=0x7f6e8402ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:11.062 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e95823640 1 -- 10.20.193.16:0/3065534029 shutdown_connections 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e95823640 1 --2- 10.20.193.16:0/3065534029 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e901094f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e95823640 1 -- 10.20.193.16:0/3065534029 >> 10.20.193.16:0/3065534029 conn(0x7f6e9007c610 msgr2=0x7f6e9007ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e95823640 1 -- 10.20.193.16:0/3065534029 shutdown_connections 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.790+0000 7f6e95823640 1 -- 10.20.193.16:0/3065534029 wait complete. 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e95823640 1 Processor -- start 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e95823640 1 -- start start 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e95823640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e9019ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e95823640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9010b180 con 0x7f6e901090f0 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e8effd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e9019ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e8effd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e9019ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44786/0 (socket says 10.20.193.16:44786) 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e8effd640 1 -- 10.20.193.16:0/1369108356 learned_addr learned my addr 10.20.193.16:0/1369108356 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:11.063 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e8effd640 1 -- 10.20.193.16:0/1369108356 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9019f370 con 0x7f6e901090f0 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e8effd640 1 --2- 10.20.193.16:0/1369108356 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e9019ee30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e84037d90 tx=0x7f6e8402fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e94821640 1 -- 10.20.193.16:0/1369108356 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e84047070 con 0x7f6e901090f0 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e94821640 1 -- 10.20.193.16:0/1369108356 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f6e84042440 con 0x7f6e901090f0 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e95823640 1 -- 10.20.193.16:0/1369108356 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9019f600 con 0x7f6e901090f0 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e94821640 1 -- 10.20.193.16:0/1369108356 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e8403c070 con 0x7f6e901090f0 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.791+0000 7f6e95823640 1 -- 10.20.193.16:0/1369108356 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e901a22f0 con 0x7f6e901090f0 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.792+0000 7f6e95823640 1 -- 10.20.193.16:0/1369108356 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e90109570 con 0x7f6e901090f0 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.792+0000 7f6e94821640 1 -- 10.20.193.16:0/1369108356 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 11) ==== 50232+0+0 (secure 0 0 0) 0x7f6e840425f0 con 0x7f6e901090f0 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.792+0000 7f6e94821640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.792+0000 7f6e94821640 4 mgrc handle_mgr_map Got map version 11 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.792+0000 7f6e94821640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:11.064 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.792+0000 7f6e94821640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.792+0000 7f6e94821640 1 --2- 10.20.193.16:0/1369108356 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6e6403dcc0 0x7f6e64040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.792+0000 7f6e94821640 1 -- 10.20.193.16:0/1369108356 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6e84076e40 con 0x7f6e901090f0 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.792+0000 7f6e8e7fc640 1 --2- 10.20.193.16:0/1369108356 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6e6403dcc0 0x7f6e64040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.793+0000 7f6e8e7fc640 1 --2- 10.20.193.16:0/1369108356 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6e6403dcc0 0x7f6e64040180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6e780099c0 tx=0x7f6e78006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.795+0000 7f6e94821640 1 -- 10.20.193.16:0/1369108356 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6e84045120 con 0x7f6e901090f0 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.879+0000 7f6e95823640 20 mgrc start_command cmd: [{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:10.879+0000 7f6e95823640 1 -- 10.20.193.16:0/1369108356 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f6e90106d80 con 0x7f6e6403dcc0 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.031+0000 7f6e94821640 1 -- 10.20.193.16:0/1369108356 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f6e90106d80 con 0x7f6e6403dcc0 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.031+0000 7f6e94821640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 10 mgrc shutdown 2026-02-17T08:22:11.065 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 1 -- 10.20.193.16:0/1369108356 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6e6403dcc0 msgr2=0x7f6e64040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 1 --2- 10.20.193.16:0/1369108356 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6e6403dcc0 0x7f6e64040180 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6e780099c0 tx=0x7f6e78006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 1 -- 10.20.193.16:0/1369108356 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 msgr2=0x7f6e9019ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 1 --2- 10.20.193.16:0/1369108356 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e9019ee30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e84037d90 tx=0x7f6e8402fcd0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 1 -- 10.20.193.16:0/1369108356 shutdown_connections 2026-02-17T08:22:11.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 1 --2- 10.20.193.16:0/1369108356 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6e6403dcc0 0x7f6e64040180 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 1 --2- 10.20.193.16:0/1369108356 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6e901090f0 0x7f6e9019ee30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 1 -- 10.20.193.16:0/1369108356 >> 10.20.193.16:0/1369108356 conn(0x7f6e9007c610 msgr2=0x7f6e90106670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:11.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 1 -- 10.20.193.16:0/1369108356 shutdown_connections 2026-02-17T08:22:11.066 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.033+0000 7f6e95823640 1 -- 10.20.193.16:0/1369108356 wait complete. 2026-02-17T08:22:11.066 INFO:teuthology.orchestra.run.trial016.stdout:Creating initial admin user... 2026-02-17T08:22:11.480 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$qi3evBTz48fMTvVgMOmeqeQBoZ5CMVvDy8Eph4ClmSaK/j.69/2RC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771316531, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-17T08:22:11.480 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.154+0000 7ff08dae4640 1 Processor -- start 2026-02-17T08:22:11.480 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.154+0000 7ff08dae4640 1 -- start start 2026-02-17T08:22:11.480 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.154+0000 7ff08dae4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.480 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.154+0000 7ff08dae4640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff08807b830 con 0x7ff08807ce90 2026-02-17T08:22:11.480 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.154+0000 7ff0877fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.480 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.154+0000 7ff0877fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08807b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44790/0 (socket says 10.20.193.16:44790) 2026-02-17T08:22:11.480 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.154+0000 7ff0877fe640 1 -- 10.20.193.16:0/1638162955 learned_addr learned my addr 10.20.193.16:0/1638162955 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:11.480 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.154+0000 7ff0877fe640 1 -- 10.20.193.16:0/1638162955 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08807b9b0 con 0x7ff08807ce90 2026-02-17T08:22:11.480 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff0877fe640 1 --2- 10.20.193.16:0/1638162955 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08807b2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff074009920 tx=0x7ff07402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc77ae4ef8f850d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff0867fc640 1 -- 10.20.193.16:0/1638162955 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07403c070 con 0x7ff08807ce90 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff0867fc640 1 -- 10.20.193.16:0/1638162955 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7ff074037440 con 0x7ff08807ce90 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff0867fc640 1 -- 10.20.193.16:0/1638162955 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0740354d0 con 0x7ff08807ce90 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff08dae4640 1 -- 10.20.193.16:0/1638162955 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 msgr2=0x7ff08807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff08dae4640 1 --2- 10.20.193.16:0/1638162955 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08807b2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff074009920 tx=0x7ff07402ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff08dae4640 1 -- 10.20.193.16:0/1638162955 shutdown_connections 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff08dae4640 1 --2- 10.20.193.16:0/1638162955 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08807b2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff08dae4640 1 -- 10.20.193.16:0/1638162955 >> 10.20.193.16:0/1638162955 conn(0x7ff088102640 msgr2=0x7ff088104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff08dae4640 1 -- 10.20.193.16:0/1638162955 shutdown_connections 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.155+0000 7ff08dae4640 1 -- 10.20.193.16:0/1638162955 wait complete. 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff08dae4640 1 Processor -- start 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff08dae4640 1 -- start start 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff08dae4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08819edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff08dae4640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff08810d290 con 0x7ff08807ce90 2026-02-17T08:22:11.481 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff0877fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08819edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff0877fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08819edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44796/0 (socket says 10.20.193.16:44796) 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff0877fe640 1 -- 10.20.193.16:0/4052539565 learned_addr learned my addr 10.20.193.16:0/4052539565 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff0877fe640 1 -- 10.20.193.16:0/4052539565 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08819f330 con 0x7ff08807ce90 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff0877fe640 1 --2- 10.20.193.16:0/4052539565 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08819edf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff07402fcd0 tx=0x7ff07402fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff084ff9640 1 -- 10.20.193.16:0/4052539565 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff074047070 con 0x7ff08807ce90 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff084ff9640 1 -- 10.20.193.16:0/4052539565 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7ff074042440 con 0x7ff08807ce90 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff084ff9640 1 -- 10.20.193.16:0/4052539565 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff07403c070 con 0x7ff08807ce90 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff08dae4640 1 -- 10.20.193.16:0/4052539565 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08819f5c0 con 0x7ff08807ce90 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.156+0000 7ff08dae4640 1 -- 10.20.193.16:0/4052539565 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0881a22b0 con 0x7ff08807ce90 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.157+0000 7ff08dae4640 1 -- 10.20.193.16:0/4052539565 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08807b370 con 0x7ff08807ce90 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.157+0000 7ff084ff9640 1 -- 10.20.193.16:0/4052539565 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 11) ==== 50232+0+0 (secure 0 0 0) 0x7ff074035b60 con 0x7ff08807ce90 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.157+0000 7ff084ff9640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.157+0000 7ff084ff9640 4 mgrc handle_mgr_map Got map version 11 2026-02-17T08:22:11.482 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.157+0000 7ff084ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.157+0000 7ff084ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.157+0000 7ff084ff9640 1 --2- 10.20.193.16:0/4052539565 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff05c03dcc0 0x7ff05c040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.157+0000 7ff084ff9640 1 -- 10.20.193.16:0/4052539565 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff074076f10 con 0x7ff08807ce90 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.157+0000 7ff086ffd640 1 --2- 10.20.193.16:0/4052539565 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff05c03dcc0 0x7ff05c040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.158+0000 7ff086ffd640 1 --2- 10.20.193.16:0/4052539565 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff05c03dcc0 0x7ff05c040180 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0780099c0 tx=0x7ff078006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.160+0000 7ff084ff9640 1 -- 10.20.193.16:0/4052539565 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff07404a360 con 0x7ff08807ce90 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.247+0000 7ff08dae4640 20 mgrc start_command cmd: [{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}] 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.247+0000 7ff08dae4640 1 -- 10.20.193.16:0/4052539565 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7ff0881038e0 con 0x7ff05c03dcc0 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.453+0000 7ff084ff9640 1 -- 10.20.193.16:0/4052539565 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7ff0881038e0 con 0x7ff05c03dcc0 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.453+0000 7ff084ff9640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 10 mgrc shutdown 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 1 -- 10.20.193.16:0/4052539565 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff05c03dcc0 msgr2=0x7ff05c040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 1 --2- 10.20.193.16:0/4052539565 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff05c03dcc0 0x7ff05c040180 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0780099c0 tx=0x7ff078006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 1 -- 10.20.193.16:0/4052539565 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 msgr2=0x7ff08819edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 1 --2- 10.20.193.16:0/4052539565 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08819edf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff07402fcd0 tx=0x7ff07402fd00 comp rx=0 tx=0).stop 2026-02-17T08:22:11.483 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 1 -- 10.20.193.16:0/4052539565 shutdown_connections 2026-02-17T08:22:11.484 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 1 --2- 10.20.193.16:0/4052539565 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff05c03dcc0 0x7ff05c040180 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.484 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 1 --2- 10.20.193.16:0/4052539565 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff08807ce90 0x7ff08819edf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.484 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 1 -- 10.20.193.16:0/4052539565 >> 10.20.193.16:0/4052539565 conn(0x7ff088102640 msgr2=0x7ff0881031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:11.484 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 1 -- 10.20.193.16:0/4052539565 shutdown_connections 2026-02-17T08:22:11.484 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.454+0000 7ff08dae4640 1 -- 10.20.193.16:0/4052539565 wait complete. 2026-02-17T08:22:11.484 INFO:teuthology.orchestra.run.trial016.stdout:Fetching dashboard port number... 2026-02-17T08:22:11.686 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stdout 8443 2026-02-17T08:22:11.686 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.571+0000 7f9a4f45e640 1 Processor -- start 2026-02-17T08:22:11.686 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.571+0000 7f9a4f45e640 1 -- start start 2026-02-17T08:22:11.686 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.571+0000 7f9a4f45e640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a481094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.686 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.571+0000 7f9a4f45e640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48109ac0 con 0x7f9a481090f0 2026-02-17T08:22:11.686 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.572+0000 7f9a4d1d3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a481094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.686 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.572+0000 7f9a4d1d3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a481094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44812/0 (socket says 10.20.193.16:44812) 2026-02-17T08:22:11.686 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.572+0000 7f9a4d1d3640 1 -- 10.20.193.16:0/3789928605 learned_addr learned my addr 10.20.193.16:0/3789928605 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:11.686 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.572+0000 7f9a4d1d3640 1 -- 10.20.193.16:0/3789928605 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4810a2f0 con 0x7f9a481090f0 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.572+0000 7f9a4d1d3640 1 --2- 10.20.193.16:0/3789928605 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a481094f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009920 tx=0x7f9a3802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545a458413ac0147 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.572+0000 7f9a37fff640 1 -- 10.20.193.16:0/3789928605 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3803c070 con 0x7f9a481090f0 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.572+0000 7f9a37fff640 1 -- 10.20.193.16:0/3789928605 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f9a38037440 con 0x7f9a481090f0 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.572+0000 7f9a37fff640 1 -- 10.20.193.16:0/3789928605 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a380354d0 con 0x7f9a481090f0 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 -- 10.20.193.16:0/3789928605 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 msgr2=0x7f9a481094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 --2- 10.20.193.16:0/3789928605 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a481094f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009920 tx=0x7f9a3802ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 -- 10.20.193.16:0/3789928605 shutdown_connections 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 --2- 10.20.193.16:0/3789928605 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a481094f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 -- 10.20.193.16:0/3789928605 >> 10.20.193.16:0/3789928605 conn(0x7f9a4807c610 msgr2=0x7f9a4807ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 -- 10.20.193.16:0/3789928605 shutdown_connections 2026-02-17T08:22:11.687 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 -- 10.20.193.16:0/3789928605 wait complete. 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 Processor -- start 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 -- start start 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a4819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4f45e640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4810b180 con 0x7f9a481090f0 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4d1d3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a4819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4d1d3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a4819ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44828/0 (socket says 10.20.193.16:44828) 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4d1d3640 1 -- 10.20.193.16:0/1035085962 learned_addr learned my addr 10.20.193.16:0/1035085962 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4d1d3640 1 -- 10.20.193.16:0/1035085962 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4819f370 con 0x7f9a481090f0 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.573+0000 7f9a4d1d3640 1 --2- 10.20.193.16:0/1035085962 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a4819ee30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a38037d90 tx=0x7f9a3802fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a367fc640 1 -- 10.20.193.16:0/1035085962 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a38047070 con 0x7f9a481090f0 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a367fc640 1 -- 10.20.193.16:0/1035085962 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f9a38042440 con 0x7f9a481090f0 2026-02-17T08:22:11.688 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a4f45e640 1 -- 10.20.193.16:0/1035085962 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4819f600 con 0x7f9a481090f0 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a367fc640 1 -- 10.20.193.16:0/1035085962 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a3803c070 con 0x7f9a481090f0 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a4f45e640 1 -- 10.20.193.16:0/1035085962 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a481a22f0 con 0x7f9a481090f0 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a4f45e640 1 -- 10.20.193.16:0/1035085962 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a48109570 con 0x7f9a481090f0 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a367fc640 1 -- 10.20.193.16:0/1035085962 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7f9a38035b60 con 0x7f9a481090f0 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a367fc640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a367fc640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a367fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a367fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a367fc640 1 --2- 10.20.193.16:0/1035085962 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f9a2403dde0 0x7f9a240402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a367fc640 1 -- 10.20.193.16:0/1035085962 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9a38076fc0 con 0x7f9a481090f0 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.574+0000 7f9a4c9d2640 1 --2- 10.20.193.16:0/1035085962 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f9a2403dde0 0x7f9a240402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.689 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.575+0000 7f9a4c9d2640 1 --2- 10.20.193.16:0/1035085962 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f9a2403dde0 0x7f9a240402a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0099c0 tx=0x7f9a3c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.577+0000 7f9a367fc640 1 -- 10.20.193.16:0/1035085962 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9a380425f0 con 0x7f9a481090f0 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.659+0000 7f9a4f45e640 1 -- 10.20.193.16:0/1035085962 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f9a481a2750 con 0x7f9a481090f0 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.659+0000 7f9a367fc640 1 -- 10.20.193.16:0/1035085962 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f9a38036c70 con 0x7f9a481090f0 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 10 mgrc shutdown 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 1 -- 10.20.193.16:0/1035085962 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f9a2403dde0 msgr2=0x7f9a240402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 1 --2- 10.20.193.16:0/1035085962 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f9a2403dde0 0x7f9a240402a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0099c0 tx=0x7f9a3c006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 1 -- 10.20.193.16:0/1035085962 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 msgr2=0x7f9a4819ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 1 --2- 10.20.193.16:0/1035085962 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a4819ee30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a38037d90 tx=0x7f9a3802fcd0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 1 -- 10.20.193.16:0/1035085962 shutdown_connections 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 1 --2- 10.20.193.16:0/1035085962 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f9a2403dde0 0x7f9a240402a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 1 --2- 10.20.193.16:0/1035085962 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9a481090f0 0x7f9a4819ee30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.690 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 1 -- 10.20.193.16:0/1035085962 >> 10.20.193.16:0/1035085962 conn(0x7f9a4807c610 msgr2=0x7f9a48106670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:11.691 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 1 -- 10.20.193.16:0/1035085962 shutdown_connections 2026-02-17T08:22:11.691 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.660+0000 7f9a4f45e640 1 -- 10.20.193.16:0/1035085962 wait complete. 2026-02-17T08:22:11.691 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T08:22:11.692 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout disabled 2026-02-17T08:22:11.694 INFO:teuthology.orchestra.run.trial016.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T08:22:11.695 INFO:teuthology.orchestra.run.trial016.stdout:systemctl: stdout inactive 2026-02-17T08:22:11.695 INFO:teuthology.orchestra.run.trial016.stdout:firewalld.service is not enabled 2026-02-17T08:22:11.695 INFO:teuthology.orchestra.run.trial016.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-17T08:22:11.696 INFO:teuthology.orchestra.run.trial016.stdout:Ceph Dashboard is now available at: 2026-02-17T08:22:11.696 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:11.696 INFO:teuthology.orchestra.run.trial016.stdout: URL: https://trial016:8443/ 2026-02-17T08:22:11.696 INFO:teuthology.orchestra.run.trial016.stdout: User: admin 2026-02-17T08:22:11.696 INFO:teuthology.orchestra.run.trial016.stdout: Password: 8xtunx8pwd 2026-02-17T08:22:11.696 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:11.696 INFO:teuthology.orchestra.run.trial016.stdout:Saving cluster configuration to /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/config directory 2026-02-17T08:22:11.946 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.794+0000 7f01994d4640 1 Processor -- start 2026-02-17T08:22:11.946 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.794+0000 7f01994d4640 1 -- start start 2026-02-17T08:22:11.946 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.794+0000 7f01994d4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f01941094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.946 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.794+0000 7f01994d4640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0194109aa0 con 0x7f01941090d0 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.794+0000 7f0192ffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f01941094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.794+0000 7f0192ffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f01941094d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44842/0 (socket says 10.20.193.16:44842) 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.794+0000 7f0192ffd640 1 -- 10.20.193.16:0/2804997687 learned_addr learned my addr 10.20.193.16:0/2804997687 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.794+0000 7f0192ffd640 1 -- 10.20.193.16:0/2804997687 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019410a2d0 con 0x7f01941090d0 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f0192ffd640 1 --2- 10.20.193.16:0/2804997687 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f01941094d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0188009920 tx=0x7f018802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36589c3f8d9263e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f0191ffb640 1 -- 10.20.193.16:0/2804997687 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f018803c070 con 0x7f01941090d0 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f0191ffb640 1 -- 10.20.193.16:0/2804997687 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0188037440 con 0x7f01941090d0 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f0191ffb640 1 -- 10.20.193.16:0/2804997687 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01880354d0 con 0x7f01941090d0 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f01994d4640 1 -- 10.20.193.16:0/2804997687 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 msgr2=0x7f01941094d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f01994d4640 1 --2- 10.20.193.16:0/2804997687 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f01941094d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0188009920 tx=0x7f018802ef20 comp rx=0 tx=0).stop 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f01994d4640 1 -- 10.20.193.16:0/2804997687 shutdown_connections 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f01994d4640 1 --2- 10.20.193.16:0/2804997687 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f01941094d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f01994d4640 1 -- 10.20.193.16:0/2804997687 >> 10.20.193.16:0/2804997687 conn(0x7f019407c550 msgr2=0x7f019407c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f01994d4640 1 -- 10.20.193.16:0/2804997687 shutdown_connections 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.795+0000 7f01994d4640 1 -- 10.20.193.16:0/2804997687 wait complete. 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f01994d4640 1 Processor -- start 2026-02-17T08:22:11.947 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f01994d4640 1 -- start start 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f01994d4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f019419edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f01994d4640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f019410b160 con 0x7f01941090d0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f0192ffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f019419edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f0192ffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f019419edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44850/0 (socket says 10.20.193.16:44850) 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f0192ffd640 1 -- 10.20.193.16:0/1664604777 learned_addr learned my addr 10.20.193.16:0/1664604777 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f0192ffd640 1 -- 10.20.193.16:0/1664604777 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019419f310 con 0x7f01941090d0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f0192ffd640 1 --2- 10.20.193.16:0/1664604777 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f019419edd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0188037d90 tx=0x7f018802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f0173fff640 1 -- 10.20.193.16:0/1664604777 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0188047070 con 0x7f01941090d0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f0173fff640 1 -- 10.20.193.16:0/1664604777 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0188035c20 con 0x7f01941090d0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f01994d4640 1 -- 10.20.193.16:0/1664604777 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019419f5a0 con 0x7f01941090d0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f0173fff640 1 -- 10.20.193.16:0/1664604777 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f018803c070 con 0x7f01941090d0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.796+0000 7f01994d4640 1 -- 10.20.193.16:0/1664604777 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01941a2290 con 0x7f01941090d0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.797+0000 7f01994d4640 1 -- 10.20.193.16:0/1664604777 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0194109550 con 0x7f01941090d0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.797+0000 7f0173fff640 1 -- 10.20.193.16:0/1664604777 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7f0188042440 con 0x7f01941090d0 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.797+0000 7f0173fff640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.797+0000 7f0173fff640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.797+0000 7f0173fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:11.948 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.797+0000 7f0173fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.797+0000 7f0173fff640 1 --2- 10.20.193.16:0/1664604777 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f016803dde0 0x7f01680402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.797+0000 7f0173fff640 1 -- 10.20.193.16:0/1664604777 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0188077120 con 0x7f01941090d0 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.797+0000 7f01927fc640 1 --2- 10.20.193.16:0/1664604777 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f016803dde0 0x7f01680402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.797+0000 7f01927fc640 1 --2- 10.20.193.16:0/1664604777 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f016803dde0 0x7f01680402a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f017c0099c0 tx=0x7f017c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.800+0000 7f0173fff640 1 -- 10.20.193.16:0/1664604777 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0188045120 con 0x7f01941090d0 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.922+0000 7f01994d4640 1 -- 10.20.193.16:0/1664604777 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f01941a26f0 con 0x7f01941090d0 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.924+0000 7f0173fff640 1 -- 10.20.193.16:0/1664604777 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f0188035dd0 con 0x7f01941090d0 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 10 mgrc shutdown 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 1 -- 10.20.193.16:0/1664604777 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f016803dde0 msgr2=0x7f01680402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 1 --2- 10.20.193.16:0/1664604777 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f016803dde0 0x7f01680402a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f017c0099c0 tx=0x7f017c006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 1 -- 10.20.193.16:0/1664604777 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 msgr2=0x7f019419edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 1 --2- 10.20.193.16:0/1664604777 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f019419edd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0188037d90 tx=0x7f018802fd40 comp rx=0 tx=0).stop 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 1 -- 10.20.193.16:0/1664604777 shutdown_connections 2026-02-17T08:22:11.949 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 1 --2- 10.20.193.16:0/1664604777 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f016803dde0 0x7f01680402a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 1 --2- 10.20.193.16:0/1664604777 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f01941090d0 0x7f019419edd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 1 -- 10.20.193.16:0/1664604777 >> 10.20.193.16:0/1664604777 conn(0x7f019407c550 msgr2=0x7f0194106670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 1 -- 10.20.193.16:0/1664604777 shutdown_connections 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout:/usr/bin/ceph: stderr 2026-02-17T08:22:11.925+0000 7f01994d4640 1 -- 10.20.193.16:0/1664604777 wait complete. 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout:Or, if you are only running a single cluster on this host: 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:11.950 INFO:teuthology.orchestra.run.trial016.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-17T08:22:11.951 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:11.951 INFO:teuthology.orchestra.run.trial016.stdout: ceph telemetry on 2026-02-17T08:22:11.951 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:11.951 INFO:teuthology.orchestra.run.trial016.stdout:For more information see: 2026-02-17T08:22:11.951 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:11.951 INFO:teuthology.orchestra.run.trial016.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-17T08:22:11.951 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:11.951 INFO:teuthology.orchestra.run.trial016.stdout:Bootstrap complete. 2026-02-17T08:22:11.971 INFO:tasks.cephadm:Fetching config... 2026-02-17T08:22:11.971 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:22:11.972 DEBUG:teuthology.orchestra.run.trial016:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-17T08:22:11.989 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-17T08:22:11.989 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:22:11.989 DEBUG:teuthology.orchestra.run.trial016:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-17T08:22:12.046 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-17T08:22:12.046 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:22:12.046 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-17T08:22:12.110 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-17T08:22:12.110 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:22:12.111 DEBUG:teuthology.orchestra.run.trial016:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-17T08:22:12.169 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-17T08:22:12.169 DEBUG:teuthology.orchestra.run.trial016:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDgWLXMMF4p4fE606xR/QNzosspLK/er0VlcIpG1PqKE ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-17T08:22:12.233 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:12 trial016 ceph-mon[39048]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:12.233 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:12 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:12.233 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:12 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:12.233 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:12 trial016 ceph-mon[39048]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:12.233 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:12 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:12.233 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:12 trial016 ceph-mon[39048]: mgrmap e12: a(active, since 2s) 2026-02-17T08:22:12.233 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:12 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1035085962' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-17T08:22:12.234 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:12 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1664604777' entity='client.admin' 2026-02-17T08:22:12.244 INFO:teuthology.orchestra.run.trial016.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDgWLXMMF4p4fE606xR/QNzosspLK/er0VlcIpG1PqKE ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:22:12.255 DEBUG:teuthology.orchestra.run.trial134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDgWLXMMF4p4fE606xR/QNzosspLK/er0VlcIpG1PqKE ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-17T08:22:12.290 INFO:teuthology.orchestra.run.trial134.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDgWLXMMF4p4fE606xR/QNzosspLK/er0VlcIpG1PqKE ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:22:12.300 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-17T08:22:12.447 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:12.564 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.561+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/2943312838 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc2a41045e0 msgr2=0x7fc2a41049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:12.564 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.561+0000 7fc2a9b3d640 1 --2- 10.20.193.16:0/2943312838 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc2a41045e0 0x7fc2a41049e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc2900099b0 tx=0x7fc29002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:12.564 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.561+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/2943312838 shutdown_connections 2026-02-17T08:22:12.564 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.561+0000 7fc2a9b3d640 1 --2- 10.20.193.16:0/2943312838 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc2a41045e0 0x7fc2a41049e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:12.564 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.561+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/2943312838 >> 10.20.193.16:0/2943312838 conn(0x7fc2a40ffd70 msgr2=0x7fc2a41021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:12.564 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.561+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/2943312838 shutdown_connections 2026-02-17T08:22:12.564 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.561+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/2943312838 wait complete. 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.561+0000 7fc2a9b3d640 1 Processor -- start 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.561+0000 7fc2a9b3d640 1 -- start start 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a9b3d640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc2a41045e0 0x7fc2a419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a9b3d640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a4109a60 con 0x7fc2a41045e0 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a37fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc2a41045e0 0x7fc2a419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a37fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc2a41045e0 0x7fc2a419b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44864/0 (socket says 10.20.193.16:44864) 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a37fe640 1 -- 10.20.193.16:0/1743028530 learned_addr learned my addr 10.20.193.16:0/1743028530 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a37fe640 1 -- 10.20.193.16:0/1743028530 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a419b6e0 con 0x7fc2a41045e0 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a37fe640 1 --2- 10.20.193.16:0/1743028530 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc2a41045e0 0x7fc2a419b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc290005ec0 tx=0x7fc290004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a0ff9640 1 -- 10.20.193.16:0/1743028530 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc290038510 con 0x7fc2a41045e0 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/1743028530 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a419b970 con 0x7fc2a41045e0 2026-02-17T08:22:12.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a0ff9640 1 -- 10.20.193.16:0/1743028530 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc290046070 con 0x7fc2a41045e0 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a0ff9640 1 -- 10.20.193.16:0/1743028530 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc290041810 con 0x7fc2a41045e0 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/1743028530 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a419e660 con 0x7fc2a41045e0 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.562+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/1743028530 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a410a200 con 0x7fc2a41045e0 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.563+0000 7fc2a0ff9640 1 -- 10.20.193.16:0/1743028530 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7fc290041ac0 con 0x7fc2a41045e0 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.563+0000 7fc2a0ff9640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.563+0000 7fc2a0ff9640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.563+0000 7fc2a0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.563+0000 7fc2a0ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.563+0000 7fc2a0ff9640 1 --2- 10.20.193.16:0/1743028530 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc27803dd90 0x7fc278040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.563+0000 7fc2a0ff9640 1 -- 10.20.193.16:0/1743028530 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc290077200 con 0x7fc2a41045e0 2026-02-17T08:22:12.566 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.563+0000 7fc2a2ffd640 1 --2- 10.20.193.16:0/1743028530 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc27803dd90 0x7fc278040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:12.567 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.563+0000 7fc2a2ffd640 1 --2- 10.20.193.16:0/1743028530 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc27803dd90 0x7fc278040250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc2940099c0 tx=0x7fc294006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:12.567 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.566+0000 7fc2a0ff9640 1 -- 10.20.193.16:0/1743028530 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc29004ac70 con 0x7fc2a41045e0 2026-02-17T08:22:12.650 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.649+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/1743028530 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fc2a4194830 con 0x7fc2a41045e0 2026-02-17T08:22:12.651 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.651+0000 7fc2a0ff9640 1 -- 10.20.193.16:0/1743028530 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fc290047de0 con 0x7fc2a41045e0 2026-02-17T08:22:12.653 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 10 mgrc shutdown 2026-02-17T08:22:12.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/1743028530 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc27803dd90 msgr2=0x7fc278040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:12.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 1 --2- 10.20.193.16:0/1743028530 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc27803dd90 0x7fc278040250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc2940099c0 tx=0x7fc294006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:12.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/1743028530 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc2a41045e0 msgr2=0x7fc2a419b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:12.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 1 --2- 10.20.193.16:0/1743028530 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc2a41045e0 0x7fc2a419b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc290005ec0 tx=0x7fc290004290 comp rx=0 tx=0).stop 2026-02-17T08:22:12.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/1743028530 shutdown_connections 2026-02-17T08:22:12.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 1 --2- 10.20.193.16:0/1743028530 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc27803dd90 0x7fc278040250 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:12.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 1 --2- 10.20.193.16:0/1743028530 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc2a41045e0 0x7fc2a419b1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:12.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/1743028530 >> 10.20.193.16:0/1743028530 conn(0x7fc2a40ffd70 msgr2=0x7fc2a41003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:12.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/1743028530 shutdown_connections 2026-02-17T08:22:12.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.652+0000 7fc2a9b3d640 1 -- 10.20.193.16:0/1743028530 wait complete. 2026-02-17T08:22:12.690 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-17T08:22:12.690 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-17T08:22:12.840 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:12.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 -- 10.20.193.16:0/491834482 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6181045b0 msgr2=0x7fe6181049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:12.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 --2- 10.20.193.16:0/491834482 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6181045b0 0x7fe6181049b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6080099b0 tx=0x7fe60802f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:12.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 -- 10.20.193.16:0/491834482 shutdown_connections 2026-02-17T08:22:12.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 --2- 10.20.193.16:0/491834482 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6181045b0 0x7fe6181049b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:12.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 -- 10.20.193.16:0/491834482 >> 10.20.193.16:0/491834482 conn(0x7fe6180ffd70 msgr2=0x7fe618102180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:12.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 -- 10.20.193.16:0/491834482 shutdown_connections 2026-02-17T08:22:12.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 -- 10.20.193.16:0/491834482 wait complete. 2026-02-17T08:22:12.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 Processor -- start 2026-02-17T08:22:12.951 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 -- start start 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6181045b0 0x7fe61819b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61ee76640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe618109a30 con 0x7fe6181045b0 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61cbeb640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6181045b0 0x7fe61819b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61cbeb640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6181045b0 0x7fe61819b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44890/0 (socket says 10.20.193.16:44890) 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61cbeb640 1 -- 10.20.193.16:0/1036444227 learned_addr learned my addr 10.20.193.16:0/1036444227 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61cbeb640 1 -- 10.20.193.16:0/1036444227 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61819b6d0 con 0x7fe6181045b0 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.948+0000 7fe61cbeb640 1 --2- 10.20.193.16:0/1036444227 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6181045b0 0x7fe61819b190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe608002410 tx=0x7fe608004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.949+0000 7fe60dffb640 1 -- 10.20.193.16:0/1036444227 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe608038510 con 0x7fe6181045b0 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.949+0000 7fe61ee76640 1 -- 10.20.193.16:0/1036444227 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61819b960 con 0x7fe6181045b0 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.949+0000 7fe60dffb640 1 -- 10.20.193.16:0/1036444227 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe608046070 con 0x7fe6181045b0 2026-02-17T08:22:12.952 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.949+0000 7fe60dffb640 1 -- 10.20.193.16:0/1036444227 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe608041730 con 0x7fe6181045b0 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.949+0000 7fe61ee76640 1 -- 10.20.193.16:0/1036444227 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe61819e650 con 0x7fe6181045b0 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.949+0000 7fe61ee76640 1 -- 10.20.193.16:0/1036444227 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61810a1d0 con 0x7fe6181045b0 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.949+0000 7fe60dffb640 1 -- 10.20.193.16:0/1036444227 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7fe6080386b0 con 0x7fe6181045b0 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.949+0000 7fe60dffb640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.950+0000 7fe60dffb640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.950+0000 7fe60dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.950+0000 7fe60dffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.950+0000 7fe60dffb640 1 --2- 10.20.193.16:0/1036444227 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5f403dd90 0x7fe5f4040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.950+0000 7fe60dffb640 1 -- 10.20.193.16:0/1036444227 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe6080771f0 con 0x7fe6181045b0 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.950+0000 7fe60ffff640 1 --2- 10.20.193.16:0/1036444227 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5f403dd90 0x7fe5f4040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:12.953 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.950+0000 7fe60ffff640 1 --2- 10.20.193.16:0/1036444227 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5f403dd90 0x7fe5f4040250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6000099c0 tx=0x7fe600006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:12.954 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:12.952+0000 7fe60dffb640 1 -- 10.20.193.16:0/1036444227 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe608007c50 con 0x7fe6181045b0 2026-02-17T08:22:13.044 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.043+0000 7fe61ee76640 20 mgrc start_command cmd: [{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:13.044 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.043+0000 7fe61ee76640 1 -- 10.20.193.16:0/1036444227 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fe6181947c0 con 0x7fe5f403dd90 2026-02-17T08:22:13.046 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.045+0000 7fe60dffb640 1 -- 10.20.193.16:0/1036444227 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe6181947c0 con 0x7fe5f403dd90 2026-02-17T08:22:13.046 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.045+0000 7fe60dffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:13.048 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 10 mgrc shutdown 2026-02-17T08:22:13.048 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 1 -- 10.20.193.16:0/1036444227 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5f403dd90 msgr2=0x7fe5f4040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:13.048 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 1 --2- 10.20.193.16:0/1036444227 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5f403dd90 0x7fe5f4040250 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6000099c0 tx=0x7fe600006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:13.048 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 1 -- 10.20.193.16:0/1036444227 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6181045b0 msgr2=0x7fe61819b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:13.048 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 1 --2- 10.20.193.16:0/1036444227 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6181045b0 0x7fe61819b190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe608002410 tx=0x7fe608004290 comp rx=0 tx=0).stop 2026-02-17T08:22:13.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 1 -- 10.20.193.16:0/1036444227 shutdown_connections 2026-02-17T08:22:13.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 1 --2- 10.20.193.16:0/1036444227 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5f403dd90 0x7fe5f4040250 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:13.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 1 --2- 10.20.193.16:0/1036444227 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6181045b0 0x7fe61819b190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:13.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 1 -- 10.20.193.16:0/1036444227 >> 10.20.193.16:0/1036444227 conn(0x7fe6180ffd70 msgr2=0x7fe618100410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:13.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 1 -- 10.20.193.16:0/1036444227 shutdown_connections 2026-02-17T08:22:13.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.047+0000 7fe61ee76640 1 -- 10.20.193.16:0/1036444227 wait complete. 2026-02-17T08:22:13.083 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial134 2026-02-17T08:22:13.084 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:22:13.084 DEBUG:teuthology.orchestra.run.trial134:> dd of=/etc/ceph/ceph.conf 2026-02-17T08:22:13.102 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:22:13.103 DEBUG:teuthology.orchestra.run.trial134:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T08:22:13.158 INFO:tasks.cephadm:Adding host trial134 to orchestrator... 2026-02-17T08:22:13.159 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph orch host add trial134 2026-02-17T08:22:13.306 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:13.413 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.410+0000 7fa6fb875640 1 -- 10.20.193.16:0/1957463466 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa6f41011f0 msgr2=0x7fa6f41015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:13.413 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.410+0000 7fa6fb875640 1 --2- 10.20.193.16:0/1957463466 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa6f41011f0 0x7fa6f41015f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40099b0 tx=0x7fa6e402f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.410+0000 7fa6fb875640 1 -- 10.20.193.16:0/1957463466 shutdown_connections 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.410+0000 7fa6fb875640 1 --2- 10.20.193.16:0/1957463466 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa6f41011f0 0x7fa6f41015f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.410+0000 7fa6fb875640 1 -- 10.20.193.16:0/1957463466 >> 10.20.193.16:0/1957463466 conn(0x7fa6f40fc9a0 msgr2=0x7fa6f40fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.410+0000 7fa6fb875640 1 -- 10.20.193.16:0/1957463466 shutdown_connections 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.410+0000 7fa6fb875640 1 -- 10.20.193.16:0/1957463466 wait complete. 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6fb875640 1 Processor -- start 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6fb875640 1 -- start start 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6fb875640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa6f41011f0 0x7fa6f419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6fb875640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4106670 con 0x7fa6f41011f0 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6f95ea640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa6f41011f0 0x7fa6f419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:13.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6f95ea640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa6f41011f0 0x7fa6f419b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44902/0 (socket says 10.20.193.16:44902) 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6f95ea640 1 -- 10.20.193.16:0/1385385739 learned_addr learned my addr 10.20.193.16:0/1385385739 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6f95ea640 1 -- 10.20.193.16:0/1385385739 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f419b6e0 con 0x7fa6f41011f0 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6f95ea640 1 --2- 10.20.193.16:0/1385385739 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa6f41011f0 0x7fa6f419b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4002410 tx=0x7fa6e4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6e27fc640 1 -- 10.20.193.16:0/1385385739 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6e4038510 con 0x7fa6f41011f0 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6e27fc640 1 -- 10.20.193.16:0/1385385739 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa6e4046070 con 0x7fa6f41011f0 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6e27fc640 1 -- 10.20.193.16:0/1385385739 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6e4041730 con 0x7fa6f41011f0 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6fb875640 1 -- 10.20.193.16:0/1385385739 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f419b970 con 0x7fa6f41011f0 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.411+0000 7fa6fb875640 1 -- 10.20.193.16:0/1385385739 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f419e660 con 0x7fa6f41011f0 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.412+0000 7fa6fb875640 1 -- 10.20.193.16:0/1385385739 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f419be50 con 0x7fa6f41011f0 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.412+0000 7fa6e27fc640 1 -- 10.20.193.16:0/1385385739 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7fa6e40386b0 con 0x7fa6f41011f0 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.412+0000 7fa6e27fc640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T08:22:13.415 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.412+0000 7fa6e27fc640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T08:22:13.416 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.412+0000 7fa6e27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:13.416 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.412+0000 7fa6e27fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:13.416 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.412+0000 7fa6e27fc640 1 --2- 10.20.193.16:0/1385385739 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa6d003dde0 0x7fa6d00402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:13.416 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.412+0000 7fa6e27fc640 1 -- 10.20.193.16:0/1385385739 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa6e4077160 con 0x7fa6f41011f0 2026-02-17T08:22:13.416 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.412+0000 7fa6f8de9640 1 --2- 10.20.193.16:0/1385385739 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa6d003dde0 0x7fa6d00402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:13.416 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.412+0000 7fa6f8de9640 1 --2- 10.20.193.16:0/1385385739 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa6d003dde0 0x7fa6d00402a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80099c0 tx=0x7fa6e8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:13.416 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.415+0000 7fa6e27fc640 1 -- 10.20.193.16:0/1385385739 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa6f419be50 con 0x7fa6f41011f0 2026-02-17T08:22:13.510 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.510+0000 7fa6fb875640 20 mgrc start_command cmd: [{"prefix": "orch host add", "hostname": "trial134", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:13.510 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:13.510+0000 7fa6fb875640 1 -- 10.20.193.16:0/1385385739 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial134", "target": ["mon-mgr", ""]}) -- 0x7fa6f406b210 con 0x7fa6d003dde0 2026-02-17T08:22:13.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:13.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:13.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial016", "name": "osd_memory_target"}]: dispatch 2026-02-17T08:22:13.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:13.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:13.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:13.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1743028530' entity='client.admin' 2026-02-17T08:22:13.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:13.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:13.870 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:13.870 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:13.870 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:13.870 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:13.870 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T08:22:13.870 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: Updating trial016:/etc/ceph/ceph.conf 2026-02-17T08:22:13.870 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: Updating trial016:/var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/config/ceph.conf 2026-02-17T08:22:13.870 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: Updating trial016:/etc/ceph/ceph.client.admin.keyring 2026-02-17T08:22:13.870 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:13 trial016 ceph-mon[39048]: Updating trial016:/var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T08:22:14.868 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:14 trial016 ceph-mon[39048]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial134", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:14.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:14 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:14.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:14 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:14.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:14 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:14.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:14 trial016 ceph-mon[39048]: Deploying cephadm binary to trial134 2026-02-17T08:22:14.987 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.987+0000 7fa6e27fc640 1 -- 10.20.193.16:0/1385385739 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fa6f406b210 con 0x7fa6d003dde0 2026-02-17T08:22:14.987 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.987+0000 7fa6e27fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:14.988 INFO:teuthology.orchestra.run.trial016.stdout:Added host 'trial134' with addr '10.20.193.134' 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 10 mgrc shutdown 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 1 -- 10.20.193.16:0/1385385739 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa6d003dde0 msgr2=0x7fa6d00402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 1 --2- 10.20.193.16:0/1385385739 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa6d003dde0 0x7fa6d00402a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80099c0 tx=0x7fa6e8006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 1 -- 10.20.193.16:0/1385385739 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa6f41011f0 msgr2=0x7fa6f419b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 1 --2- 10.20.193.16:0/1385385739 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa6f41011f0 0x7fa6f419b1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4002410 tx=0x7fa6e4004290 comp rx=0 tx=0).stop 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 1 -- 10.20.193.16:0/1385385739 shutdown_connections 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 1 --2- 10.20.193.16:0/1385385739 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa6d003dde0 0x7fa6d00402a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 1 --2- 10.20.193.16:0/1385385739 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa6f41011f0 0x7fa6f419b1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 1 -- 10.20.193.16:0/1385385739 >> 10.20.193.16:0/1385385739 conn(0x7fa6f40fc9a0 msgr2=0x7fa6f40fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 1 -- 10.20.193.16:0/1385385739 shutdown_connections 2026-02-17T08:22:14.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:14.991+0000 7fa6fb875640 1 -- 10.20.193.16:0/1385385739 wait complete. 2026-02-17T08:22:15.029 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-17T08:22:15.177 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:15.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.281+0000 7f9585e15640 1 -- 10.20.193.16:0/3111632409 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9580077620 msgr2=0x7f9580077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:15.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.281+0000 7f9585e15640 1 --2- 10.20.193.16:0/3111632409 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9580077620 0x7f9580077a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f956c0099b0 tx=0x7f956c02f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:15.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.281+0000 7f9585e15640 1 -- 10.20.193.16:0/3111632409 shutdown_connections 2026-02-17T08:22:15.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.281+0000 7f9585e15640 1 --2- 10.20.193.16:0/3111632409 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9580077620 0x7f9580077a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:15.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.281+0000 7f9585e15640 1 -- 10.20.193.16:0/3111632409 >> 10.20.193.16:0/3111632409 conn(0x7f9580100290 msgr2=0x7f95801026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:15.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.281+0000 7f9585e15640 1 -- 10.20.193.16:0/3111632409 shutdown_connections 2026-02-17T08:22:15.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.281+0000 7f9585e15640 1 -- 10.20.193.16:0/3111632409 wait complete. 2026-02-17T08:22:15.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f9585e15640 1 Processor -- start 2026-02-17T08:22:15.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f9585e15640 1 -- start start 2026-02-17T08:22:15.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f9585e15640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9580077620 0x7f958019fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:15.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f9585e15640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f95801124c0 con 0x7f9580077620 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f957f7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9580077620 0x7f958019fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f957f7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9580077620 0x7f958019fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44918/0 (socket says 10.20.193.16:44918) 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f957f7fe640 1 -- 10.20.193.16:0/3837126639 learned_addr learned my addr 10.20.193.16:0/3837126639 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f957f7fe640 1 -- 10.20.193.16:0/3837126639 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95801a00b0 con 0x7f9580077620 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f957f7fe640 1 --2- 10.20.193.16:0/3837126639 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9580077620 0x7f958019fb70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f956c004290 tx=0x7f956c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f957cff9640 1 -- 10.20.193.16:0/3837126639 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f956c038510 con 0x7f9580077620 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f957cff9640 1 -- 10.20.193.16:0/3837126639 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f956c046070 con 0x7f9580077620 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f9585e15640 1 -- 10.20.193.16:0/3837126639 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95801a0340 con 0x7f9580077620 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.282+0000 7f957cff9640 1 -- 10.20.193.16:0/3837126639 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f956c041610 con 0x7f9580077620 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.283+0000 7f9585e15640 1 -- 10.20.193.16:0/3837126639 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95801a07a0 con 0x7f9580077620 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.283+0000 7f9585e15640 1 -- 10.20.193.16:0/3837126639 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9580078d60 con 0x7f9580077620 2026-02-17T08:22:15.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.283+0000 7f957cff9640 1 -- 10.20.193.16:0/3837126639 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7f956c0386b0 con 0x7f9580077620 2026-02-17T08:22:15.287 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.283+0000 7f957cff9640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T08:22:15.287 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.283+0000 7f957cff9640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T08:22:15.287 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.283+0000 7f957cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:15.287 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.283+0000 7f957cff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:15.287 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.283+0000 7f957cff9640 1 --2- 10.20.193.16:0/3837126639 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f955403dd90 0x7f9554040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:15.287 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.283+0000 7f957cff9640 1 -- 10.20.193.16:0/3837126639 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f956c077120 con 0x7f9580077620 2026-02-17T08:22:15.287 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.283+0000 7f957effd640 1 --2- 10.20.193.16:0/3837126639 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f955403dd90 0x7f9554040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:15.287 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.284+0000 7f957effd640 1 --2- 10.20.193.16:0/3837126639 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f955403dd90 0x7f9554040250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f95700099c0 tx=0x7f9570006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:15.288 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.286+0000 7f957cff9640 1 -- 10.20.193.16:0/3837126639 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f956c04ade0 con 0x7f9580077620 2026-02-17T08:22:15.372 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.371+0000 7f9585e15640 20 mgrc start_command cmd: [{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-17T08:22:15.372 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.371+0000 7f9585e15640 1 -- 10.20.193.16:0/3837126639 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9580077a80 con 0x7f955403dd90 2026-02-17T08:22:15.372 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.372+0000 7f957cff9640 1 -- 10.20.193.16:0/3837126639 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f9580077a80 con 0x7f955403dd90 2026-02-17T08:22:15.373 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.372+0000 7f957cff9640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:15.373 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:15.373 INFO:teuthology.orchestra.run.trial016.stdout:[{"addr": "10.20.193.16", "hostname": "trial016", "labels": [], "status": ""}, {"addr": "10.20.193.134", "hostname": "trial134", "labels": [], "status": ""}] 2026-02-17T08:22:15.374 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 10 mgrc shutdown 2026-02-17T08:22:15.374 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 1 -- 10.20.193.16:0/3837126639 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f955403dd90 msgr2=0x7f9554040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:15.374 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 1 --2- 10.20.193.16:0/3837126639 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f955403dd90 0x7f9554040250 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f95700099c0 tx=0x7f9570006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:15.374 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 1 -- 10.20.193.16:0/3837126639 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9580077620 msgr2=0x7f958019fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:15.374 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 1 --2- 10.20.193.16:0/3837126639 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9580077620 0x7f958019fb70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f956c004290 tx=0x7f956c0042c0 comp rx=0 tx=0).stop 2026-02-17T08:22:15.375 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 1 -- 10.20.193.16:0/3837126639 shutdown_connections 2026-02-17T08:22:15.375 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 1 --2- 10.20.193.16:0/3837126639 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f955403dd90 0x7f9554040250 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:15.375 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 1 --2- 10.20.193.16:0/3837126639 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f9580077620 0x7f958019fb70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:15.375 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 1 -- 10.20.193.16:0/3837126639 >> 10.20.193.16:0/3837126639 conn(0x7f9580100290 msgr2=0x7f9580110560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:15.375 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 1 -- 10.20.193.16:0/3837126639 shutdown_connections 2026-02-17T08:22:15.375 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.373+0000 7f9585e15640 1 -- 10.20.193.16:0/3837126639 wait complete. 2026-02-17T08:22:15.409 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-17T08:22:15.410 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd crush tunables default 2026-02-17T08:22:15.558 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:15.665 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.661+0000 7f4b1ebba640 1 -- 10.20.193.16:0/511668098 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4b18077620 msgr2=0x7f4b18077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:15.665 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.661+0000 7f4b1ebba640 1 --2- 10.20.193.16:0/511668098 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4b18077620 0x7f4b18077a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4b080099b0 tx=0x7f4b0802f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:15.665 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.661+0000 7f4b1ebba640 1 -- 10.20.193.16:0/511668098 shutdown_connections 2026-02-17T08:22:15.665 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.661+0000 7f4b1ebba640 1 --2- 10.20.193.16:0/511668098 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4b18077620 0x7f4b18077a00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:15.665 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.661+0000 7f4b1ebba640 1 -- 10.20.193.16:0/511668098 >> 10.20.193.16:0/511668098 conn(0x7f4b18100290 msgr2=0x7f4b181026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:15.665 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.661+0000 7f4b1ebba640 1 -- 10.20.193.16:0/511668098 shutdown_connections 2026-02-17T08:22:15.665 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.661+0000 7f4b1ebba640 1 -- 10.20.193.16:0/511668098 wait complete. 2026-02-17T08:22:15.665 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1ebba640 1 Processor -- start 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1ebba640 1 -- start start 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1ebba640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4b18077620 0x7f4b1819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1ebba640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181124c0 con 0x7f4b18077620 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1c92f640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4b18077620 0x7f4b1819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1c92f640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4b18077620 0x7f4b1819fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44944/0 (socket says 10.20.193.16:44944) 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1c92f640 1 -- 10.20.193.16:0/2675253390 learned_addr learned my addr 10.20.193.16:0/2675253390 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1c92f640 1 -- 10.20.193.16:0/2675253390 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b181a00b0 con 0x7f4b18077620 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1c92f640 1 --2- 10.20.193.16:0/2675253390 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4b18077620 0x7f4b1819fb70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4b08004290 tx=0x7f4b080042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b0dffb640 1 -- 10.20.193.16:0/2675253390 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b08038510 con 0x7f4b18077620 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1ebba640 1 -- 10.20.193.16:0/2675253390 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b181a0340 con 0x7f4b18077620 2026-02-17T08:22:15.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b0dffb640 1 -- 10.20.193.16:0/2675253390 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f4b08046070 con 0x7f4b18077620 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b0dffb640 1 -- 10.20.193.16:0/2675253390 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b08041610 con 0x7f4b18077620 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.662+0000 7f4b1ebba640 1 -- 10.20.193.16:0/2675253390 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b181a07a0 con 0x7f4b18077620 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.663+0000 7f4b1ebba640 1 -- 10.20.193.16:0/2675253390 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b18078d60 con 0x7f4b18077620 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.663+0000 7f4b0dffb640 1 -- 10.20.193.16:0/2675253390 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 12) ==== 50338+0+0 (secure 0 0 0) 0x7f4b080386b0 con 0x7f4b18077620 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.663+0000 7f4b0dffb640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.663+0000 7f4b0dffb640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.663+0000 7f4b0dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.663+0000 7f4b0dffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.663+0000 7f4b0dffb640 1 --2- 10.20.193.16:0/2675253390 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4af403dd90 0x7f4af4040250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.663+0000 7f4b0dffb640 1 -- 10.20.193.16:0/2675253390 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4b08077120 con 0x7f4b18077620 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.663+0000 7f4b0ffff640 1 --2- 10.20.193.16:0/2675253390 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4af403dd90 0x7f4af4040250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:15.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.663+0000 7f4b0ffff640 1 --2- 10.20.193.16:0/2675253390 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4af403dd90 0x7f4af4040250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4b000099c0 tx=0x7f4b00006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:15.668 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.666+0000 7f4b0dffb640 1 -- 10.20.193.16:0/2675253390 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4b0804ade0 con 0x7f4b18077620 2026-02-17T08:22:15.754 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.753+0000 7f4b1ebba640 1 -- 10.20.193.16:0/2675253390 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f4b18077a80 con 0x7f4b18077620 2026-02-17T08:22:15.992 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.991+0000 7f4b0dffb640 1 -- 10.20.193.16:0/2675253390 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f4b0804b460 con 0x7f4b18077620 2026-02-17T08:22:15.993 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.991+0000 7f4b0dffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:15.993 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.991+0000 7f4b0dffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:15.993 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:15.991+0000 7f4b0dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:16.311 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.310+0000 7f4b0dffb640 1 -- 10.20.193.16:0/2675253390 <== mon.0 v2:10.20.193.16:3300/0 8 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f4b0804fd10 con 0x7f4b18077620 2026-02-17T08:22:16.311 INFO:teuthology.orchestra.run.trial016.stderr:adjusted tunables profile to default 2026-02-17T08:22:16.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:15 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:16.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:15 trial016 ceph-mon[39048]: Added host trial134 2026-02-17T08:22:16.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:15 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:16.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:15 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:16.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:15 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:16.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:15 trial016 ceph-mon[39048]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T08:22:16.312 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:15 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/2675253390' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-17T08:22:16.314 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 10 mgrc shutdown 2026-02-17T08:22:16.314 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 1 -- 10.20.193.16:0/2675253390 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4af403dd90 msgr2=0x7f4af4040250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:16.314 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 1 --2- 10.20.193.16:0/2675253390 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4af403dd90 0x7f4af4040250 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4b000099c0 tx=0x7f4b00006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:16.314 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 1 -- 10.20.193.16:0/2675253390 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4b18077620 msgr2=0x7f4b1819fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:16.314 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 1 --2- 10.20.193.16:0/2675253390 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4b18077620 0x7f4b1819fb70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4b08004290 tx=0x7f4b080042c0 comp rx=0 tx=0).stop 2026-02-17T08:22:16.315 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 1 -- 10.20.193.16:0/2675253390 shutdown_connections 2026-02-17T08:22:16.315 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 1 --2- 10.20.193.16:0/2675253390 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4af403dd90 0x7f4af4040250 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:16.315 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 1 --2- 10.20.193.16:0/2675253390 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4b18077620 0x7f4b1819fb70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:16.315 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 1 -- 10.20.193.16:0/2675253390 >> 10.20.193.16:0/2675253390 conn(0x7f4b18100290 msgr2=0x7f4b18110560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:16.315 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 1 -- 10.20.193.16:0/2675253390 shutdown_connections 2026-02-17T08:22:16.315 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:16.313+0000 7f4b1ebba640 1 -- 10.20.193.16:0/2675253390 wait complete. 2026-02-17T08:22:16.353 INFO:tasks.cephadm:Adding mon.a on trial016 2026-02-17T08:22:16.354 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph orch apply mon '1;trial016:10.20.193.16=a' 2026-02-17T08:22:16.559 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T08:22:16.593 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T08:22:16.703 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.698+0000 7f5362403640 1 -- 10.20.193.134:0/3181094016 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f535c0770a0 msgr2=0x7f535c075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:16.703 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.698+0000 7f5362403640 1 --2- 10.20.193.134:0/3181094016 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f535c0770a0 0x7f535c075500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53480099b0 tx=0x7f534802f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:16.703 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.698+0000 7f5362403640 1 -- 10.20.193.134:0/3181094016 shutdown_connections 2026-02-17T08:22:16.703 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.698+0000 7f5362403640 1 --2- 10.20.193.134:0/3181094016 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f535c0770a0 0x7f535c075500 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:16.703 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.698+0000 7f5362403640 1 -- 10.20.193.134:0/3181094016 >> 10.20.193.134:0/3181094016 conn(0x7f535c0fdae0 msgr2=0x7f535c0fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:16.704 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.698+0000 7f5362403640 1 -- 10.20.193.134:0/3181094016 shutdown_connections 2026-02-17T08:22:16.704 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.698+0000 7f5362403640 1 -- 10.20.193.134:0/3181094016 wait complete. 2026-02-17T08:22:16.704 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.698+0000 7f5362403640 1 Processor -- start 2026-02-17T08:22:16.704 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.698+0000 7f5362403640 1 -- start start 2026-02-17T08:22:16.704 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f5362403640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f535c0770a0 0x7f535c19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:16.704 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f5362403640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f535c109a10 con 0x7f535c0770a0 2026-02-17T08:22:16.704 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f535bfff640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f535c0770a0 0x7f535c19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:16.704 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f535bfff640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f535c0770a0 0x7f535c19b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.134:58792/0 (socket says 10.20.193.134:58792) 2026-02-17T08:22:16.704 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f535bfff640 1 -- 10.20.193.134:0/3871240929 learned_addr learned my addr 10.20.193.134:0/3871240929 (peer_addr_for_me v2:10.20.193.134:0/0) 2026-02-17T08:22:16.704 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f535bfff640 1 -- 10.20.193.134:0/3871240929 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c19b730 con 0x7f535c0770a0 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f535bfff640 1 --2- 10.20.193.134:0/3871240929 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f535c0770a0 0x7f535c19b1f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5348009ae0 tx=0x7f5348004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f53597fa640 1 -- 10.20.193.134:0/3871240929 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5348038640 con 0x7f535c0770a0 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f53597fa640 1 -- 10.20.193.134:0/3871240929 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f5348046070 con 0x7f535c0770a0 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f5362403640 1 -- 10.20.193.134:0/3871240929 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535c19b9c0 con 0x7f535c0770a0 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f53597fa640 1 -- 10.20.193.134:0/3871240929 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5348041780 con 0x7f535c0770a0 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.699+0000 7f5362403640 1 -- 10.20.193.134:0/3871240929 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535c19e6b0 con 0x7f535c0770a0 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.700+0000 7f5362403640 1 -- 10.20.193.134:0/3871240929 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535c10a1b0 con 0x7f535c0770a0 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.700+0000 7f53597fa640 1 -- 10.20.193.134:0/3871240929 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f53480387e0 con 0x7f535c0770a0 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.700+0000 7f53597fa640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.700+0000 7f53597fa640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.700+0000 7f53597fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:16.705 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.700+0000 7f53597fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:16.706 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.700+0000 7f53597fa640 1 --2- 10.20.193.134:0/3871240929 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f533003de80 0x7f5330040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:16.706 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.700+0000 7f53597fa640 1 -- 10.20.193.134:0/3871240929 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f53480773d0 con 0x7f535c0770a0 2026-02-17T08:22:16.706 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.700+0000 7f535b7fe640 1 --2- 10.20.193.134:0/3871240929 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f533003de80 0x7f5330040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:16.706 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.701+0000 7f535b7fe640 1 --2- 10.20.193.134:0/3871240929 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f533003de80 0x7f5330040340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f534c0099c0 tx=0x7f534c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:16.706 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.703+0000 7f53597fa640 1 -- 10.20.193.134:0/3871240929 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5348050020 con 0x7f535c0770a0 2026-02-17T08:22:16.797 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.794+0000 7f5362403640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial016:10.20.193.16=a", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:16.797 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.794+0000 7f5362403640 1 -- 10.20.193.134:0/3871240929 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "1;trial016:10.20.193.16=a", "target": ["mon-mgr", ""]}) -- 0x7f535c194770 con 0x7f533003de80 2026-02-17T08:22:16.802 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.800+0000 7f53597fa640 1 -- 10.20.193.134:0/3871240929 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f535c194770 con 0x7f533003de80 2026-02-17T08:22:16.803 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.800+0000 7f53597fa640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:16.804 INFO:teuthology.orchestra.run.trial134.stdout:Scheduled mon update... 2026-02-17T08:22:16.805 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 10 mgrc shutdown 2026-02-17T08:22:16.806 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 1 -- 10.20.193.134:0/3871240929 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f533003de80 msgr2=0x7f5330040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:16.806 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 1 --2- 10.20.193.134:0/3871240929 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f533003de80 0x7f5330040340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f534c0099c0 tx=0x7f534c006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:16.806 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 1 -- 10.20.193.134:0/3871240929 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f535c0770a0 msgr2=0x7f535c19b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:16.806 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 1 --2- 10.20.193.134:0/3871240929 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f535c0770a0 0x7f535c19b1f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5348009ae0 tx=0x7f5348004290 comp rx=0 tx=0).stop 2026-02-17T08:22:16.806 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 1 -- 10.20.193.134:0/3871240929 shutdown_connections 2026-02-17T08:22:16.807 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 1 --2- 10.20.193.134:0/3871240929 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f533003de80 0x7f5330040340 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:16.807 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 1 --2- 10.20.193.134:0/3871240929 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f535c0770a0 0x7f535c19b1f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:16.807 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 1 -- 10.20.193.134:0/3871240929 >> 10.20.193.134:0/3871240929 conn(0x7f535c0fdae0 msgr2=0x7f535c0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:16.807 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 1 -- 10.20.193.134:0/3871240929 shutdown_connections 2026-02-17T08:22:16.807 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:16.801+0000 7f5362403640 1 -- 10.20.193.134:0/3871240929 wait complete. 2026-02-17T08:22:16.856 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-02-17T08:22:16.856 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T08:22:17.002 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T08:22:17.050 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T08:22:17.155 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.150+0000 7fe60d392640 1 -- 10.20.193.134:0/4271446479 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6081045e0 msgr2=0x7fe6081049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:17.155 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.150+0000 7fe60d392640 1 --2- 10.20.193.134:0/4271446479 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6081045e0 0x7fe6081049e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0099b0 tx=0x7fe5fc02f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.155 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe60d392640 1 -- 10.20.193.134:0/4271446479 shutdown_connections 2026-02-17T08:22:17.155 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe60d392640 1 --2- 10.20.193.134:0/4271446479 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6081045e0 0x7fe6081049e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.155 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe60d392640 1 -- 10.20.193.134:0/4271446479 >> 10.20.193.134:0/4271446479 conn(0x7fe6080ffd70 msgr2=0x7fe6081021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe60d392640 1 -- 10.20.193.134:0/4271446479 shutdown_connections 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe60d392640 1 -- 10.20.193.134:0/4271446479 wait complete. 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe60d392640 1 Processor -- start 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe60d392640 1 -- start start 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe60d392640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6081045e0 0x7fe60819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe60d392640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe608109a60 con 0x7fe6081045e0 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe606ffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6081045e0 0x7fe60819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe606ffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6081045e0 0x7fe60819b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.134:58800/0 (socket says 10.20.193.134:58800) 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.151+0000 7fe606ffd640 1 -- 10.20.193.134:0/2010842197 learned_addr learned my addr 10.20.193.134:0/2010842197 (peer_addr_for_me v2:10.20.193.134:0/0) 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.152+0000 7fe606ffd640 1 -- 10.20.193.134:0/2010842197 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60819b6e0 con 0x7fe6081045e0 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.152+0000 7fe606ffd640 1 --2- 10.20.193.134:0/2010842197 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6081045e0 0x7fe60819b1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc002410 tx=0x7fe5fc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:17.156 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.152+0000 7fe5dffff640 1 -- 10.20.193.134:0/2010842197 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5fc038510 con 0x7fe6081045e0 2026-02-17T08:22:17.157 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.152+0000 7fe60d392640 1 -- 10.20.193.134:0/2010842197 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60819b970 con 0x7fe6081045e0 2026-02-17T08:22:17.157 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.152+0000 7fe60d392640 1 -- 10.20.193.134:0/2010842197 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60819e660 con 0x7fe6081045e0 2026-02-17T08:22:17.157 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.152+0000 7fe5dffff640 1 -- 10.20.193.134:0/2010842197 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe5fc046070 con 0x7fe6081045e0 2026-02-17T08:22:17.157 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.152+0000 7fe5dffff640 1 -- 10.20.193.134:0/2010842197 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5fc04b600 con 0x7fe6081045e0 2026-02-17T08:22:17.157 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.152+0000 7fe60d392640 1 -- 10.20.193.134:0/2010842197 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60819be50 con 0x7fe6081045e0 2026-02-17T08:22:17.158 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.153+0000 7fe5dffff640 1 -- 10.20.193.134:0/2010842197 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fe5fc0386b0 con 0x7fe6081045e0 2026-02-17T08:22:17.158 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.153+0000 7fe5dffff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:17.158 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.153+0000 7fe5dffff640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:17.158 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.153+0000 7fe5dffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:17.158 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.153+0000 7fe5dffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:17.159 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.153+0000 7fe5dffff640 1 --2- 10.20.193.134:0/2010842197 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5d803de80 0x7fe5d8040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:17.159 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.153+0000 7fe5dffff640 1 -- 10.20.193.134:0/2010842197 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe5fc077270 con 0x7fe6081045e0 2026-02-17T08:22:17.159 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.153+0000 7fe6067fc640 1 --2- 10.20.193.134:0/2010842197 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5d803de80 0x7fe5d8040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:17.159 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.154+0000 7fe6067fc640 1 --2- 10.20.193.134:0/2010842197 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5d803de80 0x7fe5d8040340 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00099c0 tx=0x7fe5f0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:17.159 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.155+0000 7fe5dffff640 1 -- 10.20.193.134:0/2010842197 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe60819be50 con 0x7fe6081045e0 2026-02-17T08:22:17.275 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.273+0000 7fe60d392640 1 -- 10.20.193.134:0/2010842197 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe60810a200 con 0x7fe6081045e0 2026-02-17T08:22:17.276 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.273+0000 7fe5dffff640 1 -- 10.20.193.134:0/2010842197 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7fe5fc050020 con 0x7fe6081045e0 2026-02-17T08:22:17.276 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:22:17.276 INFO:teuthology.orchestra.run.trial134.stdout:{"epoch":1,"fsid":"ad06c547-0bd9-11f1-adc2-d404e6e7d460","modified":"2026-02-17T08:21:50.249033Z","created":"2026-02-17T08:21:50.249033Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:3300","nonce":0},{"type":"v1","addr":"10.20.193.16:6789","nonce":0}]},"addr":"10.20.193.16:6789/0","public_addr":"10.20.193.16:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T08:22:17.277 INFO:teuthology.orchestra.run.trial134.stderr:dumped monmap epoch 1 2026-02-17T08:22:17.277 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 10 mgrc shutdown 2026-02-17T08:22:17.278 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 1 -- 10.20.193.134:0/2010842197 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5d803de80 msgr2=0x7fe5d8040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:17.278 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 1 --2- 10.20.193.134:0/2010842197 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5d803de80 0x7fe5d8040340 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00099c0 tx=0x7fe5f0006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.278 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 1 -- 10.20.193.134:0/2010842197 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6081045e0 msgr2=0x7fe60819b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:17.278 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 1 --2- 10.20.193.134:0/2010842197 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6081045e0 0x7fe60819b1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc002410 tx=0x7fe5fc004290 comp rx=0 tx=0).stop 2026-02-17T08:22:17.278 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 1 -- 10.20.193.134:0/2010842197 shutdown_connections 2026-02-17T08:22:17.278 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 1 --2- 10.20.193.134:0/2010842197 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fe5d803de80 0x7fe5d8040340 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.278 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 1 --2- 10.20.193.134:0/2010842197 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fe6081045e0 0x7fe60819b1a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.278 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 1 -- 10.20.193.134:0/2010842197 >> 10.20.193.134:0/2010842197 conn(0x7fe6080ffd70 msgr2=0x7fe6081003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:17.278 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 1 -- 10.20.193.134:0/2010842197 shutdown_connections 2026-02-17T08:22:17.278 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:17.274+0000 7fe60d392640 1 -- 10.20.193.134:0/2010842197 wait complete. 2026-02-17T08:22:17.311 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-17T08:22:17.312 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-17T08:22:17.335 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: mgrmap e13: a(active, since 6s) 2026-02-17T08:22:17.335 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:17.335 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/2675253390' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-17T08:22:17.335 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: osdmap e4: 0 total, 0 up, 0 in 2026-02-17T08:22:17.335 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:17.336 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:17.336 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:17.336 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:17.336 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:17.336 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial134", "name": "osd_memory_target"}]: dispatch 2026-02-17T08:22:17.336 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:17.336 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:16 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T08:22:17.461 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:17.577 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.573+0000 7fb0e54be640 1 -- 10.20.193.16:0/3754206258 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb0e0102520 msgr2=0x7fb0e0102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:17.577 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.573+0000 7fb0e54be640 1 --2- 10.20.193.16:0/3754206258 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb0e0102520 0x7fb0e0102900 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40099b0 tx=0x7fb0d402f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.577 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.573+0000 7fb0e54be640 1 -- 10.20.193.16:0/3754206258 shutdown_connections 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.573+0000 7fb0e54be640 1 --2- 10.20.193.16:0/3754206258 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb0e0102520 0x7fb0e0102900 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.573+0000 7fb0e54be640 1 -- 10.20.193.16:0/3754206258 >> 10.20.193.16:0/3754206258 conn(0x7fb0e0079160 msgr2=0x7fb0e0100410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.573+0000 7fb0e54be640 1 -- 10.20.193.16:0/3754206258 shutdown_connections 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.573+0000 7fb0e54be640 1 -- 10.20.193.16:0/3754206258 wait complete. 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0e54be640 1 Processor -- start 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0e54be640 1 -- start start 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0e54be640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb0e0102520 0x7fb0e019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0e54be640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e010bcd0 con 0x7fb0e0102520 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0deffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb0e0102520 0x7fb0e019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0deffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb0e0102520 0x7fb0e019b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:44966/0 (socket says 10.20.193.16:44966) 2026-02-17T08:22:17.578 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0deffd640 1 -- 10.20.193.16:0/2473548347 learned_addr learned my addr 10.20.193.16:0/2473548347 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0deffd640 1 -- 10.20.193.16:0/2473548347 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e019bb00 con 0x7fb0e0102520 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0deffd640 1 --2- 10.20.193.16:0/2473548347 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb0e0102520 0x7fb0e019b5c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4004290 tx=0x7fb0d40042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0b7fff640 1 -- 10.20.193.16:0/2473548347 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d4038510 con 0x7fb0e0102520 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0e54be640 1 -- 10.20.193.16:0/2473548347 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e019bd90 con 0x7fb0e0102520 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0b7fff640 1 -- 10.20.193.16:0/2473548347 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fb0d4046070 con 0x7fb0e0102520 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0b7fff640 1 -- 10.20.193.16:0/2473548347 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0d4041610 con 0x7fb0e0102520 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.574+0000 7fb0e54be640 1 -- 10.20.193.16:0/2473548347 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e019fe90 con 0x7fb0e0102520 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.575+0000 7fb0e54be640 1 -- 10.20.193.16:0/2473548347 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e0103a00 con 0x7fb0e0102520 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.575+0000 7fb0b7fff640 1 -- 10.20.193.16:0/2473548347 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fb0d4041910 con 0x7fb0e0102520 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.575+0000 7fb0b7fff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:17.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.575+0000 7fb0b7fff640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:17.580 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.575+0000 7fb0b7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:17.580 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.575+0000 7fb0b7fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:17.580 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.575+0000 7fb0b7fff640 1 --2- 10.20.193.16:0/2473548347 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb0b003de30 0x7fb0b00402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:17.580 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.575+0000 7fb0b7fff640 1 -- 10.20.193.16:0/2473548347 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb0d40772b0 con 0x7fb0e0102520 2026-02-17T08:22:17.580 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.575+0000 7fb0de7fc640 1 --2- 10.20.193.16:0/2473548347 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb0b003de30 0x7fb0b00402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:17.580 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.575+0000 7fb0de7fc640 1 --2- 10.20.193.16:0/2473548347 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb0b003de30 0x7fb0b00402f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80099c0 tx=0x7fb0c8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:17.580 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.577+0000 7fb0b7fff640 1 -- 10.20.193.16:0/2473548347 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb0d4047270 con 0x7fb0e0102520 2026-02-17T08:22:17.664 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.662+0000 7fb0e54be640 1 -- 10.20.193.16:0/2473548347 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fb0e0102980 con 0x7fb0e0102520 2026-02-17T08:22:17.664 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.662+0000 7fb0b7fff640 1 -- 10.20.193.16:0/2473548347 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+175 (secure 0 0 0) 0x7fb0d404a3c0 con 0x7fb0e0102520 2026-02-17T08:22:17.665 INFO:teuthology.orchestra.run.trial016.stdout:# minimal ceph.conf for ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:22:17.665 INFO:teuthology.orchestra.run.trial016.stdout:[global] 2026-02-17T08:22:17.665 INFO:teuthology.orchestra.run.trial016.stdout: fsid = ad06c547-0bd9-11f1-adc2-d404e6e7d460 2026-02-17T08:22:17.665 INFO:teuthology.orchestra.run.trial016.stdout: mon_host = [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] 2026-02-17T08:22:17.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 10 mgrc shutdown 2026-02-17T08:22:17.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 1 -- 10.20.193.16:0/2473548347 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb0b003de30 msgr2=0x7fb0b00402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:17.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 1 --2- 10.20.193.16:0/2473548347 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb0b003de30 0x7fb0b00402f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80099c0 tx=0x7fb0c8006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 1 -- 10.20.193.16:0/2473548347 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb0e0102520 msgr2=0x7fb0e019b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:17.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 1 --2- 10.20.193.16:0/2473548347 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb0e0102520 0x7fb0e019b5c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4004290 tx=0x7fb0d40042c0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 1 -- 10.20.193.16:0/2473548347 shutdown_connections 2026-02-17T08:22:17.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 1 --2- 10.20.193.16:0/2473548347 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb0b003de30 0x7fb0b00402f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 1 --2- 10.20.193.16:0/2473548347 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb0e0102520 0x7fb0e019b5c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:17.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 1 -- 10.20.193.16:0/2473548347 >> 10.20.193.16:0/2473548347 conn(0x7fb0e0079160 msgr2=0x7fb0e010a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:17.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 1 -- 10.20.193.16:0/2473548347 shutdown_connections 2026-02-17T08:22:17.667 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:17.664+0000 7fb0e54be640 1 -- 10.20.193.16:0/2473548347 wait complete. 2026-02-17T08:22:17.732 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-17T08:22:17.732 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:22:17.732 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/ceph/ceph.conf 2026-02-17T08:22:17.797 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:22:17.797 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T08:22:17.861 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:22:17.861 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/etc/ceph/ceph.conf 2026-02-17T08:22:17.889 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:22:17.889 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T08:22:17.952 INFO:tasks.cephadm:Adding mgr.a on trial016 2026-02-17T08:22:17.953 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph orch apply mgr '1;trial016=a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial016:10.20.193.16=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: Saving service mon spec with placement trial016:10.20.193.16=a;count:1 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: Updating trial134:/etc/ceph/ceph.conf 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: Updating trial134:/var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/config/ceph.conf 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: Updating trial134:/etc/ceph/ceph.client.admin.keyring 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='client.? 10.20.193.134:0/2010842197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: Updating trial134:/var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/2473548347' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T08:22:18.119 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:17 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:18.133 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/config/ceph.conf 2026-02-17T08:22:18.234 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.229+0000 7f1b85705640 1 -- 10.20.193.134:0/759112229 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1b801045b0 msgr2=0x7f1b801049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:18.234 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.229+0000 7f1b85705640 1 --2- 10.20.193.134:0/759112229 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1b801045b0 0x7f1b801049b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1b740099b0 tx=0x7f1b7402f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:18.234 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.229+0000 7f1b85705640 1 -- 10.20.193.134:0/759112229 shutdown_connections 2026-02-17T08:22:18.234 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.229+0000 7f1b85705640 1 --2- 10.20.193.134:0/759112229 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1b801045b0 0x7f1b801049b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.229+0000 7f1b85705640 1 -- 10.20.193.134:0/759112229 >> 10.20.193.134:0/759112229 conn(0x7f1b800ffd70 msgr2=0x7f1b80102180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.229+0000 7f1b85705640 1 -- 10.20.193.134:0/759112229 shutdown_connections 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.229+0000 7f1b85705640 1 -- 10.20.193.134:0/759112229 wait complete. 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.230+0000 7f1b85705640 1 Processor -- start 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.230+0000 7f1b85705640 1 -- start start 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.230+0000 7f1b85705640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1b801045b0 0x7f1b8019b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.230+0000 7f1b85705640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1b80109a30 con 0x7f1b801045b0 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.230+0000 7f1b7effd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1b801045b0 0x7f1b8019b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.230+0000 7f1b7effd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1b801045b0 0x7f1b8019b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.134:58828/0 (socket says 10.20.193.134:58828) 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.230+0000 7f1b7effd640 1 -- 10.20.193.134:0/2381385162 learned_addr learned my addr 10.20.193.134:0/2381385162 (peer_addr_for_me v2:10.20.193.134:0/0) 2026-02-17T08:22:18.235 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.230+0000 7f1b7effd640 1 -- 10.20.193.134:0/2381385162 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8019b6d0 con 0x7f1b801045b0 2026-02-17T08:22:18.236 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.231+0000 7f1b7effd640 1 --2- 10.20.193.134:0/2381385162 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1b801045b0 0x7f1b8019b190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b74005ec0 tx=0x7f1b74004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:18.236 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.231+0000 7f1b5ffff640 1 -- 10.20.193.134:0/2381385162 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b74038510 con 0x7f1b801045b0 2026-02-17T08:22:18.236 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.231+0000 7f1b85705640 1 -- 10.20.193.134:0/2381385162 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8019b960 con 0x7f1b801045b0 2026-02-17T08:22:18.236 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.231+0000 7f1b85705640 1 -- 10.20.193.134:0/2381385162 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8019e650 con 0x7f1b801045b0 2026-02-17T08:22:18.236 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.231+0000 7f1b5ffff640 1 -- 10.20.193.134:0/2381385162 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1b74046070 con 0x7f1b801045b0 2026-02-17T08:22:18.236 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.231+0000 7f1b5ffff640 1 -- 10.20.193.134:0/2381385162 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7404b7c0 con 0x7f1b801045b0 2026-02-17T08:22:18.236 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.231+0000 7f1b85705640 1 -- 10.20.193.134:0/2381385162 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8010a1d0 con 0x7f1b801045b0 2026-02-17T08:22:18.237 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.232+0000 7f1b5ffff640 1 -- 10.20.193.134:0/2381385162 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f1b7404b960 con 0x7f1b801045b0 2026-02-17T08:22:18.237 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.232+0000 7f1b5ffff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:18.237 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.232+0000 7f1b5ffff640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:18.237 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.232+0000 7f1b5ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:18.238 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.232+0000 7f1b5ffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:18.238 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.232+0000 7f1b5ffff640 1 --2- 10.20.193.134:0/2381385162 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1b5403de80 0x7f1b54040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:18.238 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.232+0000 7f1b5ffff640 1 -- 10.20.193.134:0/2381385162 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1b740777a0 con 0x7f1b801045b0 2026-02-17T08:22:18.238 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.232+0000 7f1b7e7fc640 1 --2- 10.20.193.134:0/2381385162 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1b5403de80 0x7f1b54040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:18.238 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.233+0000 7f1b7e7fc640 1 --2- 10.20.193.134:0/2381385162 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1b5403de80 0x7f1b54040340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1b680099c0 tx=0x7f1b68006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:18.238 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.235+0000 7f1b5ffff640 1 -- 10.20.193.134:0/2381385162 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1b740357c0 con 0x7f1b801045b0 2026-02-17T08:22:18.324 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.322+0000 7f1b85705640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial016=a", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:18.325 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.322+0000 7f1b85705640 1 -- 10.20.193.134:0/2381385162 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial016=a", "target": ["mon-mgr", ""]}) -- 0x7f1b8019be40 con 0x7f1b5403de80 2026-02-17T08:22:18.328 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.326+0000 7f1b5ffff640 1 -- 10.20.193.134:0/2381385162 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1b8019be40 con 0x7f1b5403de80 2026-02-17T08:22:18.328 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.326+0000 7f1b5ffff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:18.329 INFO:teuthology.orchestra.run.trial134.stdout:Scheduled mgr update... 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 10 mgrc shutdown 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 1 -- 10.20.193.134:0/2381385162 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1b5403de80 msgr2=0x7f1b54040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 1 --2- 10.20.193.134:0/2381385162 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1b5403de80 0x7f1b54040340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1b680099c0 tx=0x7f1b68006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 1 -- 10.20.193.134:0/2381385162 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1b801045b0 msgr2=0x7f1b8019b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 1 --2- 10.20.193.134:0/2381385162 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1b801045b0 0x7f1b8019b190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1b74005ec0 tx=0x7f1b74004290 comp rx=0 tx=0).stop 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 1 -- 10.20.193.134:0/2381385162 shutdown_connections 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 1 --2- 10.20.193.134:0/2381385162 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1b5403de80 0x7f1b54040340 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 1 --2- 10.20.193.134:0/2381385162 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1b801045b0 0x7f1b8019b190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 1 -- 10.20.193.134:0/2381385162 >> 10.20.193.134:0/2381385162 conn(0x7f1b800ffd70 msgr2=0x7f1b801003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 1 -- 10.20.193.134:0/2381385162 shutdown_connections 2026-02-17T08:22:18.330 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:22:18.327+0000 7f1b85705640 1 -- 10.20.193.134:0/2381385162 wait complete. 2026-02-17T08:22:18.364 INFO:tasks.cephadm:Deploying OSDs... 2026-02-17T08:22:18.364 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:22:18.364 DEBUG:teuthology.orchestra.run.trial016:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T08:22:18.380 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T08:22:18.380 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_1 2026-02-17T08:22:18.436 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T08:22:18.436 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:22:18.436 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-17T08:22:18.437 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:22:18.437 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:22:18.437 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-17 08:22:12.822061485 +0000 2026-02-17T08:22:18.437 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-17 08:20:34.255596787 +0000 2026-02-17T08:22:18.437 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-17 08:20:34.255596787 +0000 2026-02-17T08:22:18.437 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-17 08:20:34.255596787 +0000 2026-02-17T08:22:18.437 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T08:22:18.500 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-17T08:22:18.501 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-17T08:22:18.501 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000176 s, 2.9 MB/s 2026-02-17T08:22:18.503 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T08:22:18.562 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_2 2026-02-17T08:22:18.620 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T08:22:18.620 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:22:18.620 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-17T08:22:18.620 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:22:18.620 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:22:18.620 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-17 08:22:12.822061485 +0000 2026-02-17T08:22:18.620 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-17 08:20:34.254596805 +0000 2026-02-17T08:22:18.620 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-17 08:20:34.254596805 +0000 2026-02-17T08:22:18.620 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-17 08:20:34.254596805 +0000 2026-02-17T08:22:18.621 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T08:22:18.684 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-17T08:22:18.685 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-17T08:22:18.685 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000156533 s, 3.3 MB/s 2026-02-17T08:22:18.686 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T08:22:18.743 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_3 2026-02-17T08:22:18.800 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T08:22:18.800 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:22:18.801 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-17T08:22:18.801 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:22:18.801 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:22:18.801 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-17 08:22:12.822061485 +0000 2026-02-17T08:22:18.801 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-17 08:20:34.254596805 +0000 2026-02-17T08:22:18.801 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-17 08:20:34.254596805 +0000 2026-02-17T08:22:18.801 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-17 08:20:34.254596805 +0000 2026-02-17T08:22:18.801 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T08:22:18.864 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-17T08:22:18.864 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-17T08:22:18.864 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000171361 s, 3.0 MB/s 2026-02-17T08:22:18.866 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T08:22:18.923 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_4 2026-02-17T08:22:18.978 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T08:22:18.978 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:22:18.979 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-17T08:22:18.979 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:22:18.979 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:22:18.979 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-17 08:22:12.822061485 +0000 2026-02-17T08:22:18.979 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-17 08:20:34.254596805 +0000 2026-02-17T08:22:18.979 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-17 08:20:34.254596805 +0000 2026-02-17T08:22:18.979 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-17 08:20:34.254596805 +0000 2026-02-17T08:22:18.979 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T08:22:19.042 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-17T08:22:19.042 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-17T08:22:19.042 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000147716 s, 3.5 MB/s 2026-02-17T08:22:19.043 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T08:22:19.101 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:22:19.101 DEBUG:teuthology.orchestra.run.trial134:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T08:22:19.120 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T08:22:19.120 DEBUG:teuthology.orchestra.run.trial134:> stat /dev/vg_nvme/lv_1 2026-02-17T08:22:19.179 INFO:teuthology.orchestra.run.trial134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T08:22:19.179 INFO:teuthology.orchestra.run.trial134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:22:19.180 INFO:teuthology.orchestra.run.trial134.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-17T08:22:19.180 INFO:teuthology.orchestra.run.trial134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:22:19.180 INFO:teuthology.orchestra.run.trial134.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:22:19.180 INFO:teuthology.orchestra.run.trial134.stdout:Access: 2026-02-17 08:22:16.760732094 +0000 2026-02-17T08:22:19.180 INFO:teuthology.orchestra.run.trial134.stdout:Modify: 2026-02-17 08:20:35.826953584 +0000 2026-02-17T08:22:19.180 INFO:teuthology.orchestra.run.trial134.stdout:Change: 2026-02-17 08:20:35.826953584 +0000 2026-02-17T08:22:19.181 INFO:teuthology.orchestra.run.trial134.stdout: Birth: 2026-02-17 08:20:35.826953584 +0000 2026-02-17T08:22:19.181 DEBUG:teuthology.orchestra.run.trial134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T08:22:19.244 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records in 2026-02-17T08:22:19.244 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records out 2026-02-17T08:22:19.244 INFO:teuthology.orchestra.run.trial134.stderr:512 bytes copied, 0.000159226 s, 3.2 MB/s 2026-02-17T08:22:19.245 DEBUG:teuthology.orchestra.run.trial134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T08:22:19.302 DEBUG:teuthology.orchestra.run.trial134:> stat /dev/vg_nvme/lv_2 2026-02-17T08:22:19.357 INFO:teuthology.orchestra.run.trial134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T08:22:19.357 INFO:teuthology.orchestra.run.trial134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:22:19.358 INFO:teuthology.orchestra.run.trial134.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-17T08:22:19.358 INFO:teuthology.orchestra.run.trial134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:22:19.358 INFO:teuthology.orchestra.run.trial134.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:22:19.358 INFO:teuthology.orchestra.run.trial134.stdout:Access: 2026-02-17 08:22:16.760732094 +0000 2026-02-17T08:22:19.358 INFO:teuthology.orchestra.run.trial134.stdout:Modify: 2026-02-17 08:20:35.826953584 +0000 2026-02-17T08:22:19.358 INFO:teuthology.orchestra.run.trial134.stdout:Change: 2026-02-17 08:20:35.826953584 +0000 2026-02-17T08:22:19.358 INFO:teuthology.orchestra.run.trial134.stdout: Birth: 2026-02-17 08:20:35.826953584 +0000 2026-02-17T08:22:19.358 DEBUG:teuthology.orchestra.run.trial134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T08:22:19.419 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records in 2026-02-17T08:22:19.419 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records out 2026-02-17T08:22:19.419 INFO:teuthology.orchestra.run.trial134.stderr:512 bytes copied, 0.000172591 s, 3.0 MB/s 2026-02-17T08:22:19.420 DEBUG:teuthology.orchestra.run.trial134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T08:22:19.476 DEBUG:teuthology.orchestra.run.trial134:> stat /dev/vg_nvme/lv_3 2026-02-17T08:22:19.532 INFO:teuthology.orchestra.run.trial134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T08:22:19.532 INFO:teuthology.orchestra.run.trial134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:22:19.532 INFO:teuthology.orchestra.run.trial134.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-17T08:22:19.532 INFO:teuthology.orchestra.run.trial134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:22:19.532 INFO:teuthology.orchestra.run.trial134.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:22:19.532 INFO:teuthology.orchestra.run.trial134.stdout:Access: 2026-02-17 08:22:16.760732094 +0000 2026-02-17T08:22:19.532 INFO:teuthology.orchestra.run.trial134.stdout:Modify: 2026-02-17 08:20:35.826953584 +0000 2026-02-17T08:22:19.532 INFO:teuthology.orchestra.run.trial134.stdout:Change: 2026-02-17 08:20:35.826953584 +0000 2026-02-17T08:22:19.532 INFO:teuthology.orchestra.run.trial134.stdout: Birth: 2026-02-17 08:20:35.826953584 +0000 2026-02-17T08:22:19.532 DEBUG:teuthology.orchestra.run.trial134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T08:22:19.595 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records in 2026-02-17T08:22:19.596 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records out 2026-02-17T08:22:19.596 INFO:teuthology.orchestra.run.trial134.stderr:512 bytes copied, 0.000242771 s, 2.1 MB/s 2026-02-17T08:22:19.597 DEBUG:teuthology.orchestra.run.trial134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T08:22:19.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: Reconfiguring mon.a (unknown last config time)... 2026-02-17T08:22:19.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: Reconfiguring daemon mon.a on trial016 2026-02-17T08:22:19.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial016=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: Saving service mgr spec with placement trial016=a;count:1 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: Reconfiguring mgr.a (unknown last config time)... 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T08:22:19.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:19.620 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: Reconfiguring daemon mgr.a on trial016 2026-02-17T08:22:19.620 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:19.620 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:19 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:19.655 DEBUG:teuthology.orchestra.run.trial134:> stat /dev/vg_nvme/lv_4 2026-02-17T08:22:19.711 INFO:teuthology.orchestra.run.trial134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T08:22:19.711 INFO:teuthology.orchestra.run.trial134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:22:19.711 INFO:teuthology.orchestra.run.trial134.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-17T08:22:19.711 INFO:teuthology.orchestra.run.trial134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:22:19.711 INFO:teuthology.orchestra.run.trial134.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:22:19.712 INFO:teuthology.orchestra.run.trial134.stdout:Access: 2026-02-17 08:22:16.760732094 +0000 2026-02-17T08:22:19.712 INFO:teuthology.orchestra.run.trial134.stdout:Modify: 2026-02-17 08:20:35.825953601 +0000 2026-02-17T08:22:19.712 INFO:teuthology.orchestra.run.trial134.stdout:Change: 2026-02-17 08:20:35.825953601 +0000 2026-02-17T08:22:19.712 INFO:teuthology.orchestra.run.trial134.stdout: Birth: 2026-02-17 08:20:35.825953601 +0000 2026-02-17T08:22:19.712 DEBUG:teuthology.orchestra.run.trial134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T08:22:19.774 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records in 2026-02-17T08:22:19.774 INFO:teuthology.orchestra.run.trial134.stderr:1+0 records out 2026-02-17T08:22:19.774 INFO:teuthology.orchestra.run.trial134.stderr:512 bytes copied, 0.000209689 s, 2.4 MB/s 2026-02-17T08:22:19.775 DEBUG:teuthology.orchestra.run.trial134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T08:22:19.831 INFO:tasks.cephadm:Deploying osd.0 on trial016 with /dev/vg_nvme/lv_4... 2026-02-17T08:22:19.832 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-17T08:22:19.977 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:20.718 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:20.737 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph orch daemon add osd trial016:vg_nvme/lv_4 2026-02-17T08:22:20.887 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:20.996 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 -- 10.20.193.16:0/1476171154 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f457c1046a0 msgr2=0x7f457c104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:20.996 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 --2- 10.20.193.16:0/1476171154 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f457c1046a0 0x7f457c104aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f456c0099b0 tx=0x7f456c02f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:20.996 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 -- 10.20.193.16:0/1476171154 shutdown_connections 2026-02-17T08:22:20.996 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 --2- 10.20.193.16:0/1476171154 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f457c1046a0 0x7f457c104aa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:20.996 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 -- 10.20.193.16:0/1476171154 >> 10.20.193.16:0/1476171154 conn(0x7f457c0ffe30 msgr2=0x7f457c102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 -- 10.20.193.16:0/1476171154 shutdown_connections 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 -- 10.20.193.16:0/1476171154 wait complete. 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 Processor -- start 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 -- start start 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f457c1046a0 0x7f457c19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4583694640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f457c109b20 con 0x7f457c1046a0 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4581409640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f457c1046a0 0x7f457c19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4581409640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f457c1046a0 0x7f457c19b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:36430/0 (socket says 10.20.193.16:36430) 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.992+0000 7f4581409640 1 -- 10.20.193.16:0/671595155 learned_addr learned my addr 10.20.193.16:0/671595155 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.993+0000 7f4581409640 1 -- 10.20.193.16:0/671595155 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457c19b800 con 0x7f457c1046a0 2026-02-17T08:22:20.997 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.993+0000 7f4581409640 1 --2- 10.20.193.16:0/671595155 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f457c1046a0 0x7f457c19b2c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f456c005ec0 tx=0x7f456c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.993+0000 7f456a7fc640 1 -- 10.20.193.16:0/671595155 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f456c038510 con 0x7f457c1046a0 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.993+0000 7f456a7fc640 1 -- 10.20.193.16:0/671595155 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f456c046070 con 0x7f457c1046a0 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.993+0000 7f4583694640 1 -- 10.20.193.16:0/671595155 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f457c19ba90 con 0x7f457c1046a0 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.993+0000 7f456a7fc640 1 -- 10.20.193.16:0/671595155 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f456c041810 con 0x7f457c1046a0 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.993+0000 7f4583694640 1 -- 10.20.193.16:0/671595155 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f457c19e780 con 0x7f457c1046a0 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.993+0000 7f4583694640 1 -- 10.20.193.16:0/671595155 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f457c10a2c0 con 0x7f457c1046a0 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.994+0000 7f456a7fc640 1 -- 10.20.193.16:0/671595155 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f456c0386b0 con 0x7f457c1046a0 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.994+0000 7f456a7fc640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.994+0000 7f456a7fc640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.994+0000 7f456a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:20.998 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.994+0000 7f456a7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:20.999 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.994+0000 7f456a7fc640 1 --2- 10.20.193.16:0/671595155 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f455803de80 0x7f4558040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:20.999 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.994+0000 7f456a7fc640 1 -- 10.20.193.16:0/671595155 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f456c077260 con 0x7f457c1046a0 2026-02-17T08:22:20.999 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.994+0000 7f4580c08640 1 --2- 10.20.193.16:0/671595155 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f455803de80 0x7f4558040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:20.999 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.994+0000 7f4580c08640 1 --2- 10.20.193.16:0/671595155 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f455803de80 0x7f4558040340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f45700099c0 tx=0x7f4570006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:20.999 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:20.996+0000 7f456a7fc640 1 -- 10.20.193.16:0/671595155 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f456c0389d0 con 0x7f457c1046a0 2026-02-17T08:22:21.087 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:21.085+0000 7f4583694640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:21.087 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:21.085+0000 7f4583694640 1 -- 10.20.193.16:0/671595155 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f457c1948f0 con 0x7f455803de80 2026-02-17T08:22:21.270 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:21 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T08:22:21.270 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:21 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T08:22:21.270 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:21 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:22.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:22 trial016 ceph-mon[39048]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:22.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:22 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3238965113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "43ca983a-2aaa-4c28-a6a4-57b52f31e54d"}]: dispatch 2026-02-17T08:22:22.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:22 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3238965113' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43ca983a-2aaa-4c28-a6a4-57b52f31e54d"}]': finished 2026-02-17T08:22:22.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:22 trial016 ceph-mon[39048]: osdmap e5: 1 total, 0 up, 1 in 2026-02-17T08:22:22.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:22 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T08:22:22.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:22 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/316058151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T08:22:27.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:27 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-17T08:22:27.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:27 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:28.868 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:28 trial016 ceph-mon[39048]: Deploying daemon osd.0 on trial016 2026-02-17T08:22:30.368 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:30 trial016 ceph-mon[39048]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T08:22:30.368 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:30 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:30.368 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:30 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:30.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:30 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:30.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:30 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:30.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:30 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:30.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:30 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:30.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:30 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T08:22:30.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:30 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:30.508 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.507+0000 7f456a7fc640 1 -- 10.20.193.16:0/671595155 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f457c1948f0 con 0x7f455803de80 2026-02-17T08:22:30.508 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.507+0000 7f456a7fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:30.509 INFO:teuthology.orchestra.run.trial016.stdout:Created osd(s) 0 on host 'trial016' 2026-02-17T08:22:30.511 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 10 mgrc shutdown 2026-02-17T08:22:30.511 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 1 -- 10.20.193.16:0/671595155 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f455803de80 msgr2=0x7f4558040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:30.511 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 1 --2- 10.20.193.16:0/671595155 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f455803de80 0x7f4558040340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f45700099c0 tx=0x7f4570006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:30.511 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 1 -- 10.20.193.16:0/671595155 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f457c1046a0 msgr2=0x7f457c19b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:30.511 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 1 --2- 10.20.193.16:0/671595155 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f457c1046a0 0x7f457c19b2c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f456c005ec0 tx=0x7f456c004290 comp rx=0 tx=0).stop 2026-02-17T08:22:30.511 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 1 -- 10.20.193.16:0/671595155 shutdown_connections 2026-02-17T08:22:30.511 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 1 --2- 10.20.193.16:0/671595155 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f455803de80 0x7f4558040340 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:30.511 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 1 --2- 10.20.193.16:0/671595155 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f457c1046a0 0x7f457c19b2c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:30.512 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 1 -- 10.20.193.16:0/671595155 >> 10.20.193.16:0/671595155 conn(0x7f457c0ffe30 msgr2=0x7f457c1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:30.512 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 1 -- 10.20.193.16:0/671595155 shutdown_connections 2026-02-17T08:22:30.512 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:30.509+0000 7f4583694640 1 -- 10.20.193.16:0/671595155 wait complete. 2026-02-17T08:22:30.546 DEBUG:teuthology.orchestra.run.trial016:osd.0> sudo journalctl -f -n 0 -u ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@osd.0.service 2026-02-17T08:22:30.548 INFO:tasks.cephadm:Deploying osd.1 on trial016 with /dev/vg_nvme/lv_3... 2026-02-17T08:22:30.548 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-17T08:22:30.759 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:31.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:31 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:31.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:31 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:31.290 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:31 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:31.549 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:22:31 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-0[50759]: 2026-02-17T08:22:31.422+0000 7f6eabab0740 -1 Falling back to public interface 2026-02-17T08:22:31.879 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:31.895 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph orch daemon add osd trial016:vg_nvme/lv_3 2026-02-17T08:22:32.048 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:32.163 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 -- 10.20.193.16:0/80336663 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1d741046a0 msgr2=0x7f1d74104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:32.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 --2- 10.20.193.16:0/80336663 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1d741046a0 0x7f1d74104aa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1d640099b0 tx=0x7f1d6402f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:32.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 -- 10.20.193.16:0/80336663 shutdown_connections 2026-02-17T08:22:32.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 --2- 10.20.193.16:0/80336663 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1d741046a0 0x7f1d74104aa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:32.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 -- 10.20.193.16:0/80336663 >> 10.20.193.16:0/80336663 conn(0x7f1d740ffe30 msgr2=0x7f1d74102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:32.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 -- 10.20.193.16:0/80336663 shutdown_connections 2026-02-17T08:22:32.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 -- 10.20.193.16:0/80336663 wait complete. 2026-02-17T08:22:32.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 Processor -- start 2026-02-17T08:22:32.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 -- start start 2026-02-17T08:22:32.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1d741046a0 0x7f1d7419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:32.164 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1d74109b20 con 0x7f1d741046a0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d79503640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1d741046a0 0x7f1d7419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d79503640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1d741046a0 0x7f1d7419b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:60964/0 (socket says 10.20.193.16:60964) 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d79503640 1 -- 10.20.193.16:0/3476729130 learned_addr learned my addr 10.20.193.16:0/3476729130 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d79503640 1 -- 10.20.193.16:0/3476729130 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7419b800 con 0x7f1d741046a0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d79503640 1 --2- 10.20.193.16:0/3476729130 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1d741046a0 0x7f1d7419b2c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d64005ec0 tx=0x7f1d64004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d627fc640 1 -- 10.20.193.16:0/3476729130 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d64038510 con 0x7f1d741046a0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d627fc640 1 -- 10.20.193.16:0/3476729130 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1d64046070 con 0x7f1d741046a0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d627fc640 1 -- 10.20.193.16:0/3476729130 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d64041810 con 0x7f1d741046a0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.160+0000 7f1d7b78e640 1 -- 10.20.193.16:0/3476729130 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7419ba90 con 0x7f1d741046a0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.161+0000 7f1d7b78e640 1 -- 10.20.193.16:0/3476729130 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7419e780 con 0x7f1d741046a0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.161+0000 7f1d7b78e640 1 -- 10.20.193.16:0/3476729130 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7410a2c0 con 0x7f1d741046a0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.161+0000 7f1d627fc640 1 -- 10.20.193.16:0/3476729130 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f1d640386b0 con 0x7f1d741046a0 2026-02-17T08:22:32.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.161+0000 7f1d627fc640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:32.166 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.161+0000 7f1d627fc640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:32.166 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.161+0000 7f1d627fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:32.166 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.161+0000 7f1d627fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:32.166 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.161+0000 7f1d627fc640 1 --2- 10.20.193.16:0/3476729130 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1d5003de80 0x7f1d50040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:32.166 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.161+0000 7f1d627fc640 1 -- 10.20.193.16:0/3476729130 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1270+0+0 (secure 0 0 0) 0x7f1d640772d0 con 0x7f1d741046a0 2026-02-17T08:22:32.166 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.162+0000 7f1d78d02640 1 --2- 10.20.193.16:0/3476729130 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1d5003de80 0x7f1d50040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:32.166 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.162+0000 7f1d78d02640 1 --2- 10.20.193.16:0/3476729130 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1d5003de80 0x7f1d50040340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d680099c0 tx=0x7f1d68006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:32.167 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.164+0000 7f1d627fc640 1 -- 10.20.193.16:0/3476729130 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1d640389d0 con 0x7f1d741046a0 2026-02-17T08:22:32.253 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.252+0000 7f1d7b78e640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:32.253 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:32.252+0000 7f1d7b78e640 1 -- 10.20.193.16:0/3476729130 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1d741948f0 con 0x7f1d5003de80 2026-02-17T08:22:32.368 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:32 trial016 ceph-mon[39048]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T08:22:32.368 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:32 trial016 ceph-mon[39048]: Detected new or changed devices on trial016 2026-02-17T08:22:32.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:32 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:32.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:32 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:32.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:32 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T08:22:32.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:32 trial016 ceph-mon[39048]: Adjusting osd_memory_target on trial016 to 84047M 2026-02-17T08:22:32.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:32 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:32.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:32 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:32.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:32 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T08:22:32.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:32 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:33.368 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:33 trial016 ceph-mon[39048]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:33.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:33 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T08:22:33.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:33 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T08:22:33.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:33 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:33.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:33 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1100942640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68806223-ddc9-4054-9293-6f4024b23bce"}]: dispatch 2026-02-17T08:22:33.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:33 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1100942640' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68806223-ddc9-4054-9293-6f4024b23bce"}]': finished 2026-02-17T08:22:33.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:33 trial016 ceph-mon[39048]: osdmap e6: 2 total, 0 up, 2 in 2026-02-17T08:22:33.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:33 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T08:22:33.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:33 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T08:22:33.369 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:33 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/267272350' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T08:22:34.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:34 trial016 ceph-mon[39048]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T08:22:36.224 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:22:35 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-0[50759]: 2026-02-17T08:22:35.955+0000 7f6eabab0740 -1 osd.0 0 log_to_monitors true 2026-02-17T08:22:36.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:36 trial016 ceph-mon[39048]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T08:22:36.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:36 trial016 ceph-mon[39048]: from='osd.0 [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-17T08:22:37.553 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:37 trial016 ceph-mon[39048]: from='osd.0 [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-17T08:22:37.553 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:37 trial016 ceph-mon[39048]: osdmap e7: 2 total, 0 up, 2 in 2026-02-17T08:22:37.553 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:37 trial016 ceph-mon[39048]: from='osd.0 [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial016", "root=default"]}]: dispatch 2026-02-17T08:22:37.553 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:37 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T08:22:37.553 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:37 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T08:22:37.554 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:37 trial016 ceph-mon[39048]: from='osd.0 [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial016", "root=default"]}]': finished 2026-02-17T08:22:37.868 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:22:37 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-0[50759]: 2026-02-17T08:22:37.551+0000 7f6ea8244640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T08:22:37.869 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:22:37 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-0[50759]: 2026-02-17T08:22:37.554+0000 7f6e9f842640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T08:22:38.238 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:38 trial016 ceph-mon[39048]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T08:22:38.238 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:38 trial016 ceph-mon[39048]: osdmap e8: 2 total, 0 up, 2 in 2026-02-17T08:22:38.238 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:38 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T08:22:38.239 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:38 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T08:22:38.239 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:38 trial016 ceph-mon[39048]: from='osd.0 [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513]' entity='osd.0' 2026-02-17T08:22:39.325 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:39 trial016 ceph-mon[39048]: purged_snaps scrub starts 2026-02-17T08:22:39.326 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:39 trial016 ceph-mon[39048]: purged_snaps scrub ok 2026-02-17T08:22:39.326 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:39 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T08:22:39.326 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:39 trial016 ceph-mon[39048]: osd.0 [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513] boot 2026-02-17T08:22:39.326 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:39 trial016 ceph-mon[39048]: osdmap e9: 2 total, 1 up, 2 in 2026-02-17T08:22:39.326 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:39 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T08:22:39.326 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:39 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T08:22:39.326 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:39 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T08:22:39.326 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:39 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:40.504 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:40 trial016 ceph-mon[39048]: Deploying daemon osd.1 on trial016 2026-02-17T08:22:40.505 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:40 trial016 ceph-mon[39048]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T08:22:40.505 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:40 trial016 ceph-mon[39048]: osdmap e10: 2 total, 1 up, 2 in 2026-02-17T08:22:40.505 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:40 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T08:22:41.565 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:41 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:41.565 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:41 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:41.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:41 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:41.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:41 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:41.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:41 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:41.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:41 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:41.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:41 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T08:22:41.566 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:41 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:41.649 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.647+0000 7f1d627fc640 1 -- 10.20.193.16:0/3476729130 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f1d741948f0 con 0x7f1d5003de80 2026-02-17T08:22:41.649 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.647+0000 7f1d627fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:41.649 INFO:teuthology.orchestra.run.trial016.stdout:Created osd(s) 1 on host 'trial016' 2026-02-17T08:22:41.651 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.649+0000 7f1d7b78e640 10 mgrc shutdown 2026-02-17T08:22:41.651 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.649+0000 7f1d7b78e640 1 -- 10.20.193.16:0/3476729130 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1d5003de80 msgr2=0x7f1d50040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.649+0000 7f1d7b78e640 1 --2- 10.20.193.16:0/3476729130 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1d5003de80 0x7f1d50040340 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d680099c0 tx=0x7f1d68006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.649+0000 7f1d7b78e640 1 -- 10.20.193.16:0/3476729130 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1d741046a0 msgr2=0x7f1d7419b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.649+0000 7f1d7b78e640 1 --2- 10.20.193.16:0/3476729130 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1d741046a0 0x7f1d7419b2c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d64005ec0 tx=0x7f1d64004290 comp rx=0 tx=0).stop 2026-02-17T08:22:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.650+0000 7f1d7b78e640 1 -- 10.20.193.16:0/3476729130 shutdown_connections 2026-02-17T08:22:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.650+0000 7f1d7b78e640 1 --2- 10.20.193.16:0/3476729130 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1d5003de80 0x7f1d50040340 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.650+0000 7f1d7b78e640 1 --2- 10.20.193.16:0/3476729130 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1d741046a0 0x7f1d7419b2c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.650+0000 7f1d7b78e640 1 -- 10.20.193.16:0/3476729130 >> 10.20.193.16:0/3476729130 conn(0x7f1d740ffe30 msgr2=0x7f1d741004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.650+0000 7f1d7b78e640 1 -- 10.20.193.16:0/3476729130 shutdown_connections 2026-02-17T08:22:41.652 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:41.650+0000 7f1d7b78e640 1 -- 10.20.193.16:0/3476729130 wait complete. 2026-02-17T08:22:41.687 DEBUG:teuthology.orchestra.run.trial016:osd.1> sudo journalctl -f -n 0 -u ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@osd.1.service 2026-02-17T08:22:41.690 INFO:tasks.cephadm:Deploying osd.2 on trial016 with /dev/vg_nvme/lv_2... 2026-02-17T08:22:41.690 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-17T08:22:41.887 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:42.515 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:42 trial016 ceph-mon[39048]: pgmap v16: 0 pgs: ; 0 B data, 30 MiB used, 700 GiB / 700 GiB avail 2026-02-17T08:22:42.515 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:42 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:42.515 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:42 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:42.515 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:42 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:42.868 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:22:42 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-1[56627]: 2026-02-17T08:22:42.611+0000 7fe30c486740 -1 Falling back to public interface 2026-02-17T08:22:43.017 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:43.033 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph orch daemon add osd trial016:vg_nvme/lv_2 2026-02-17T08:22:43.185 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:43.294 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.290+0000 7f1df2f6c640 1 -- 10.20.193.16:0/2081468069 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1dec100720 msgr2=0x7f1dec100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:43.294 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.290+0000 7f1df2f6c640 1 --2- 10.20.193.16:0/2081468069 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1dec100720 0x7f1dec100b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0099b0 tx=0x7f1ddc02f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.290+0000 7f1df2f6c640 1 -- 10.20.193.16:0/2081468069 shutdown_connections 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.290+0000 7f1df2f6c640 1 --2- 10.20.193.16:0/2081468069 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1dec100720 0x7f1dec100b20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.290+0000 7f1df2f6c640 1 -- 10.20.193.16:0/2081468069 >> 10.20.193.16:0/2081468069 conn(0x7f1dec0fc200 msgr2=0x7f1dec0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.290+0000 7f1df2f6c640 1 -- 10.20.193.16:0/2081468069 shutdown_connections 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.290+0000 7f1df2f6c640 1 -- 10.20.193.16:0/2081468069 wait complete. 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df2f6c640 1 Processor -- start 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df2f6c640 1 -- start start 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df2f6c640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1dec100720 0x7f1dec19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df2f6c640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1dec109c50 con 0x7f1dec100720 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df0ce1640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1dec100720 0x7f1dec19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:43.295 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df0ce1640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1dec100720 0x7f1dec19b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:59190/0 (socket says 10.20.193.16:59190) 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df0ce1640 1 -- 10.20.193.16:0/868030093 learned_addr learned my addr 10.20.193.16:0/868030093 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df0ce1640 1 -- 10.20.193.16:0/868030093 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dec19b810 con 0x7f1dec100720 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df0ce1640 1 --2- 10.20.193.16:0/868030093 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1dec100720 0x7f1dec19b2d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc005ec0 tx=0x7f1ddc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1de1ffb640 1 -- 10.20.193.16:0/868030093 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ddc038510 con 0x7f1dec100720 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df2f6c640 1 -- 10.20.193.16:0/868030093 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dec19baa0 con 0x7f1dec100720 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1de1ffb640 1 -- 10.20.193.16:0/868030093 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1ddc046070 con 0x7f1dec100720 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1de1ffb640 1 -- 10.20.193.16:0/868030093 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ddc041810 con 0x7f1dec100720 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.291+0000 7f1df2f6c640 1 -- 10.20.193.16:0/868030093 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dec19e790 con 0x7f1dec100720 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.292+0000 7f1df2f6c640 1 -- 10.20.193.16:0/868030093 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dec10a370 con 0x7f1dec100720 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.292+0000 7f1de1ffb640 1 -- 10.20.193.16:0/868030093 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f1ddc0386b0 con 0x7f1dec100720 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.292+0000 7f1de1ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:43.296 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.292+0000 7f1de1ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:43.297 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.292+0000 7f1de1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:43.297 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.292+0000 7f1de1ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:43.297 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.292+0000 7f1de1ffb640 1 --2- 10.20.193.16:0/868030093 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1dc803de80 0x7f1dc8040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:43.297 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.292+0000 7f1de1ffb640 1 -- 10.20.193.16:0/868030093 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1880+0+0 (secure 0 0 0) 0x7f1ddc077510 con 0x7f1dec100720 2026-02-17T08:22:43.297 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.292+0000 7f1de3fff640 1 --2- 10.20.193.16:0/868030093 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1dc803de80 0x7f1dc8040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:43.297 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.293+0000 7f1de3fff640 1 --2- 10.20.193.16:0/868030093 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1dc803de80 0x7f1dc8040340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40099c0 tx=0x7f1dd4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:43.297 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.295+0000 7f1de1ffb640 1 -- 10.20.193.16:0/868030093 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1ddc0389d0 con 0x7f1dec100720 2026-02-17T08:22:43.383 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.382+0000 7f1df2f6c640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}] 2026-02-17T08:22:43.383 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:43.382+0000 7f1df2f6c640 1 -- 10.20.193.16:0/868030093 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1dec1949a0 con 0x7f1dc803de80 2026-02-17T08:22:43.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:43 trial016 ceph-mon[39048]: Detected new or changed devices on trial016 2026-02-17T08:22:43.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:43 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:43.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:43 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:43.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:43 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T08:22:43.568 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:43 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T08:22:43.569 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:43 trial016 ceph-mon[39048]: Adjusting osd_memory_target on trial016 to 42023M 2026-02-17T08:22:43.569 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:43 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:43.569 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:43 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:43.569 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:43 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T08:22:43.569 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:43 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:44.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: pgmap v17: 0 pgs: ; 0 B data, 30 MiB used, 700 GiB / 700 GiB avail 2026-02-17T08:22:44.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial016:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T08:22:44.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T08:22:44.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T08:22:44.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:44.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3334258618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "de18185e-a42b-49a0-b172-1983e20a8550"}]: dispatch 2026-02-17T08:22:44.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3334258618' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "de18185e-a42b-49a0-b172-1983e20a8550"}]': finished 2026-02-17T08:22:44.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: osdmap e11: 3 total, 1 up, 3 in 2026-02-17T08:22:44.620 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T08:22:44.620 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T08:22:44.620 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:44 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/515809197' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T08:22:46.868 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:46 trial016 ceph-mon[39048]: pgmap v19: 0 pgs: ; 0 B data, 30 MiB used, 700 GiB / 700 GiB avail 2026-02-17T08:22:47.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:47 trial016 ceph-mon[39048]: from='osd.1 [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-17T08:22:47.618 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:22:47 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-1[56627]: 2026-02-17T08:22:47.169+0000 7fe30c486740 -1 osd.1 0 log_to_monitors true 2026-02-17T08:22:48.782 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:22:48 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-1[56627]: 2026-02-17T08:22:48.387+0000 7fe307be4640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T08:22:48.782 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:22:48 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-1[56627]: 2026-02-17T08:22:48.389+0000 7fe304220640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T08:22:48.782 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:48 trial016 ceph-mon[39048]: pgmap v20: 0 pgs: ; 0 B data, 30 MiB used, 700 GiB / 700 GiB avail 2026-02-17T08:22:48.782 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:48 trial016 ceph-mon[39048]: from='osd.1 [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-17T08:22:48.782 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:48 trial016 ceph-mon[39048]: osdmap e12: 3 total, 1 up, 3 in 2026-02-17T08:22:48.783 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:48 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T08:22:48.783 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:48 trial016 ceph-mon[39048]: from='osd.1 [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial016", "root=default"]}]: dispatch 2026-02-17T08:22:48.783 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:48 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T08:22:49.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:49 trial016 ceph-mon[39048]: from='osd.1 [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial016", "root=default"]}]': finished 2026-02-17T08:22:49.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:49 trial016 ceph-mon[39048]: osdmap e13: 3 total, 1 up, 3 in 2026-02-17T08:22:49.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:49 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T08:22:49.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:49 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T08:22:49.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:49 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T08:22:50.449 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:50 trial016 ceph-mon[39048]: purged_snaps scrub starts 2026-02-17T08:22:50.450 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:50 trial016 ceph-mon[39048]: purged_snaps scrub ok 2026-02-17T08:22:50.450 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:50 trial016 ceph-mon[39048]: pgmap v23: 0 pgs: ; 0 B data, 30 MiB used, 700 GiB / 700 GiB avail 2026-02-17T08:22:50.450 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:50 trial016 ceph-mon[39048]: osd.1 [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540] boot 2026-02-17T08:22:50.450 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:50 trial016 ceph-mon[39048]: osdmap e14: 3 total, 2 up, 3 in 2026-02-17T08:22:50.450 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:50 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T08:22:50.450 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:50 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T08:22:50.450 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:50 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-17T08:22:50.450 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:50 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:51.796 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:51 trial016 ceph-mon[39048]: Deploying daemon osd.2 on trial016 2026-02-17T08:22:51.796 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:51 trial016 ceph-mon[39048]: osdmap e15: 3 total, 2 up, 3 in 2026-02-17T08:22:51.796 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:51 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T08:22:52.465 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.463+0000 7f1de1ffb640 1 -- 10.20.193.16:0/868030093 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f1dec1949a0 con 0x7f1dc803de80 2026-02-17T08:22:52.465 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.463+0000 7f1de1ffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:22:52.465 INFO:teuthology.orchestra.run.trial016.stdout:Created osd(s) 2 on host 'trial016' 2026-02-17T08:22:52.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.465+0000 7f1df2f6c640 10 mgrc shutdown 2026-02-17T08:22:52.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.465+0000 7f1df2f6c640 1 -- 10.20.193.16:0/868030093 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1dc803de80 msgr2=0x7f1dc8040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:52.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.465+0000 7f1df2f6c640 1 --2- 10.20.193.16:0/868030093 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1dc803de80 0x7f1dc8040340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40099c0 tx=0x7f1dd4006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:52.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.465+0000 7f1df2f6c640 1 -- 10.20.193.16:0/868030093 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1dec100720 msgr2=0x7f1dec19b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:52.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.465+0000 7f1df2f6c640 1 --2- 10.20.193.16:0/868030093 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1dec100720 0x7f1dec19b2d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc005ec0 tx=0x7f1ddc004290 comp rx=0 tx=0).stop 2026-02-17T08:22:52.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.465+0000 7f1df2f6c640 1 -- 10.20.193.16:0/868030093 shutdown_connections 2026-02-17T08:22:52.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.465+0000 7f1df2f6c640 1 --2- 10.20.193.16:0/868030093 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1dc803de80 0x7f1dc8040340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:52.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.465+0000 7f1df2f6c640 1 --2- 10.20.193.16:0/868030093 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1dec100720 0x7f1dec19b2d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:52.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.465+0000 7f1df2f6c640 1 -- 10.20.193.16:0/868030093 >> 10.20.193.16:0/868030093 conn(0x7f1dec0fc200 msgr2=0x7f1dec0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:52.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.465+0000 7f1df2f6c640 1 -- 10.20.193.16:0/868030093 shutdown_connections 2026-02-17T08:22:52.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.466+0000 7f1df2f6c640 1 -- 10.20.193.16:0/868030093 wait complete. 2026-02-17T08:22:52.502 DEBUG:teuthology.orchestra.run.trial016:osd.2> sudo journalctl -f -n 0 -u ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460@osd.2.service 2026-02-17T08:22:52.504 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2026-02-17T08:22:52.504 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T08:22:52.649 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:52 trial016 ceph-mon[39048]: pgmap v26: 0 pgs: ; 0 B data, 57 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T08:22:52.649 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:52 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:52.649 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:52 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:52.649 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:52 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:52.649 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:52 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:52.649 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:52 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:52.649 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:52 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:52.649 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:52 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T08:22:52.649 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:52 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:52.708 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:52.822 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.818+0000 7f856096e640 1 -- 10.20.193.16:0/2640251336 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f855c102240 msgr2=0x7f855c102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:52.822 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.818+0000 7f856096e640 1 --2- 10.20.193.16:0/2640251336 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f855c102240 0x7f855c102640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f85500099b0 tx=0x7f855002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:52.822 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.818+0000 7f856096e640 1 -- 10.20.193.16:0/2640251336 shutdown_connections 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.818+0000 7f856096e640 1 --2- 10.20.193.16:0/2640251336 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f855c102240 0x7f855c102640 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.818+0000 7f856096e640 1 -- 10.20.193.16:0/2640251336 >> 10.20.193.16:0/2640251336 conn(0x7f855c0fd9d0 msgr2=0x7f855c0ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.818+0000 7f856096e640 1 -- 10.20.193.16:0/2640251336 shutdown_connections 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.818+0000 7f856096e640 1 -- 10.20.193.16:0/2640251336 wait complete. 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f856096e640 1 Processor -- start 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f856096e640 1 -- start start 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f856096e640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f855c102240 0x7f855c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f856096e640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f855c1076c0 con 0x7f855c102240 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f855ad76640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f855c102240 0x7f855c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f855ad76640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f855c102240 0x7f855c198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58204/0 (socket says 10.20.193.16:58204) 2026-02-17T08:22:52.823 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f855ad76640 1 -- 10.20.193.16:0/316390846 learned_addr learned my addr 10.20.193.16:0/316390846 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f855ad76640 1 -- 10.20.193.16:0/316390846 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c199390 con 0x7f855c102240 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f855ad76640 1 --2- 10.20.193.16:0/316390846 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f855c102240 0x7f855c198e50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8550005ec0 tx=0x7f8550004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f853bfff640 1 -- 10.20.193.16:0/316390846 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8550038510 con 0x7f855c102240 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f853bfff640 1 -- 10.20.193.16:0/316390846 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8550046070 con 0x7f855c102240 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f856096e640 1 -- 10.20.193.16:0/316390846 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855c199620 con 0x7f855c102240 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f853bfff640 1 -- 10.20.193.16:0/316390846 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8550041810 con 0x7f855c102240 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.819+0000 7f856096e640 1 -- 10.20.193.16:0/316390846 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855c19c310 con 0x7f855c102240 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.820+0000 7f856096e640 1 -- 10.20.193.16:0/316390846 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855c107e60 con 0x7f855c102240 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.820+0000 7f853bfff640 1 -- 10.20.193.16:0/316390846 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f85500386b0 con 0x7f855c102240 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.820+0000 7f853bfff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.820+0000 7f853bfff640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.820+0000 7f853bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:52.824 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.820+0000 7f853bfff640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:52.825 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.820+0000 7f853bfff640 1 --2- 10.20.193.16:0/316390846 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f853003de30 0x7f85300402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:52.825 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.820+0000 7f853bfff640 1 -- 10.20.193.16:0/316390846 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7f8550077730 con 0x7f855c102240 2026-02-17T08:22:52.825 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.820+0000 7f855a575640 1 --2- 10.20.193.16:0/316390846 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f853003de30 0x7f85300402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:52.825 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.820+0000 7f855a575640 1 --2- 10.20.193.16:0/316390846 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f853003de30 0x7f85300402f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85440099c0 tx=0x7f8544006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:52.825 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.823+0000 7f853bfff640 1 -- 10.20.193.16:0/316390846 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f85500389d0 con 0x7f855c102240 2026-02-17T08:22:52.908 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.906+0000 7f856096e640 1 -- 10.20.193.16:0/316390846 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f855c192420 con 0x7f855c102240 2026-02-17T08:22:52.908 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.906+0000 7f853bfff640 1 -- 10.20.193.16:0/316390846 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7f8550007c50 con 0x7f855c102240 2026-02-17T08:22:52.908 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:52.909 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 10 mgrc shutdown 2026-02-17T08:22:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 1 -- 10.20.193.16:0/316390846 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f853003de30 msgr2=0x7f85300402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 1 --2- 10.20.193.16:0/316390846 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f853003de30 0x7f85300402f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85440099c0 tx=0x7f8544006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 1 -- 10.20.193.16:0/316390846 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f855c102240 msgr2=0x7f855c198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 1 --2- 10.20.193.16:0/316390846 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f855c102240 0x7f855c198e50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8550005ec0 tx=0x7f8550004290 comp rx=0 tx=0).stop 2026-02-17T08:22:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 1 -- 10.20.193.16:0/316390846 shutdown_connections 2026-02-17T08:22:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 1 --2- 10.20.193.16:0/316390846 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f853003de30 0x7f85300402f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 1 --2- 10.20.193.16:0/316390846 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f855c102240 0x7f855c198e50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 1 -- 10.20.193.16:0/316390846 >> 10.20.193.16:0/316390846 conn(0x7f855c0fd9d0 msgr2=0x7f855c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 1 -- 10.20.193.16:0/316390846 shutdown_connections 2026-02-17T08:22:52.910 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:52.907+0000 7f856096e640 1 -- 10.20.193.16:0/316390846 wait complete. 2026-02-17T08:22:52.948 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771316569,"num_in_osds":3,"osd_in_since":1771316564,"num_remapped_pgs":0} 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/316390846' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T08:22:53.455 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T08:22:53.456 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:53 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:22:53.868 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:22:53 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-2[62750]: 2026-02-17T08:22:53.486+0000 7fb036c34740 -1 Falling back to public interface 2026-02-17T08:22:53.949 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T08:22:54.106 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:54.213 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 -- 10.20.193.16:0/372185607 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd7e01046a0 msgr2=0x7fd7e0104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:54.213 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 --2- 10.20.193.16:0/372185607 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd7e01046a0 0x7fd7e0104aa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0099b0 tx=0x7fd7cc02f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:54.213 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 -- 10.20.193.16:0/372185607 shutdown_connections 2026-02-17T08:22:54.213 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 --2- 10.20.193.16:0/372185607 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd7e01046a0 0x7fd7e0104aa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:54.213 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 -- 10.20.193.16:0/372185607 >> 10.20.193.16:0/372185607 conn(0x7fd7e00ffe30 msgr2=0x7fd7e0102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 -- 10.20.193.16:0/372185607 shutdown_connections 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 -- 10.20.193.16:0/372185607 wait complete. 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 Processor -- start 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 -- start start 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd7e01046a0 0x7fd7e019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7e60d5640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e0109b20 con 0x7fd7e01046a0 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7df7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd7e01046a0 0x7fd7e019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7df7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd7e01046a0 0x7fd7e019b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58222/0 (socket says 10.20.193.16:58222) 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.209+0000 7fd7df7fe640 1 -- 10.20.193.16:0/1440359870 learned_addr learned my addr 10.20.193.16:0/1440359870 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.210+0000 7fd7df7fe640 1 -- 10.20.193.16:0/1440359870 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e019b800 con 0x7fd7e01046a0 2026-02-17T08:22:54.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.210+0000 7fd7df7fe640 1 --2- 10.20.193.16:0/1440359870 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd7e01046a0 0x7fd7e019b2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc005ec0 tx=0x7fd7cc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.210+0000 7fd7dcff9640 1 -- 10.20.193.16:0/1440359870 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc038510 con 0x7fd7e01046a0 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.210+0000 7fd7e60d5640 1 -- 10.20.193.16:0/1440359870 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e019ba90 con 0x7fd7e01046a0 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.210+0000 7fd7dcff9640 1 -- 10.20.193.16:0/1440359870 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fd7cc046070 con 0x7fd7e01046a0 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.210+0000 7fd7dcff9640 1 -- 10.20.193.16:0/1440359870 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7cc041810 con 0x7fd7e01046a0 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.210+0000 7fd7e60d5640 1 -- 10.20.193.16:0/1440359870 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e019e780 con 0x7fd7e01046a0 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.210+0000 7fd7e60d5640 1 -- 10.20.193.16:0/1440359870 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e010a2c0 con 0x7fd7e01046a0 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.210+0000 7fd7dcff9640 1 -- 10.20.193.16:0/1440359870 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fd7cc0386b0 con 0x7fd7e01046a0 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.210+0000 7fd7dcff9640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.211+0000 7fd7dcff9640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.211+0000 7fd7dcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.211+0000 7fd7dcff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:54.215 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.211+0000 7fd7dcff9640 1 --2- 10.20.193.16:0/1440359870 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd7b403de80 0x7fd7b4040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:54.216 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.211+0000 7fd7dcff9640 1 -- 10.20.193.16:0/1440359870 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7fd7cc0776e0 con 0x7fd7e01046a0 2026-02-17T08:22:54.216 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.211+0000 7fd7deffd640 1 --2- 10.20.193.16:0/1440359870 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd7b403de80 0x7fd7b4040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:54.216 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.211+0000 7fd7deffd640 1 --2- 10.20.193.16:0/1440359870 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd7b403de80 0x7fd7b4040340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00099c0 tx=0x7fd7d0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:54.216 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.213+0000 7fd7dcff9640 1 -- 10.20.193.16:0/1440359870 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd7cc0389d0 con 0x7fd7e01046a0 2026-02-17T08:22:54.300 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.298+0000 7fd7e60d5640 1 -- 10.20.193.16:0/1440359870 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd7e0194880 con 0x7fd7e01046a0 2026-02-17T08:22:54.300 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.298+0000 7fd7dcff9640 1 -- 10.20.193.16:0/1440359870 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7fd7cc04a3c0 con 0x7fd7e01046a0 2026-02-17T08:22:54.300 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:54.301 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 10 mgrc shutdown 2026-02-17T08:22:54.301 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 1 -- 10.20.193.16:0/1440359870 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd7b403de80 msgr2=0x7fd7b4040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:54.302 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 1 --2- 10.20.193.16:0/1440359870 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd7b403de80 0x7fd7b4040340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00099c0 tx=0x7fd7d0006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:54.302 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 1 -- 10.20.193.16:0/1440359870 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd7e01046a0 msgr2=0x7fd7e019b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:54.302 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 1 --2- 10.20.193.16:0/1440359870 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd7e01046a0 0x7fd7e019b2c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc005ec0 tx=0x7fd7cc004290 comp rx=0 tx=0).stop 2026-02-17T08:22:54.302 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 1 -- 10.20.193.16:0/1440359870 shutdown_connections 2026-02-17T08:22:54.302 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 1 --2- 10.20.193.16:0/1440359870 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd7b403de80 0x7fd7b4040340 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:54.302 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 1 --2- 10.20.193.16:0/1440359870 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd7e01046a0 0x7fd7e019b2c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:54.302 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 1 -- 10.20.193.16:0/1440359870 >> 10.20.193.16:0/1440359870 conn(0x7fd7e00ffe30 msgr2=0x7fd7e01004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:54.302 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 1 -- 10.20.193.16:0/1440359870 shutdown_connections 2026-02-17T08:22:54.302 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:54.299+0000 7fd7e60d5640 1 -- 10.20.193.16:0/1440359870 wait complete. 2026-02-17T08:22:54.338 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771316569,"num_in_osds":3,"osd_in_since":1771316564,"num_remapped_pgs":0} 2026-02-17T08:22:54.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:54 trial016 ceph-mon[39048]: pgmap v27: 0 pgs: ; 0 B data, 57 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T08:22:54.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:54 trial016 ceph-mon[39048]: Detected new or changed devices on trial016 2026-02-17T08:22:54.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:54 trial016 ceph-mon[39048]: Adjusting osd_memory_target on trial016 to 28015M 2026-02-17T08:22:54.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:54 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1440359870' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T08:22:55.340 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T08:22:55.495 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:55.599 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.594+0000 7f611ad3e640 1 -- 10.20.193.16:0/1920007363 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f61141046a0 msgr2=0x7f6114104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:55.599 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.594+0000 7f611ad3e640 1 --2- 10.20.193.16:0/1920007363 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f61141046a0 0x7f6114104aa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f61040099b0 tx=0x7f610402f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:55.599 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.594+0000 7f611ad3e640 1 -- 10.20.193.16:0/1920007363 shutdown_connections 2026-02-17T08:22:55.599 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.594+0000 7f611ad3e640 1 --2- 10.20.193.16:0/1920007363 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f61141046a0 0x7f6114104aa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:55.599 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.594+0000 7f611ad3e640 1 -- 10.20.193.16:0/1920007363 >> 10.20.193.16:0/1920007363 conn(0x7f61140ffe30 msgr2=0x7f6114102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.594+0000 7f611ad3e640 1 -- 10.20.193.16:0/1920007363 shutdown_connections 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.594+0000 7f611ad3e640 1 -- 10.20.193.16:0/1920007363 wait complete. 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f611ad3e640 1 Processor -- start 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f611ad3e640 1 -- start start 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f611ad3e640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f61141046a0 0x7f611419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f611ad3e640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6114109b20 con 0x7f61141046a0 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f6118ab3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f61141046a0 0x7f611419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f6118ab3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f61141046a0 0x7f611419b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58244/0 (socket says 10.20.193.16:58244) 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f6118ab3640 1 -- 10.20.193.16:0/1246395001 learned_addr learned my addr 10.20.193.16:0/1246395001 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f6118ab3640 1 -- 10.20.193.16:0/1246395001 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611419b800 con 0x7f61141046a0 2026-02-17T08:22:55.600 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f6118ab3640 1 --2- 10.20.193.16:0/1246395001 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f61141046a0 0x7f611419b2c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6104005ec0 tx=0x7f6104004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f6109ffb640 1 -- 10.20.193.16:0/1246395001 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6104038510 con 0x7f61141046a0 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f611ad3e640 1 -- 10.20.193.16:0/1246395001 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611419ba90 con 0x7f61141046a0 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f6109ffb640 1 -- 10.20.193.16:0/1246395001 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f6104046070 con 0x7f61141046a0 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f6109ffb640 1 -- 10.20.193.16:0/1246395001 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6104041810 con 0x7f61141046a0 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.595+0000 7f611ad3e640 1 -- 10.20.193.16:0/1246395001 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611419e780 con 0x7f61141046a0 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.596+0000 7f611ad3e640 1 -- 10.20.193.16:0/1246395001 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f611410a2c0 con 0x7f61141046a0 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.596+0000 7f6109ffb640 1 -- 10.20.193.16:0/1246395001 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f61040386b0 con 0x7f61141046a0 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.596+0000 7f6109ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.596+0000 7f6109ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.596+0000 7f6109ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.596+0000 7f6109ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:55.601 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.596+0000 7f6109ffb640 1 --2- 10.20.193.16:0/1246395001 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f60f003de80 0x7f60f0040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:55.602 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.596+0000 7f6109ffb640 1 -- 10.20.193.16:0/1246395001 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7f6104077700 con 0x7f61141046a0 2026-02-17T08:22:55.602 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.596+0000 7f610bfff640 1 --2- 10.20.193.16:0/1246395001 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f60f003de80 0x7f60f0040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:55.602 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.597+0000 7f610bfff640 1 --2- 10.20.193.16:0/1246395001 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f60f003de80 0x7f60f0040340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0099c0 tx=0x7f60fc006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:55.602 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.599+0000 7f6109ffb640 1 -- 10.20.193.16:0/1246395001 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f61040389d0 con 0x7f61141046a0 2026-02-17T08:22:55.685 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.683+0000 7f611ad3e640 1 -- 10.20.193.16:0/1246395001 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6114194880 con 0x7f61141046a0 2026-02-17T08:22:55.686 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.683+0000 7f6109ffb640 1 -- 10.20.193.16:0/1246395001 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7f610404a3c0 con 0x7f61141046a0 2026-02-17T08:22:55.686 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:55.687 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 10 mgrc shutdown 2026-02-17T08:22:55.687 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 1 -- 10.20.193.16:0/1246395001 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f60f003de80 msgr2=0x7f60f0040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 1 --2- 10.20.193.16:0/1246395001 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f60f003de80 0x7f60f0040340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0099c0 tx=0x7f60fc006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 1 -- 10.20.193.16:0/1246395001 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f61141046a0 msgr2=0x7f611419b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 1 --2- 10.20.193.16:0/1246395001 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f61141046a0 0x7f611419b2c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6104005ec0 tx=0x7f6104004290 comp rx=0 tx=0).stop 2026-02-17T08:22:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 1 -- 10.20.193.16:0/1246395001 shutdown_connections 2026-02-17T08:22:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 1 --2- 10.20.193.16:0/1246395001 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f60f003de80 0x7f60f0040340 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 1 --2- 10.20.193.16:0/1246395001 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f61141046a0 0x7f611419b2c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 1 -- 10.20.193.16:0/1246395001 >> 10.20.193.16:0/1246395001 conn(0x7f61140ffe30 msgr2=0x7f61141004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 1 -- 10.20.193.16:0/1246395001 shutdown_connections 2026-02-17T08:22:55.688 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:55.684+0000 7f611ad3e640 1 -- 10.20.193.16:0/1246395001 wait complete. 2026-02-17T08:22:55.723 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771316569,"num_in_osds":3,"osd_in_since":1771316564,"num_remapped_pgs":0} 2026-02-17T08:22:56.724 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T08:22:56.747 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:56 trial016 ceph-mon[39048]: pgmap v28: 0 pgs: ; 0 B data, 57 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T08:22:56.748 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:56 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1246395001' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T08:22:56.875 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:56.981 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.976+0000 7fc1c7342640 1 -- 10.20.193.16:0/3195670556 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc1c0102420 msgr2=0x7fc1c0102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:56.981 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.976+0000 7fc1c7342640 1 --2- 10.20.193.16:0/3195670556 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc1c0102420 0x7fc1c0102820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00099b0 tx=0x7fc1b002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:56.982 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c7342640 1 -- 10.20.193.16:0/3195670556 shutdown_connections 2026-02-17T08:22:56.982 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c7342640 1 --2- 10.20.193.16:0/3195670556 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc1c0102420 0x7fc1c0102820 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:56.982 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c7342640 1 -- 10.20.193.16:0/3195670556 >> 10.20.193.16:0/3195670556 conn(0x7fc1c00fdbb0 msgr2=0x7fc1c00ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:56.982 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c7342640 1 -- 10.20.193.16:0/3195670556 shutdown_connections 2026-02-17T08:22:56.982 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c7342640 1 -- 10.20.193.16:0/3195670556 wait complete. 2026-02-17T08:22:56.982 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c7342640 1 Processor -- start 2026-02-17T08:22:56.982 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c7342640 1 -- start start 2026-02-17T08:22:56.982 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c7342640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc1c0102420 0x7fc1c019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:56.982 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c7342640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01078a0 con 0x7fc1c0102420 2026-02-17T08:22:56.982 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c50b7640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc1c0102420 0x7fc1c019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c50b7640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc1c0102420 0x7fc1c019b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58262/0 (socket says 10.20.193.16:58262) 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c50b7640 1 -- 10.20.193.16:0/731839871 learned_addr learned my addr 10.20.193.16:0/731839871 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c50b7640 1 -- 10.20.193.16:0/731839871 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c019b810 con 0x7fc1c0102420 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1c50b7640 1 --2- 10.20.193.16:0/731839871 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc1c0102420 0x7fc1c019b2d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0002410 tx=0x7fc1b0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.977+0000 7fc1ae7fc640 1 -- 10.20.193.16:0/731839871 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1b0038510 con 0x7fc1c0102420 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1ae7fc640 1 -- 10.20.193.16:0/731839871 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc1b0046070 con 0x7fc1c0102420 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1c7342640 1 -- 10.20.193.16:0/731839871 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c019baa0 con 0x7fc1c0102420 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1ae7fc640 1 -- 10.20.193.16:0/731839871 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1b0041730 con 0x7fc1c0102420 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1c7342640 1 -- 10.20.193.16:0/731839871 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c019e790 con 0x7fc1c0102420 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1c7342640 1 -- 10.20.193.16:0/731839871 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c0108040 con 0x7fc1c0102420 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1ae7fc640 1 -- 10.20.193.16:0/731839871 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fc1b00419f0 con 0x7fc1c0102420 2026-02-17T08:22:56.983 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1ae7fc640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:56.984 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1ae7fc640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:56.984 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1ae7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:56.984 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1ae7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:56.984 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1ae7fc640 1 --2- 10.20.193.16:0/731839871 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc19c03de30 0x7fc19c0402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:56.984 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1ae7fc640 1 -- 10.20.193.16:0/731839871 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7fc1b00778c0 con 0x7fc1c0102420 2026-02-17T08:22:56.984 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.978+0000 7fc1c48b6640 1 --2- 10.20.193.16:0/731839871 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc19c03de30 0x7fc19c0402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:56.984 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.979+0000 7fc1c48b6640 1 --2- 10.20.193.16:0/731839871 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc19c03de30 0x7fc19c0402f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40099c0 tx=0x7fc1b4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:56.985 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:56.981+0000 7fc1ae7fc640 1 -- 10.20.193.16:0/731839871 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc1b0046220 con 0x7fc1c0102420 2026-02-17T08:22:57.069 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.067+0000 7fc1c7342640 1 -- 10.20.193.16:0/731839871 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc1c0194b00 con 0x7fc1c0102420 2026-02-17T08:22:57.069 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.067+0000 7fc1ae7fc640 1 -- 10.20.193.16:0/731839871 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7fc1b0041d10 con 0x7fc1c0102420 2026-02-17T08:22:57.070 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:57.071 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 10 mgrc shutdown 2026-02-17T08:22:57.071 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 1 -- 10.20.193.16:0/731839871 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc19c03de30 msgr2=0x7fc19c0402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:57.071 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 1 --2- 10.20.193.16:0/731839871 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc19c03de30 0x7fc19c0402f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40099c0 tx=0x7fc1b4006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:57.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 1 -- 10.20.193.16:0/731839871 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc1c0102420 msgr2=0x7fc1c019b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:57.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 1 --2- 10.20.193.16:0/731839871 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc1c0102420 0x7fc1c019b2d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0002410 tx=0x7fc1b0004290 comp rx=0 tx=0).stop 2026-02-17T08:22:57.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 1 -- 10.20.193.16:0/731839871 shutdown_connections 2026-02-17T08:22:57.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 1 --2- 10.20.193.16:0/731839871 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc19c03de30 0x7fc19c0402f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:57.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 1 --2- 10.20.193.16:0/731839871 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc1c0102420 0x7fc1c019b2d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:57.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 1 -- 10.20.193.16:0/731839871 >> 10.20.193.16:0/731839871 conn(0x7fc1c00fdbb0 msgr2=0x7fc1c00fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:57.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 1 -- 10.20.193.16:0/731839871 shutdown_connections 2026-02-17T08:22:57.072 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:57.069+0000 7fc1c7342640 1 -- 10.20.193.16:0/731839871 wait complete. 2026-02-17T08:22:57.130 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771316569,"num_in_osds":3,"osd_in_since":1771316564,"num_remapped_pgs":0} 2026-02-17T08:22:57.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:57 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/731839871' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T08:22:58.131 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T08:22:58.284 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:58.307 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:22:57 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-2[62750]: 2026-02-17T08:22:57.995+0000 7fb036c34740 -1 osd.2 0 log_to_monitors true 2026-02-17T08:22:58.389 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.386+0000 7fa4120f9640 1 -- 10.20.193.16:0/3581436715 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa40c1046a0 msgr2=0x7fa40c104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:58.390 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.386+0000 7fa4120f9640 1 --2- 10.20.193.16:0/3581436715 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa40c1046a0 0x7fa40c104aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80099b0 tx=0x7fa3f802f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:58.390 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.386+0000 7fa4120f9640 1 -- 10.20.193.16:0/3581436715 shutdown_connections 2026-02-17T08:22:58.390 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.386+0000 7fa4120f9640 1 --2- 10.20.193.16:0/3581436715 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa40c1046a0 0x7fa40c104aa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:58.390 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.386+0000 7fa4120f9640 1 -- 10.20.193.16:0/3581436715 >> 10.20.193.16:0/3581436715 conn(0x7fa40c0ffe30 msgr2=0x7fa40c102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:58.390 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.386+0000 7fa4120f9640 1 -- 10.20.193.16:0/3581436715 shutdown_connections 2026-02-17T08:22:58.390 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.386+0000 7fa4120f9640 1 -- 10.20.193.16:0/3581436715 wait complete. 2026-02-17T08:22:58.390 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa4120f9640 1 Processor -- start 2026-02-17T08:22:58.390 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa4120f9640 1 -- start start 2026-02-17T08:22:58.390 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa4120f9640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa40c1046a0 0x7fa40c19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa4120f9640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c109b20 con 0x7fa40c1046a0 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa40b7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa40c1046a0 0x7fa40c19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa40b7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa40c1046a0 0x7fa40c19b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58300/0 (socket says 10.20.193.16:58300) 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa40b7fe640 1 -- 10.20.193.16:0/1437652559 learned_addr learned my addr 10.20.193.16:0/1437652559 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa40b7fe640 1 -- 10.20.193.16:0/1437652559 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40c19b800 con 0x7fa40c1046a0 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa40b7fe640 1 --2- 10.20.193.16:0/1437652559 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa40c1046a0 0x7fa40c19b2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8005ec0 tx=0x7fa3f8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa408ff9640 1 -- 10.20.193.16:0/1437652559 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3f8038510 con 0x7fa40c1046a0 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa408ff9640 1 -- 10.20.193.16:0/1437652559 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa3f8046070 con 0x7fa40c1046a0 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa4120f9640 1 -- 10.20.193.16:0/1437652559 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa40c19ba90 con 0x7fa40c1046a0 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa408ff9640 1 -- 10.20.193.16:0/1437652559 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3f8041810 con 0x7fa40c1046a0 2026-02-17T08:22:58.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.387+0000 7fa4120f9640 1 -- 10.20.193.16:0/1437652559 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa40c19e780 con 0x7fa40c1046a0 2026-02-17T08:22:58.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.388+0000 7fa4120f9640 1 -- 10.20.193.16:0/1437652559 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa40c10a2c0 con 0x7fa40c1046a0 2026-02-17T08:22:58.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.388+0000 7fa408ff9640 1 -- 10.20.193.16:0/1437652559 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fa3f80386b0 con 0x7fa40c1046a0 2026-02-17T08:22:58.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.388+0000 7fa408ff9640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:58.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.388+0000 7fa408ff9640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:58.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.388+0000 7fa408ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:58.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.388+0000 7fa408ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:58.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.388+0000 7fa408ff9640 1 --2- 10.20.193.16:0/1437652559 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa3e003de30 0x7fa3e00402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:58.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.388+0000 7fa408ff9640 1 -- 10.20.193.16:0/1437652559 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7fa3f8077730 con 0x7fa40c1046a0 2026-02-17T08:22:58.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.388+0000 7fa40affd640 1 --2- 10.20.193.16:0/1437652559 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa3e003de30 0x7fa3e00402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:58.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.389+0000 7fa40affd640 1 --2- 10.20.193.16:0/1437652559 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa3e003de30 0x7fa3e00402f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0099c0 tx=0x7fa3fc006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:58.393 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.391+0000 7fa408ff9640 1 -- 10.20.193.16:0/1437652559 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa3f80389d0 con 0x7fa40c1046a0 2026-02-17T08:22:58.475 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.473+0000 7fa4120f9640 1 -- 10.20.193.16:0/1437652559 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa40c194880 con 0x7fa40c1046a0 2026-02-17T08:22:58.475 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.473+0000 7fa408ff9640 1 -- 10.20.193.16:0/1437652559 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v16) ==== 74+0+130 (secure 0 0 0) 0x7fa3f8007c50 con 0x7fa40c1046a0 2026-02-17T08:22:58.476 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:58.477 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 10 mgrc shutdown 2026-02-17T08:22:58.478 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 1 -- 10.20.193.16:0/1437652559 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa3e003de30 msgr2=0x7fa3e00402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:58.478 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 1 --2- 10.20.193.16:0/1437652559 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa3e003de30 0x7fa3e00402f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0099c0 tx=0x7fa3fc006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:58.478 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 1 -- 10.20.193.16:0/1437652559 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa40c1046a0 msgr2=0x7fa40c19b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:58.478 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 1 --2- 10.20.193.16:0/1437652559 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa40c1046a0 0x7fa40c19b2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8005ec0 tx=0x7fa3f8004290 comp rx=0 tx=0).stop 2026-02-17T08:22:58.479 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 1 -- 10.20.193.16:0/1437652559 shutdown_connections 2026-02-17T08:22:58.479 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 1 --2- 10.20.193.16:0/1437652559 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fa3e003de30 0x7fa3e00402f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:58.479 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 1 --2- 10.20.193.16:0/1437652559 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fa40c1046a0 0x7fa40c19b2c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:58.479 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 1 -- 10.20.193.16:0/1437652559 >> 10.20.193.16:0/1437652559 conn(0x7fa40c0ffe30 msgr2=0x7fa40c1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:58.479 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 1 -- 10.20.193.16:0/1437652559 shutdown_connections 2026-02-17T08:22:58.479 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:58.474+0000 7fa4120f9640 1 -- 10.20.193.16:0/1437652559 wait complete. 2026-02-17T08:22:58.509 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":16,"num_osds":3,"num_up_osds":2,"osd_up_since":1771316569,"num_in_osds":3,"osd_in_since":1771316564,"num_remapped_pgs":0} 2026-02-17T08:22:58.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:58 trial016 ceph-mon[39048]: pgmap v29: 0 pgs: ; 0 B data, 57 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T08:22:58.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:58 trial016 ceph-mon[39048]: from='osd.2 [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-17T08:22:59.510 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T08:22:59.665 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:22:59.688 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:59 trial016 ceph-mon[39048]: from='osd.2 [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-17T08:22:59.688 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:59 trial016 ceph-mon[39048]: osdmap e16: 3 total, 2 up, 3 in 2026-02-17T08:22:59.688 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:59 trial016 ceph-mon[39048]: from='osd.2 [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial016", "root=default"]}]: dispatch 2026-02-17T08:22:59.688 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:59 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T08:22:59.688 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:59 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1437652559' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T08:22:59.689 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:22:59 trial016 ceph-mon[39048]: from='osd.2 [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial016", "root=default"]}]': finished 2026-02-17T08:22:59.781 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 -- 10.20.193.16:0/3035588169 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2e800770a0 msgr2=0x7f2e80075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:59.781 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 --2- 10.20.193.16:0/3035588169 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2e800770a0 0x7f2e80075500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2e700099b0 tx=0x7f2e7002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:22:59.781 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 -- 10.20.193.16:0/3035588169 shutdown_connections 2026-02-17T08:22:59.781 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 --2- 10.20.193.16:0/3035588169 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2e800770a0 0x7f2e80075500 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:59.781 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 -- 10.20.193.16:0/3035588169 >> 10.20.193.16:0/3035588169 conn(0x7f2e800fdbb0 msgr2=0x7f2e800ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:59.781 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 -- 10.20.193.16:0/3035588169 shutdown_connections 2026-02-17T08:22:59.781 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 -- 10.20.193.16:0/3035588169 wait complete. 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 Processor -- start 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 -- start start 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2e800770a0 0x7f2e8019f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e877f5640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2e801055f0 con 0x7f2e800770a0 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e8556a640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2e800770a0 0x7f2e8019f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e8556a640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2e800770a0 0x7f2e8019f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58326/0 (socket says 10.20.193.16:58326) 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e8556a640 1 -- 10.20.193.16:0/3710178525 learned_addr learned my addr 10.20.193.16:0/3710178525 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.778+0000 7f2e8556a640 1 -- 10.20.193.16:0/3710178525 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8019fcf0 con 0x7f2e800770a0 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e8556a640 1 --2- 10.20.193.16:0/3710178525 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2e800770a0 0x7f2e8019f7b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e70002410 tx=0x7f2e70004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e6e7fc640 1 -- 10.20.193.16:0/3710178525 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e70038510 con 0x7f2e800770a0 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e6e7fc640 1 -- 10.20.193.16:0/3710178525 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f2e70046070 con 0x7f2e800770a0 2026-02-17T08:22:59.782 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e6e7fc640 1 -- 10.20.193.16:0/3710178525 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e70041760 con 0x7f2e800770a0 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e877f5640 1 -- 10.20.193.16:0/3710178525 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8019ff80 con 0x7f2e800770a0 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e877f5640 1 -- 10.20.193.16:0/3710178525 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e801a2c70 con 0x7f2e800770a0 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e877f5640 1 -- 10.20.193.16:0/3710178525 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e80105d90 con 0x7f2e800770a0 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e6e7fc640 1 -- 10.20.193.16:0/3710178525 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f2e700419d0 con 0x7f2e800770a0 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e6e7fc640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e6e7fc640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e6e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e6e7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e6e7fc640 1 --2- 10.20.193.16:0/3710178525 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2e5c03de80 0x7f2e5c040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.779+0000 7f2e6e7fc640 1 -- 10.20.193.16:0/3710178525 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2349+0+0 (secure 0 0 0) 0x7f2e70077720 con 0x7f2e800770a0 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.780+0000 7f2e84d69640 1 --2- 10.20.193.16:0/3710178525 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2e5c03de80 0x7f2e5c040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:22:59.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.780+0000 7f2e84d69640 1 --2- 10.20.193.16:0/3710178525 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2e5c03de80 0x7f2e5c040340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2e740099c0 tx=0x7f2e74006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:22:59.784 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.782+0000 7f2e6e7fc640 1 -- 10.20.193.16:0/3710178525 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2e70041cf0 con 0x7f2e800770a0 2026-02-17T08:22:59.865 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.864+0000 7f2e877f5640 1 -- 10.20.193.16:0/3710178525 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2e80198d90 con 0x7f2e800770a0 2026-02-17T08:22:59.865 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.864+0000 7f2e6e7fc640 1 -- 10.20.193.16:0/3710178525 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v17) ==== 74+0+130 (secure 0 0 0) 0x7f2e70038c90 con 0x7f2e800770a0 2026-02-17T08:22:59.866 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:22:59.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 10 mgrc shutdown 2026-02-17T08:22:59.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 1 -- 10.20.193.16:0/3710178525 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2e5c03de80 msgr2=0x7f2e5c040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:59.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 1 --2- 10.20.193.16:0/3710178525 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2e5c03de80 0x7f2e5c040340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2e740099c0 tx=0x7f2e74006eb0 comp rx=0 tx=0).stop 2026-02-17T08:22:59.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 1 -- 10.20.193.16:0/3710178525 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2e800770a0 msgr2=0x7f2e8019f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:22:59.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 1 --2- 10.20.193.16:0/3710178525 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2e800770a0 0x7f2e8019f7b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e70002410 tx=0x7f2e70004290 comp rx=0 tx=0).stop 2026-02-17T08:22:59.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 1 -- 10.20.193.16:0/3710178525 shutdown_connections 2026-02-17T08:22:59.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 1 --2- 10.20.193.16:0/3710178525 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2e5c03de80 0x7f2e5c040340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:59.867 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 1 --2- 10.20.193.16:0/3710178525 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2e800770a0 0x7f2e8019f7b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:22:59.868 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 1 -- 10.20.193.16:0/3710178525 >> 10.20.193.16:0/3710178525 conn(0x7f2e800fdbb0 msgr2=0x7f2e800fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:22:59.868 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 1 -- 10.20.193.16:0/3710178525 shutdown_connections 2026-02-17T08:22:59.868 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:22:59.865+0000 7f2e877f5640 1 -- 10.20.193.16:0/3710178525 wait complete. 2026-02-17T08:22:59.901 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":17,"num_osds":3,"num_up_osds":2,"osd_up_since":1771316569,"num_in_osds":3,"osd_in_since":1771316564,"num_remapped_pgs":0} 2026-02-17T08:23:00.119 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:22:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-2[62750]: 2026-02-17T08:22:59.726+0000 7fb032392640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T08:23:00.119 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:22:59 trial016 ceph-ad06c547-0bd9-11f1-adc2-d404e6e7d460-osd-2[62750]: 2026-02-17T08:22:59.729+0000 7fb02a9c6640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T08:23:00.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:00 trial016 ceph-mon[39048]: pgmap v31: 0 pgs: ; 0 B data, 57 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T08:23:00.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:00 trial016 ceph-mon[39048]: osdmap e17: 3 total, 2 up, 3 in 2026-02-17T08:23:00.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:00 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T08:23:00.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:00 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T08:23:00.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:00 trial016 ceph-mon[39048]: from='osd.2 [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815]' entity='osd.2' 2026-02-17T08:23:00.869 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:00 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3710178525' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T08:23:00.902 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T08:23:01.052 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:01.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 -- 10.20.193.16:0/1622308222 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1c8c077aa0 msgr2=0x7f1c8c077ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:01.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 --2- 10.20.193.16:0/1622308222 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1c8c077aa0 0x7f1c8c077ea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1c780099b0 tx=0x7f1c7802f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 -- 10.20.193.16:0/1622308222 shutdown_connections 2026-02-17T08:23:01.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 --2- 10.20.193.16:0/1622308222 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1c8c077aa0 0x7f1c8c077ea0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 -- 10.20.193.16:0/1622308222 >> 10.20.193.16:0/1622308222 conn(0x7f1c8c0ffe30 msgr2=0x7f1c8c102270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:01.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 -- 10.20.193.16:0/1622308222 shutdown_connections 2026-02-17T08:23:01.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 -- 10.20.193.16:0/1622308222 wait complete. 2026-02-17T08:23:01.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 Processor -- start 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 -- start start 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1c8c077aa0 0x7f1c8c19f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c925f3640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8c07af40 con 0x7f1c8c077aa0 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c8bfff640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1c8c077aa0 0x7f1c8c19f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c8bfff640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1c8c077aa0 0x7f1c8c19f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58304/0 (socket says 10.20.193.16:58304) 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.154+0000 7f1c8bfff640 1 -- 10.20.193.16:0/1007995992 learned_addr learned my addr 10.20.193.16:0/1007995992 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.155+0000 7f1c8bfff640 1 -- 10.20.193.16:0/1007995992 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8c19fcc0 con 0x7f1c8c077aa0 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.155+0000 7f1c8bfff640 1 --2- 10.20.193.16:0/1007995992 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1c8c077aa0 0x7f1c8c19f780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009ae0 tx=0x7f1c78004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.155+0000 7f1c897fa640 1 -- 10.20.193.16:0/1007995992 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c78038640 con 0x7f1c8c077aa0 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.155+0000 7f1c897fa640 1 -- 10.20.193.16:0/1007995992 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1c78046070 con 0x7f1c8c077aa0 2026-02-17T08:23:01.159 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.155+0000 7f1c925f3640 1 -- 10.20.193.16:0/1007995992 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c8c19ff50 con 0x7f1c8c077aa0 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.155+0000 7f1c897fa640 1 -- 10.20.193.16:0/1007995992 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c78041870 con 0x7f1c8c077aa0 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.155+0000 7f1c925f3640 1 -- 10.20.193.16:0/1007995992 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8c1a2c40 con 0x7f1c8c077aa0 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.155+0000 7f1c925f3640 1 -- 10.20.193.16:0/1007995992 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8c07b6e0 con 0x7f1c8c077aa0 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.155+0000 7f1c897fa640 1 -- 10.20.193.16:0/1007995992 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f1c780387e0 con 0x7f1c8c077aa0 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.155+0000 7f1c897fa640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.156+0000 7f1c897fa640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.156+0000 7f1c897fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.156+0000 7f1c897fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.156+0000 7f1c897fa640 1 --2- 10.20.193.16:0/1007995992 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1c6003de80 0x7f1c60040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.156+0000 7f1c897fa640 1 -- 10.20.193.16:0/1007995992 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2629+0+0 (secure 0 0 0) 0x7f1c78077a00 con 0x7f1c8c077aa0 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.156+0000 7f1c8b7fe640 1 --2- 10.20.193.16:0/1007995992 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1c6003de80 0x7f1c60040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:01.160 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.156+0000 7f1c8b7fe640 1 --2- 10.20.193.16:0/1007995992 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1c6003de80 0x7f1c60040340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0099c0 tx=0x7f1c7c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:01.161 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.158+0000 7f1c897fa640 1 -- 10.20.193.16:0/1007995992 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1c78040360 con 0x7f1c8c077aa0 2026-02-17T08:23:01.244 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.243+0000 7f1c925f3640 1 -- 10.20.193.16:0/1007995992 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1c8c198d70 con 0x7f1c8c077aa0 2026-02-17T08:23:01.244 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.243+0000 7f1c897fa640 1 -- 10.20.193.16:0/1007995992 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v18) ==== 74+0+130 (secure 0 0 0) 0x7f1c78049360 con 0x7f1c8c077aa0 2026-02-17T08:23:01.245 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:01.246 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 10 mgrc shutdown 2026-02-17T08:23:01.246 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 1 -- 10.20.193.16:0/1007995992 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1c6003de80 msgr2=0x7f1c60040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:01.246 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 1 --2- 10.20.193.16:0/1007995992 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1c6003de80 0x7f1c60040340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0099c0 tx=0x7f1c7c006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.246 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 1 -- 10.20.193.16:0/1007995992 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1c8c077aa0 msgr2=0x7f1c8c19f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:01.246 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 1 --2- 10.20.193.16:0/1007995992 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1c8c077aa0 0x7f1c8c19f780 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009ae0 tx=0x7f1c78004290 comp rx=0 tx=0).stop 2026-02-17T08:23:01.246 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 1 -- 10.20.193.16:0/1007995992 shutdown_connections 2026-02-17T08:23:01.246 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 1 --2- 10.20.193.16:0/1007995992 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f1c6003de80 0x7f1c60040340 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.246 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 1 --2- 10.20.193.16:0/1007995992 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f1c8c077aa0 0x7f1c8c19f780 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.246 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 1 -- 10.20.193.16:0/1007995992 >> 10.20.193.16:0/1007995992 conn(0x7f1c8c0ffe30 msgr2=0x7f1c8c1004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:01.247 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 1 -- 10.20.193.16:0/1007995992 shutdown_connections 2026-02-17T08:23:01.247 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.244+0000 7f1c925f3640 1 -- 10.20.193.16:0/1007995992 wait complete. 2026-02-17T08:23:01.280 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":18,"num_osds":3,"num_up_osds":3,"osd_up_since":1771316580,"num_in_osds":3,"osd_in_since":1771316564,"num_remapped_pgs":0} 2026-02-17T08:23:01.280 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T08:23:01.430 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:01.531 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:01 trial016 ceph-mon[39048]: purged_snaps scrub starts 2026-02-17T08:23:01.531 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:01 trial016 ceph-mon[39048]: purged_snaps scrub ok 2026-02-17T08:23:01.532 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:01 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T08:23:01.532 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:01 trial016 ceph-mon[39048]: osd.2 [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815] boot 2026-02-17T08:23:01.532 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:01 trial016 ceph-mon[39048]: osdmap e18: 3 total, 3 up, 3 in 2026-02-17T08:23:01.532 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:01 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T08:23:01.532 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:01 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-17T08:23:01.532 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:01 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1007995992' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T08:23:01.534 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.530+0000 7f4d0f73c640 1 -- 10.20.193.16:0/2709854791 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4d0810a4d0 msgr2=0x7f4d0810a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:01.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.530+0000 7f4d0f73c640 1 --2- 10.20.193.16:0/2709854791 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4d0810a4d0 0x7f4d0810a8b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4d000099b0 tx=0x7f4d0002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.530+0000 7f4d0f73c640 1 -- 10.20.193.16:0/2709854791 shutdown_connections 2026-02-17T08:23:01.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.530+0000 7f4d0f73c640 1 --2- 10.20.193.16:0/2709854791 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4d0810a4d0 0x7f4d0810a8b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.530+0000 7f4d0f73c640 1 -- 10.20.193.16:0/2709854791 >> 10.20.193.16:0/2709854791 conn(0x7f4d08100140 msgr2=0x7f4d08102560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:01.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.530+0000 7f4d0f73c640 1 -- 10.20.193.16:0/2709854791 shutdown_connections 2026-02-17T08:23:01.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.530+0000 7f4d0f73c640 1 -- 10.20.193.16:0/2709854791 wait complete. 2026-02-17T08:23:01.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.530+0000 7f4d0f73c640 1 Processor -- start 2026-02-17T08:23:01.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.530+0000 7f4d0f73c640 1 -- start start 2026-02-17T08:23:01.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4d0f73c640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4d0810a4d0 0x7f4d0819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:01.535 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4d0f73c640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0810de50 con 0x7f4d0810a4d0 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4d0e73a640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4d0810a4d0 0x7f4d0819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4d0e73a640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4d0810a4d0 0x7f4d0819b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58330/0 (socket says 10.20.193.16:58330) 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4d0e73a640 1 -- 10.20.193.16:0/356637275 learned_addr learned my addr 10.20.193.16:0/356637275 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4d0e73a640 1 -- 10.20.193.16:0/356637275 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0819b9f0 con 0x7f4d0810a4d0 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4d0e73a640 1 --2- 10.20.193.16:0/356637275 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4d0810a4d0 0x7f4d0819b4b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4d00004290 tx=0x7f4d000042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4cf37fe640 1 -- 10.20.193.16:0/356637275 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d00038510 con 0x7f4d0810a4d0 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4cf37fe640 1 -- 10.20.193.16:0/356637275 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f4d00046070 con 0x7f4d0810a4d0 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4d0f73c640 1 -- 10.20.193.16:0/356637275 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0819bc80 con 0x7f4d0810a4d0 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4cf37fe640 1 -- 10.20.193.16:0/356637275 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d00041610 con 0x7f4d0810a4d0 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4d0f73c640 1 -- 10.20.193.16:0/356637275 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0819fd80 con 0x7f4d0810a4d0 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.531+0000 7f4d0f73c640 1 -- 10.20.193.16:0/356637275 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d08105b80 con 0x7f4d0810a4d0 2026-02-17T08:23:01.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.532+0000 7f4cf37fe640 1 -- 10.20.193.16:0/356637275 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f4d000386b0 con 0x7f4d0810a4d0 2026-02-17T08:23:01.537 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.532+0000 7f4cf37fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:23:01.537 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.532+0000 7f4cf37fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:23:01.537 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.532+0000 7f4cf37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:01.537 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.532+0000 7f4cf37fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:01.537 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.532+0000 7f4cf37fe640 1 --2- 10.20.193.16:0/356637275 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4ce403de80 0x7f4ce4040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:01.537 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.532+0000 7f4cf37fe640 1 -- 10.20.193.16:0/356637275 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2629+0+0 (secure 0 0 0) 0x7f4d000778c0 con 0x7f4d0810a4d0 2026-02-17T08:23:01.537 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.532+0000 7f4d0df39640 1 --2- 10.20.193.16:0/356637275 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4ce403de80 0x7f4ce4040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:01.537 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.532+0000 7f4d0df39640 1 --2- 10.20.193.16:0/356637275 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4ce403de80 0x7f4ce4040340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40099c0 tx=0x7f4cf4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:01.538 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.535+0000 7f4cf37fe640 1 -- 10.20.193.16:0/356637275 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4d00040360 con 0x7f4d0810a4d0 2026-02-17T08:23:01.619 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.618+0000 7f4d0f73c640 1 -- 10.20.193.16:0/356637275 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d0810a930 con 0x7f4d0810a4d0 2026-02-17T08:23:01.620 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.618+0000 7f4cf37fe640 1 -- 10.20.193.16:0/356637275 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+5536 (secure 0 0 0) 0x7f4d00049360 con 0x7f4d0810a4d0 2026-02-17T08:23:01.620 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:01.620 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":18,"fsid":"ad06c547-0bd9-11f1-adc2-d404e6e7d460","created":"2026-02-17T08:21:51.185537+0000","modified":"2026-02-17T08:23:00.727415+0000","last_up_change":"2026-02-17T08:23:00.727415+0000","last_in_change":"2026-02-17T08:22:44.064758+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"43ca983a-2aaa-4c28-a6a4-57b52f31e54d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6803","nonce":2367982513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6805","nonce":2367982513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6808","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6809","nonce":2367982513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6807","nonce":2367982513}]},"public_addr":"10.20.193.16:6803/2367982513","cluster_addr":"10.20.193.16:6805/2367982513","heartbeat_back_addr":"10.20.193.16:6809/2367982513","heartbeat_front_addr":"10.20.193.16:6807/2367982513","state":["exists","up"]},{"osd":1,"uuid":"68806223-ddc9-4054-9293-6f4024b23bce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6810","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6811","nonce":914146540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6812","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6813","nonce":914146540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6816","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6817","nonce":914146540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6814","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6815","nonce":914146540}]},"public_addr":"10.20.193.16:6811/914146540","cluster_addr":"10.20.193.16:6813/914146540","heartbeat_back_addr":"10.20.193.16:6817/914146540","heartbeat_front_addr":"10.20.193.16:6815/914146540","state":["exists","up"]},{"osd":2,"uuid":"de18185e-a42b-49a0-b172-1983e20a8550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6818","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6819","nonce":2377130815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6820","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6821","nonce":2377130815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6824","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6825","nonce":2377130815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6822","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6823","nonce":2377130815}]},"public_addr":"10.20.193.16:6819/2377130815","cluster_addr":"10.20.193.16:6821/2377130815","heartbeat_back_addr":"10.20.193.16:6825/2377130815","heartbeat_front_addr":"10.20.193.16:6823/2377130815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T08:22:36.999879+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T08:22:48.129059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.16:0/4014033054":"2026-02-18T08:22:09.005983+0000","10.20.193.16:6801/2968480635":"2026-02-18T08:22:09.005983+0000","10.20.193.16:0/2733458708":"2026-02-18T08:22:09.005983+0000","10.20.193.16:0/336162453":"2026-02-18T08:22:09.005983+0000","10.20.193.16:0/1912223208":"2026-02-18T08:22:00.730706+0000","10.20.193.16:6800/2968480635":"2026-02-18T08:22:09.005983+0000","10.20.193.16:6801/1077302716":"2026-02-18T08:22:00.730706+0000","10.20.193.16:6800/1077302716":"2026-02-18T08:22:00.730706+0000","10.20.193.16:0/3151484323":"2026-02-18T08:22:00.730706+0000","10.20.193.16:0/1729636758":"2026-02-18T08:22:00.730706+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:23:01.621 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 10 mgrc shutdown 2026-02-17T08:23:01.622 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 1 -- 10.20.193.16:0/356637275 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4ce403de80 msgr2=0x7f4ce4040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:01.622 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 1 --2- 10.20.193.16:0/356637275 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4ce403de80 0x7f4ce4040340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40099c0 tx=0x7f4cf4006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.622 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 1 -- 10.20.193.16:0/356637275 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4d0810a4d0 msgr2=0x7f4d0819b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:01.622 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 1 --2- 10.20.193.16:0/356637275 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4d0810a4d0 0x7f4d0819b4b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4d00004290 tx=0x7f4d000042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.622 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 1 -- 10.20.193.16:0/356637275 shutdown_connections 2026-02-17T08:23:01.622 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 1 --2- 10.20.193.16:0/356637275 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f4ce403de80 0x7f4ce4040340 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.622 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 1 --2- 10.20.193.16:0/356637275 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f4d0810a4d0 0x7f4d0819b4b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.622 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 1 -- 10.20.193.16:0/356637275 >> 10.20.193.16:0/356637275 conn(0x7f4d08100140 msgr2=0x7f4d08108740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:01.622 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 1 -- 10.20.193.16:0/356637275 shutdown_connections 2026-02-17T08:23:01.622 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.619+0000 7f4d0f73c640 1 -- 10.20.193.16:0/356637275 wait complete. 2026-02-17T08:23:01.655 INFO:tasks.cephadm.ceph_manager.ceph:[] 2026-02-17T08:23:01.656 INFO:tasks.cephadm:Setting up client nodes... 2026-02-17T08:23:01.656 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-17T08:23:01.807 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:01.923 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.919+0000 7f70a2e27640 1 -- 10.20.193.16:0/934997072 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f709c1046b0 msgr2=0x7f709c104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:01.923 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.919+0000 7f70a2e27640 1 --2- 10.20.193.16:0/934997072 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f709c1046b0 0x7f709c104ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f708c0099b0 tx=0x7f708c02f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.923 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.919+0000 7f70a2e27640 1 -- 10.20.193.16:0/934997072 shutdown_connections 2026-02-17T08:23:01.923 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.919+0000 7f70a2e27640 1 --2- 10.20.193.16:0/934997072 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f709c1046b0 0x7f709c104ab0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:01.923 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.919+0000 7f70a2e27640 1 -- 10.20.193.16:0/934997072 >> 10.20.193.16:0/934997072 conn(0x7f709c0ffe60 msgr2=0x7f709c102280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:01.923 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.919+0000 7f70a2e27640 1 -- 10.20.193.16:0/934997072 shutdown_connections 2026-02-17T08:23:01.923 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.919+0000 7f70a2e27640 1 -- 10.20.193.16:0/934997072 wait complete. 2026-02-17T08:23:01.923 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a2e27640 1 Processor -- start 2026-02-17T08:23:01.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a2e27640 1 -- start start 2026-02-17T08:23:01.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a2e27640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f709c1046b0 0x7f709c19b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:01.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a2e27640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f709c109b30 con 0x7f709c1046b0 2026-02-17T08:23:01.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a0b9c640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f709c1046b0 0x7f709c19b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:01.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a0b9c640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f709c1046b0 0x7f709c19b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58340/0 (socket says 10.20.193.16:58340) 2026-02-17T08:23:01.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a0b9c640 1 -- 10.20.193.16:0/1086396623 learned_addr learned my addr 10.20.193.16:0/1086396623 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:01.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a0b9c640 1 -- 10.20.193.16:0/1086396623 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c19b7d0 con 0x7f709c1046b0 2026-02-17T08:23:01.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a0b9c640 1 --2- 10.20.193.16:0/1086396623 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f709c1046b0 0x7f709c19b290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f708c005ec0 tx=0x7f708c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:01.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f7091ffb640 1 -- 10.20.193.16:0/1086396623 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708c038510 con 0x7f709c1046b0 2026-02-17T08:23:01.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f7091ffb640 1 -- 10.20.193.16:0/1086396623 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f708c046070 con 0x7f709c1046b0 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a2e27640 1 -- 10.20.193.16:0/1086396623 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709c19ba60 con 0x7f709c1046b0 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f7091ffb640 1 -- 10.20.193.16:0/1086396623 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f708c041810 con 0x7f709c1046b0 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.920+0000 7f70a2e27640 1 -- 10.20.193.16:0/1086396623 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f709c19e750 con 0x7f709c1046b0 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.921+0000 7f70a2e27640 1 -- 10.20.193.16:0/1086396623 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f709c10a2d0 con 0x7f709c1046b0 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.921+0000 7f7091ffb640 1 -- 10.20.193.16:0/1086396623 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f708c0386b0 con 0x7f709c1046b0 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.921+0000 7f7091ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.921+0000 7f7091ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.921+0000 7f7091ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.921+0000 7f7091ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.921+0000 7f7091ffb640 1 --2- 10.20.193.16:0/1086396623 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f707803de80 0x7f7078040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.921+0000 7f7091ffb640 1 -- 10.20.193.16:0/1086396623 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3004+0+0 (secure 0 0 0) 0x7f708c077a30 con 0x7f709c1046b0 2026-02-17T08:23:01.925 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.921+0000 7f7093fff640 1 --2- 10.20.193.16:0/1086396623 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f707803de80 0x7f7078040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:01.926 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.921+0000 7f7093fff640 1 --2- 10.20.193.16:0/1086396623 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f707803de80 0x7f7078040340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f70840099c0 tx=0x7f7084006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:01.926 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:01.923+0000 7f7091ffb640 1 -- 10.20.193.16:0/1086396623 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f708c0389d0 con 0x7f709c1046b0 2026-02-17T08:23:02.037 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.036+0000 7f70a2e27640 1 -- 10.20.193.16:0/1086396623 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f709c194890 con 0x7f709c1046b0 2026-02-17T08:23:02.038 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.037+0000 7f7091ffb640 1 -- 10.20.193.16:0/1086396623 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v7) ==== 170+0+59 (secure 0 0 0) 0x7f708c037cd0 con 0x7f709c1046b0 2026-02-17T08:23:02.038 INFO:teuthology.orchestra.run.trial016.stdout:[client.0] 2026-02-17T08:23:02.038 INFO:teuthology.orchestra.run.trial016.stdout: key = AQBmJZRp+q83AhAASVcsigm2keUz/iJ07gwmdg== 2026-02-17T08:23:02.039 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 10 mgrc shutdown 2026-02-17T08:23:02.039 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 1 -- 10.20.193.16:0/1086396623 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f707803de80 msgr2=0x7f7078040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:02.039 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 1 --2- 10.20.193.16:0/1086396623 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f707803de80 0x7f7078040340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f70840099c0 tx=0x7f7084006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.040 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 1 -- 10.20.193.16:0/1086396623 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f709c1046b0 msgr2=0x7f709c19b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:02.040 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 1 --2- 10.20.193.16:0/1086396623 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f709c1046b0 0x7f709c19b290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f708c005ec0 tx=0x7f708c004290 comp rx=0 tx=0).stop 2026-02-17T08:23:02.040 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 1 -- 10.20.193.16:0/1086396623 shutdown_connections 2026-02-17T08:23:02.040 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 1 --2- 10.20.193.16:0/1086396623 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f707803de80 0x7f7078040340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.040 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 1 --2- 10.20.193.16:0/1086396623 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f709c1046b0 0x7f709c19b290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.040 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 1 -- 10.20.193.16:0/1086396623 >> 10.20.193.16:0/1086396623 conn(0x7f709c0ffe60 msgr2=0x7f709c100440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:02.040 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 1 -- 10.20.193.16:0/1086396623 shutdown_connections 2026-02-17T08:23:02.040 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.038+0000 7f70a2e27640 1 -- 10.20.193.16:0/1086396623 wait complete. 2026-02-17T08:23:02.075 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:23:02.076 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-17T08:23:02.076 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T08:23:02.111 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-17T08:23:02.257 INFO:teuthology.orchestra.run.trial134.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/config/ceph.conf 2026-02-17T08:23:02.371 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.367+0000 7fda99953640 1 -- 10.20.193.134:0/2813123910 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fda941045b0 msgr2=0x7fda941049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:02.372 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.367+0000 7fda99953640 1 --2- 10.20.193.134:0/2813123910 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fda941045b0 0x7fda941049b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda880099b0 tx=0x7fda8802f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.372 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda99953640 1 -- 10.20.193.134:0/2813123910 shutdown_connections 2026-02-17T08:23:02.372 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda99953640 1 --2- 10.20.193.134:0/2813123910 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fda941045b0 0x7fda941049b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.372 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda99953640 1 -- 10.20.193.134:0/2813123910 >> 10.20.193.134:0/2813123910 conn(0x7fda940ffd70 msgr2=0x7fda94102180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:02.372 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda99953640 1 -- 10.20.193.134:0/2813123910 shutdown_connections 2026-02-17T08:23:02.372 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda99953640 1 -- 10.20.193.134:0/2813123910 wait complete. 2026-02-17T08:23:02.372 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda99953640 1 Processor -- start 2026-02-17T08:23:02.372 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda99953640 1 -- start start 2026-02-17T08:23:02.372 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda99953640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fda941045b0 0x7fda9419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:02.372 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda99953640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fda94109a30 con 0x7fda941045b0 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda92ffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fda941045b0 0x7fda9419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda92ffd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fda941045b0 0x7fda9419b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.134:35080/0 (socket says 10.20.193.134:35080) 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.368+0000 7fda92ffd640 1 -- 10.20.193.134:0/2840772521 learned_addr learned my addr 10.20.193.134:0/2840772521 (peer_addr_for_me v2:10.20.193.134:0/0) 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.369+0000 7fda92ffd640 1 -- 10.20.193.134:0/2840772521 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9419b6d0 con 0x7fda941045b0 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.369+0000 7fda92ffd640 1 --2- 10.20.193.134:0/2840772521 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fda941045b0 0x7fda9419b190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda88005ec0 tx=0x7fda88004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.369+0000 7fda98951640 1 -- 10.20.193.134:0/2840772521 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda88038510 con 0x7fda941045b0 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.369+0000 7fda99953640 1 -- 10.20.193.134:0/2840772521 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9419b960 con 0x7fda941045b0 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.369+0000 7fda98951640 1 -- 10.20.193.134:0/2840772521 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fda88046070 con 0x7fda941045b0 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.369+0000 7fda98951640 1 -- 10.20.193.134:0/2840772521 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda88041810 con 0x7fda941045b0 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.369+0000 7fda99953640 1 -- 10.20.193.134:0/2840772521 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9419e650 con 0x7fda941045b0 2026-02-17T08:23:02.373 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.369+0000 7fda99953640 1 -- 10.20.193.134:0/2840772521 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9410a1d0 con 0x7fda941045b0 2026-02-17T08:23:02.375 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.370+0000 7fda98951640 1 -- 10.20.193.134:0/2840772521 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fda880386b0 con 0x7fda941045b0 2026-02-17T08:23:02.375 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.370+0000 7fda98951640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:23:02.375 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.370+0000 7fda98951640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:23:02.375 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.370+0000 7fda98951640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:02.375 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.370+0000 7fda98951640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:02.375 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.370+0000 7fda98951640 1 --2- 10.20.193.134:0/2840772521 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fda6803de30 0x7fda680402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:02.375 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.370+0000 7fda98951640 1 -- 10.20.193.134:0/2840772521 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3004+0+0 (secure 0 0 0) 0x7fda880782d0 con 0x7fda941045b0 2026-02-17T08:23:02.375 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.370+0000 7fda927fc640 1 --2- 10.20.193.134:0/2840772521 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fda6803de30 0x7fda680402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:02.375 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.371+0000 7fda927fc640 1 --2- 10.20.193.134:0/2840772521 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fda6803de30 0x7fda680402f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0099c0 tx=0x7fda7c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:02.376 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.372+0000 7fda98951640 1 -- 10.20.193.134:0/2840772521 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fda880389d0 con 0x7fda941045b0 2026-02-17T08:23:02.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.486+0000 7fda99953640 1 -- 10.20.193.134:0/2840772521 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fda94194790 con 0x7fda941045b0 2026-02-17T08:23:02.488 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda98951640 1 -- 10.20.193.134:0/2840772521 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v8) ==== 170+0+59 (secure 0 0 0) 0x7fda88038db0 con 0x7fda941045b0 2026-02-17T08:23:02.488 INFO:teuthology.orchestra.run.trial134.stdout:[client.1] 2026-02-17T08:23:02.488 INFO:teuthology.orchestra.run.trial134.stdout: key = AQBmJZRprWIWHRAAwEkT1Eff38B487G550YsqQ== 2026-02-17T08:23:02.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 10 mgrc shutdown 2026-02-17T08:23:02.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 1 -- 10.20.193.134:0/2840772521 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fda6803de30 msgr2=0x7fda680402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:02.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 1 --2- 10.20.193.134:0/2840772521 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fda6803de30 0x7fda680402f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0099c0 tx=0x7fda7c006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 1 -- 10.20.193.134:0/2840772521 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fda941045b0 msgr2=0x7fda9419b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:02.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 1 --2- 10.20.193.134:0/2840772521 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fda941045b0 0x7fda9419b190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda88005ec0 tx=0x7fda88004290 comp rx=0 tx=0).stop 2026-02-17T08:23:02.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 1 -- 10.20.193.134:0/2840772521 shutdown_connections 2026-02-17T08:23:02.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 1 --2- 10.20.193.134:0/2840772521 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fda6803de30 0x7fda680402f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.489 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 1 --2- 10.20.193.134:0/2840772521 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fda941045b0 0x7fda9419b190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.490 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 1 -- 10.20.193.134:0/2840772521 >> 10.20.193.134:0/2840772521 conn(0x7fda940ffd70 msgr2=0x7fda941003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:02.490 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 1 -- 10.20.193.134:0/2840772521 shutdown_connections 2026-02-17T08:23:02.490 INFO:teuthology.orchestra.run.trial134.stderr:2026-02-17T08:23:02.487+0000 7fda99953640 1 -- 10.20.193.134:0/2840772521 wait complete. 2026-02-17T08:23:02.537 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:23:02.537 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-17T08:23:02.537 DEBUG:teuthology.orchestra.run.trial134:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-17T08:23:02.616 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T08:23:02.616 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-17T08:23:02.616 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-17T08:23:02.766 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:02.788 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:02 trial016 ceph-mon[39048]: pgmap v34: 0 pgs: ; 0 B data, 57 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T08:23:02.788 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:02 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/356637275' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T08:23:02.788 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:02 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-17T08:23:02.789 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:02 trial016 ceph-mon[39048]: osdmap e19: 3 total, 3 up, 3 in 2026-02-17T08:23:02.789 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:02 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-17T08:23:02.789 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:02 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1086396623' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T08:23:02.789 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:02 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1086396623' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T08:23:02.869 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.865+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/2141895829 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6c6810a640 msgr2=0x7f6c6810aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:02.869 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.865+0000 7f6c6cfb9640 1 --2- 10.20.193.16:0/2141895829 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6c6810a640 0x7f6c6810aa20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0099b0 tx=0x7f6c5c02f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.869 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/2141895829 shutdown_connections 2026-02-17T08:23:02.869 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c6cfb9640 1 --2- 10.20.193.16:0/2141895829 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6c6810a640 0x7f6c6810aa20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.869 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/2141895829 >> 10.20.193.16:0/2141895829 conn(0x7f6c681006d0 msgr2=0x7f6c68102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:02.869 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/2141895829 shutdown_connections 2026-02-17T08:23:02.869 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/2141895829 wait complete. 2026-02-17T08:23:02.869 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c6cfb9640 1 Processor -- start 2026-02-17T08:23:02.869 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c6cfb9640 1 -- start start 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c6cfb9640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6c6810a640 0x7f6c6819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c6cfb9640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6810e050 con 0x7f6c6810a640 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c66575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6c6810a640 0x7f6c6819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c66575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6c6810a640 0x7f6c6819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58364/0 (socket says 10.20.193.16:58364) 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c66575640 1 -- 10.20.193.16:0/1530998717 learned_addr learned my addr 10.20.193.16:0/1530998717 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c66575640 1 -- 10.20.193.16:0/1530998717 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6819bb90 con 0x7f6c6810a640 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c66575640 1 --2- 10.20.193.16:0/1530998717 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6c6810a640 0x7f6c6819b650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c004290 tx=0x7f6c5c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c4f7fe640 1 -- 10.20.193.16:0/1530998717 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c5c038510 con 0x7f6c6810a640 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.866+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/1530998717 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6819be20 con 0x7f6c6810a640 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c4f7fe640 1 -- 10.20.193.16:0/1530998717 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f6c5c046070 con 0x7f6c6810a640 2026-02-17T08:23:02.870 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c4f7fe640 1 -- 10.20.193.16:0/1530998717 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c5c041610 con 0x7f6c6810a640 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/1530998717 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6819ff20 con 0x7f6c6810a640 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/1530998717 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c68105d80 con 0x7f6c6810a640 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c4f7fe640 1 -- 10.20.193.16:0/1530998717 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f6c5c0386b0 con 0x7f6c6810a640 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c4f7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c4f7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c4f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c4f7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c4f7fe640 1 --2- 10.20.193.16:0/1530998717 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6c4003de30 0x7f6c400402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c4f7fe640 1 -- 10.20.193.16:0/1530998717 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7f6c5c077a30 con 0x7f6c6810a640 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.867+0000 7f6c65d74640 1 --2- 10.20.193.16:0/1530998717 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6c4003de30 0x7f6c400402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:02.871 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.868+0000 7f6c65d74640 1 --2- 10.20.193.16:0/1530998717 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6c4003de30 0x7f6c400402f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c500099c0 tx=0x7f6c50006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:02.872 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.870+0000 7f6c4f7fe640 1 -- 10.20.193.16:0/1530998717 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6c5c040360 con 0x7f6c6810a640 2026-02-17T08:23:02.975 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.975+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/1530998717 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6c6810aaa0 con 0x7f6c6810a640 2026-02-17T08:23:02.976 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.976+0000 7f6c4f7fe640 1 -- 10.20.193.16:0/1530998717 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v13) ==== 74+0+96878 (secure 0 0 0) 0x7f6c5c049360 con 0x7f6c6810a640 2026-02-17T08:23:02.978 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:02.979 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 10 mgrc shutdown 2026-02-17T08:23:02.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/1530998717 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6c4003de30 msgr2=0x7f6c400402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:02.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 1 --2- 10.20.193.16:0/1530998717 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6c4003de30 0x7f6c400402f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c500099c0 tx=0x7f6c50006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/1530998717 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6c6810a640 msgr2=0x7f6c6819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:02.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 1 --2- 10.20.193.16:0/1530998717 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6c6810a640 0x7f6c6819b650 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c004290 tx=0x7f6c5c0042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/1530998717 shutdown_connections 2026-02-17T08:23:02.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 1 --2- 10.20.193.16:0/1530998717 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f6c4003de30 0x7f6c400402f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 1 --2- 10.20.193.16:0/1530998717 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f6c6810a640 0x7f6c6819b650 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:02.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/1530998717 >> 10.20.193.16:0/1530998717 conn(0x7f6c681006d0 msgr2=0x7f6c68106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:02.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/1530998717 shutdown_connections 2026-02-17T08:23:02.980 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:02.978+0000 7f6c6cfb9640 1 -- 10.20.193.16:0/1530998717 wait complete. 2026-02-17T08:23:03.016 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":13,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6800","nonce":2397623389},{"type":"v1","addr":"10.20.193.16:6801","nonce":2397623389}]},"active_addr":"10.20.193.16:6801/2397623389","active_change":"2026-02-17T08:22:09.006099+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.16:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.16:0","nonce":401679493}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.16:0","nonce":226538997}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.16:0","nonce":2653736851}]}]} 2026-02-17T08:23:03.020 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-17T08:23:03.020 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-17T08:23:03.021 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T08:23:03.039 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:23:02 trial016 sudo[67229]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-17T08:23:03.039 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:23:02 trial016 sudo[67229]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T08:23:03.039 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:23:02 trial016 sudo[67229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T08:23:03.039 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67229]: pam_unix(sudo:session): session closed for user root 2026-02-17T08:23:03.039 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67249]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-17T08:23:03.039 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67249]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T08:23:03.040 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T08:23:03.040 INFO:journalctl@ceph.osd.0.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67249]: pam_unix(sudo:session): session closed for user root 2026-02-17T08:23:03.178 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:03.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 -- 10.20.193.16:0/4112886550 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f159c10a650 msgr2=0x7f159c10aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:03.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 --2- 10.20.193.16:0/4112886550 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f159c10a650 0x7f159c10aa30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f15900099b0 tx=0x7f159002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 -- 10.20.193.16:0/4112886550 shutdown_connections 2026-02-17T08:23:03.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 --2- 10.20.193.16:0/4112886550 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f159c10a650 0x7f159c10aa30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 -- 10.20.193.16:0/4112886550 >> 10.20.193.16:0/4112886550 conn(0x7f159c100330 msgr2=0x7f159c102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:03.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 -- 10.20.193.16:0/4112886550 shutdown_connections 2026-02-17T08:23:03.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 -- 10.20.193.16:0/4112886550 wait complete. 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 Processor -- start 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 -- start start 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f159c10a650 0x7f159c19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f15a0f49640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f159c10e060 con 0x7f159c10a650 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f159a575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f159c10a650 0x7f159c19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f159a575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f159c10a650 0x7f159c19b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58410/0 (socket says 10.20.193.16:58410) 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f159a575640 1 -- 10.20.193.16:0/1092836815 learned_addr learned my addr 10.20.193.16:0/1092836815 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f159a575640 1 -- 10.20.193.16:0/1092836815 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159c19bb70 con 0x7f159c10a650 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.280+0000 7f159a575640 1 --2- 10.20.193.16:0/1092836815 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f159c10a650 0x7f159c19b630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1590004290 tx=0x7f15900042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.281+0000 7f15837fe640 1 -- 10.20.193.16:0/1092836815 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1590038510 con 0x7f159c10a650 2026-02-17T08:23:03.284 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.281+0000 7f15a0f49640 1 -- 10.20.193.16:0/1092836815 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159c19be00 con 0x7f159c10a650 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.281+0000 7f15837fe640 1 -- 10.20.193.16:0/1092836815 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1590046070 con 0x7f159c10a650 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.281+0000 7f15837fe640 1 -- 10.20.193.16:0/1092836815 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1590041610 con 0x7f159c10a650 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.281+0000 7f15a0f49640 1 -- 10.20.193.16:0/1092836815 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f159c19ff00 con 0x7f159c10a650 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.281+0000 7f15a0f49640 1 -- 10.20.193.16:0/1092836815 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159c105d90 con 0x7f159c10a650 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.281+0000 7f15837fe640 1 -- 10.20.193.16:0/1092836815 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7f15900418c0 con 0x7f159c10a650 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.281+0000 7f15837fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.282+0000 7f15837fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.282+0000 7f15837fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.282+0000 7f15837fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.282+0000 7f15837fe640 1 --2- 10.20.193.16:0/1092836815 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f157403de80 0x7f1574040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.282+0000 7f15837fe640 1 -- 10.20.193.16:0/1092836815 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7f1590078290 con 0x7f159c10a650 2026-02-17T08:23:03.285 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.282+0000 7f1599d74640 1 --2- 10.20.193.16:0/1092836815 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f157403de80 0x7f1574040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:03.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.282+0000 7f1599d74640 1 --2- 10.20.193.16:0/1092836815 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f157403de80 0x7f1574040340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f15840099c0 tx=0x7f1584006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:03.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.284+0000 7f15837fe640 1 -- 10.20.193.16:0/1092836815 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1590046d90 con 0x7f159c10a650 2026-02-17T08:23:03.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67294]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-17T08:23:03.292 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67294]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T08:23:03.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T08:23:03.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67294]: pam_unix(sudo:session): session closed for user root 2026-02-17T08:23:03.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67310]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-17T08:23:03.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67310]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T08:23:03.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T08:23:03.293 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67310]: pam_unix(sudo:session): session closed for user root 2026-02-17T08:23:03.293 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67266]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-17T08:23:03.293 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67266]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T08:23:03.294 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T08:23:03.294 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67266]: pam_unix(sudo:session): session closed for user root 2026-02-17T08:23:03.294 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67282]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-17T08:23:03.294 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67282]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T08:23:03.294 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T08:23:03.294 INFO:journalctl@ceph.osd.1.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67282]: pam_unix(sudo:session): session closed for user root 2026-02-17T08:23:03.294 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67286]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-17T08:23:03.294 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67286]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T08:23:03.294 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T08:23:03.295 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67286]: pam_unix(sudo:session): session closed for user root 2026-02-17T08:23:03.295 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67290]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-17T08:23:03.295 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67290]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T08:23:03.295 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T08:23:03.295 INFO:journalctl@ceph.osd.2.trial016.stdout:Feb 17 08:23:03 trial016 sudo[67290]: pam_unix(sudo:session): session closed for user root 2026-02-17T08:23:03.374 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.373+0000 7f15a0f49640 1 -- 10.20.193.16:0/1092836815 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f159c10aab0 con 0x7f159c10a650 2026-02-17T08:23:03.374 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.373+0000 7f15837fe640 1 -- 10.20.193.16:0/1092836815 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+7384 (secure 0 0 0) 0x7f1590076520 con 0x7f159c10a650 2026-02-17T08:23:03.375 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:03.375 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":20,"fsid":"ad06c547-0bd9-11f1-adc2-d404e6e7d460","created":"2026-02-17T08:21:51.185537+0000","modified":"2026-02-17T08:23:02.730034+0000","last_up_change":"2026-02-17T08:23:00.727415+0000","last_in_change":"2026-02-17T08:22:44.064758+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T08:23:01.039279+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43ca983a-2aaa-4c28-a6a4-57b52f31e54d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6803","nonce":2367982513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6805","nonce":2367982513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6808","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6809","nonce":2367982513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6807","nonce":2367982513}]},"public_addr":"10.20.193.16:6803/2367982513","cluster_addr":"10.20.193.16:6805/2367982513","heartbeat_back_addr":"10.20.193.16:6809/2367982513","heartbeat_front_addr":"10.20.193.16:6807/2367982513","state":["exists","up"]},{"osd":1,"uuid":"68806223-ddc9-4054-9293-6f4024b23bce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6810","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6811","nonce":914146540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6812","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6813","nonce":914146540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6816","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6817","nonce":914146540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6814","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6815","nonce":914146540}]},"public_addr":"10.20.193.16:6811/914146540","cluster_addr":"10.20.193.16:6813/914146540","heartbeat_back_addr":"10.20.193.16:6817/914146540","heartbeat_front_addr":"10.20.193.16:6815/914146540","state":["exists","up"]},{"osd":2,"uuid":"de18185e-a42b-49a0-b172-1983e20a8550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6818","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6819","nonce":2377130815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6820","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6821","nonce":2377130815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6824","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6825","nonce":2377130815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6822","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6823","nonce":2377130815}]},"public_addr":"10.20.193.16:6819/2377130815","cluster_addr":"10.20.193.16:6821/2377130815","heartbeat_back_addr":"10.20.193.16:6825/2377130815","heartbeat_front_addr":"10.20.193.16:6823/2377130815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T08:22:36.999879+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T08:22:48.129059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T08:22:59.012799+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.16:0/4014033054":"2026-02-18T08:22:09.005983+0000","10.20.193.16:6801/2968480635":"2026-02-18T08:22:09.005983+0000","10.20.193.16:0/2733458708":"2026-02-18T08:22:09.005983+0000","10.20.193.16:0/336162453":"2026-02-18T08:22:09.005983+0000","10.20.193.16:0/1912223208":"2026-02-18T08:22:00.730706+0000","10.20.193.16:6800/2968480635":"2026-02-18T08:22:09.005983+0000","10.20.193.16:6801/1077302716":"2026-02-18T08:22:00.730706+0000","10.20.193.16:6800/1077302716":"2026-02-18T08:22:00.730706+0000","10.20.193.16:0/3151484323":"2026-02-18T08:22:00.730706+0000","10.20.193.16:0/1729636758":"2026-02-18T08:22:00.730706+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:23:03.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 10 mgrc shutdown 2026-02-17T08:23:03.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 1 -- 10.20.193.16:0/1092836815 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f157403de80 msgr2=0x7f1574040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:03.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 1 --2- 10.20.193.16:0/1092836815 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f157403de80 0x7f1574040340 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f15840099c0 tx=0x7f1584006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 1 -- 10.20.193.16:0/1092836815 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f159c10a650 msgr2=0x7f159c19b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:03.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 1 --2- 10.20.193.16:0/1092836815 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f159c10a650 0x7f159c19b630 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1590004290 tx=0x7f15900042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 1 -- 10.20.193.16:0/1092836815 shutdown_connections 2026-02-17T08:23:03.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 1 --2- 10.20.193.16:0/1092836815 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f157403de80 0x7f1574040340 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 1 --2- 10.20.193.16:0/1092836815 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f159c10a650 0x7f159c19b630 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.376 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 1 -- 10.20.193.16:0/1092836815 >> 10.20.193.16:0/1092836815 conn(0x7f159c100330 msgr2=0x7f159c108830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:03.377 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 1 -- 10.20.193.16:0/1092836815 shutdown_connections 2026-02-17T08:23:03.377 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.374+0000 7f15a0f49640 1 -- 10.20.193.16:0/1092836815 wait complete. 2026-02-17T08:23:03.410 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-17T08:23:03.411 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T08:23:03.596 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:03.617 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: from='client.? 10.20.193.134:0/2840772521' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T08:23:03.617 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: from='client.? 10.20.193.134:0/2840772521' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T08:23:03.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-17T08:23:03.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: osdmap e20: 3 total, 3 up, 3 in 2026-02-17T08:23:03.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1530998717' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-17T08:23:03.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:23:03.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' 2026-02-17T08:23:03.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T08:23:03.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T08:23:03.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: from='mgr.14150 10.20.193.16:0/2334044684' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T08:23:03.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:03 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1092836815' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T08:23:03.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.697+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/707988369 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb9b410a640 msgr2=0x7fb9b410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:03.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.697+0000 7fb9bc9b8640 1 --2- 10.20.193.16:0/707988369 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb9b410a640 0x7fb9b410aa20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0099b0 tx=0x7fb9ac02f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.697+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/707988369 shutdown_connections 2026-02-17T08:23:03.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.697+0000 7fb9bc9b8640 1 --2- 10.20.193.16:0/707988369 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb9b410a640 0x7fb9b410aa20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.697+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/707988369 >> 10.20.193.16:0/707988369 conn(0x7fb9b41006d0 msgr2=0x7fb9b4102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:03.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.697+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/707988369 shutdown_connections 2026-02-17T08:23:03.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.697+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/707988369 wait complete. 2026-02-17T08:23:03.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9bc9b8640 1 Processor -- start 2026-02-17T08:23:03.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9bc9b8640 1 -- start start 2026-02-17T08:23:03.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9bc9b8640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb9b410a640 0x7fb9b419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:03.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9bc9b8640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b410e050 con 0x7fb9b410a640 2026-02-17T08:23:03.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9ba72d640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb9b410a640 0x7fb9b419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:03.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9ba72d640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb9b410a640 0x7fb9b419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58436/0 (socket says 10.20.193.16:58436) 2026-02-17T08:23:03.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9ba72d640 1 -- 10.20.193.16:0/2340986029 learned_addr learned my addr 10.20.193.16:0/2340986029 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:03.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9ba72d640 1 -- 10.20.193.16:0/2340986029 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b419bb90 con 0x7fb9b410a640 2026-02-17T08:23:03.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9ba72d640 1 --2- 10.20.193.16:0/2340986029 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb9b410a640 0x7fb9b419b650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac004290 tx=0x7fb9ac0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:03.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb99f7fe640 1 -- 10.20.193.16:0/2340986029 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac038510 con 0x7fb9b410a640 2026-02-17T08:23:03.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb99f7fe640 1 -- 10.20.193.16:0/2340986029 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fb9ac046070 con 0x7fb9b410a640 2026-02-17T08:23:03.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/2340986029 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b419be20 con 0x7fb9b410a640 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb99f7fe640 1 -- 10.20.193.16:0/2340986029 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9ac041610 con 0x7fb9b410a640 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.698+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/2340986029 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b419ff20 con 0x7fb9b410a640 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.699+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/2340986029 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b4105d80 con 0x7fb9b410a640 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.699+0000 7fb99f7fe640 1 -- 10.20.193.16:0/2340986029 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 13) ==== 50381+0+0 (secure 0 0 0) 0x7fb9ac0386b0 con 0x7fb9b410a640 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.699+0000 7fb99f7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.699+0000 7fb99f7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.699+0000 7fb99f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.699+0000 7fb99f7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.699+0000 7fb99f7fe640 1 --2- 10.20.193.16:0/2340986029 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb99003de80 0x7fb990040340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.699+0000 7fb99f7fe640 1 -- 10.20.193.16:0/2340986029 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7fb9ac077980 con 0x7fb9b410a640 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.699+0000 7fb9b9f2c640 1 --2- 10.20.193.16:0/2340986029 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb99003de80 0x7fb990040340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:03.703 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.699+0000 7fb9b9f2c640 1 --2- 10.20.193.16:0/2340986029 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb99003de80 0x7fb990040340 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00099c0 tx=0x7fb9a0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:03.704 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.702+0000 7fb99f7fe640 1 -- 10.20.193.16:0/2340986029 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb9ac040360 con 0x7fb9b410a640 2026-02-17T08:23:03.737 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.736+0000 7fb99f7fe640 1 -- 10.20.193.16:0/2340986029 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7fb9ac04b460 con 0x7fb9b410a640 2026-02-17T08:23:03.737 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.736+0000 7fb99f7fe640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:03.738 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.736+0000 7fb99f7fe640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:03.738 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.736+0000 7fb99f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:03.787 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.787+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/2340986029 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9b410aaa0 con 0x7fb9b410a640 2026-02-17T08:23:03.788 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.787+0000 7fb99f7fe640 1 -- 10.20.193.16:0/2340986029 <== mon.0 v2:10.20.193.16:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+7371 (secure 0 0 0) 0x7fb9ac049360 con 0x7fb9b410a640 2026-02-17T08:23:03.789 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:03.789 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":21,"fsid":"ad06c547-0bd9-11f1-adc2-d404e6e7d460","created":"2026-02-17T08:21:51.185537+0000","modified":"2026-02-17T08:23:03.730799+0000","last_up_change":"2026-02-17T08:23:00.727415+0000","last_in_change":"2026-02-17T08:22:44.064758+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T08:23:01.039279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"43ca983a-2aaa-4c28-a6a4-57b52f31e54d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6803","nonce":2367982513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6805","nonce":2367982513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6808","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6809","nonce":2367982513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":2367982513},{"type":"v1","addr":"10.20.193.16:6807","nonce":2367982513}]},"public_addr":"10.20.193.16:6803/2367982513","cluster_addr":"10.20.193.16:6805/2367982513","heartbeat_back_addr":"10.20.193.16:6809/2367982513","heartbeat_front_addr":"10.20.193.16:6807/2367982513","state":["exists","up"]},{"osd":1,"uuid":"68806223-ddc9-4054-9293-6f4024b23bce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6810","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6811","nonce":914146540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6812","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6813","nonce":914146540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6816","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6817","nonce":914146540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6814","nonce":914146540},{"type":"v1","addr":"10.20.193.16:6815","nonce":914146540}]},"public_addr":"10.20.193.16:6811/914146540","cluster_addr":"10.20.193.16:6813/914146540","heartbeat_back_addr":"10.20.193.16:6817/914146540","heartbeat_front_addr":"10.20.193.16:6815/914146540","state":["exists","up"]},{"osd":2,"uuid":"de18185e-a42b-49a0-b172-1983e20a8550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6818","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6819","nonce":2377130815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6820","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6821","nonce":2377130815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6824","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6825","nonce":2377130815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6822","nonce":2377130815},{"type":"v1","addr":"10.20.193.16:6823","nonce":2377130815}]},"public_addr":"10.20.193.16:6819/2377130815","cluster_addr":"10.20.193.16:6821/2377130815","heartbeat_back_addr":"10.20.193.16:6825/2377130815","heartbeat_front_addr":"10.20.193.16:6823/2377130815","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T08:22:36.999879+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T08:22:48.129059+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T08:22:59.012799+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.16:0/4014033054":"2026-02-18T08:22:09.005983+0000","10.20.193.16:6801/2968480635":"2026-02-18T08:22:09.005983+0000","10.20.193.16:0/2733458708":"2026-02-18T08:22:09.005983+0000","10.20.193.16:0/336162453":"2026-02-18T08:22:09.005983+0000","10.20.193.16:0/1912223208":"2026-02-18T08:22:00.730706+0000","10.20.193.16:6800/2968480635":"2026-02-18T08:22:09.005983+0000","10.20.193.16:6801/1077302716":"2026-02-18T08:22:00.730706+0000","10.20.193.16:6800/1077302716":"2026-02-18T08:22:00.730706+0000","10.20.193.16:0/3151484323":"2026-02-18T08:22:00.730706+0000","10.20.193.16:0/1729636758":"2026-02-18T08:22:00.730706+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T08:23:03.790 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 10 mgrc shutdown 2026-02-17T08:23:03.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/2340986029 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb99003de80 msgr2=0x7fb990040340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:03.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 1 --2- 10.20.193.16:0/2340986029 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb99003de80 0x7fb990040340 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00099c0 tx=0x7fb9a0006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/2340986029 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb9b410a640 msgr2=0x7fb9b419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:03.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 1 --2- 10.20.193.16:0/2340986029 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb9b410a640 0x7fb9b419b650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac004290 tx=0x7fb9ac0042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/2340986029 shutdown_connections 2026-02-17T08:23:03.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 1 --2- 10.20.193.16:0/2340986029 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fb99003de80 0x7fb990040340 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 1 --2- 10.20.193.16:0/2340986029 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fb9b410a640 0x7fb9b419b650 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:03.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/2340986029 >> 10.20.193.16:0/2340986029 conn(0x7fb9b41006d0 msgr2=0x7fb9b4106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:03.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/2340986029 shutdown_connections 2026-02-17T08:23:03.791 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:03.788+0000 7fb9bc9b8640 1 -- 10.20.193.16:0/2340986029 wait complete. 2026-02-17T08:23:03.826 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-17T08:23:03.826 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-17T08:23:03.827 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-17T08:23:03.983 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:03.984 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:03.986 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:04.094 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7f3800e23640 1 -- 10.20.193.16:0/1223148405 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f37fc10a640 msgr2=0x7f37fc10aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.094 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7f3800e23640 1 --2- 10.20.193.16:0/1223148405 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f37fc10a640 0x7f37fc10aa20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f37f00099b0 tx=0x7f37f002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.094 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7f3800e23640 1 -- 10.20.193.16:0/1223148405 shutdown_connections 2026-02-17T08:23:04.094 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7f3800e23640 1 --2- 10.20.193.16:0/1223148405 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f37fc10a640 0x7f37fc10aa20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.094 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7f3800e23640 1 -- 10.20.193.16:0/1223148405 >> 10.20.193.16:0/1223148405 conn(0x7f37fc1006d0 msgr2=0x7f37fc102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.094 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7f3800e23640 1 -- 10.20.193.16:0/1223148405 shutdown_connections 2026-02-17T08:23:04.095 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7f3800e23640 1 -- 10.20.193.16:0/1223148405 wait complete. 2026-02-17T08:23:04.095 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7f3800e23640 1 Processor -- start 2026-02-17T08:23:04.095 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7f3800e23640 1 -- start start 2026-02-17T08:23:04.095 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7fd4604ae640 1 -- 10.20.193.16:0/266016900 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd4581014f0 msgr2=0x7fd4581018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.095 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.092+0000 7fd4604ae640 1 --2- 10.20.193.16:0/266016900 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd4581014f0 0x7fd4581018d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4480099b0 tx=0x7fd44802f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.095 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd4604ae640 1 -- 10.20.193.16:0/266016900 shutdown_connections 2026-02-17T08:23:04.096 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd4604ae640 1 --2- 10.20.193.16:0/266016900 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd4581014f0 0x7fd4581018d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.096 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd4604ae640 1 -- 10.20.193.16:0/266016900 >> 10.20.193.16:0/266016900 conn(0x7fd4580fcf70 msgr2=0x7fd4580ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.096 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd4604ae640 1 -- 10.20.193.16:0/266016900 shutdown_connections 2026-02-17T08:23:04.096 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd4604ae640 1 -- 10.20.193.16:0/266016900 wait complete. 2026-02-17T08:23:04.097 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f3800e23640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f37fc10a640 0x7f37fc19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.097 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f3800e23640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc10e050 con 0x7f37fc10a640 2026-02-17T08:23:04.097 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f37fa575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f37fc10a640 0x7f37fc19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.097 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f37fa575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f37fc10a640 0x7f37fc19b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58472/0 (socket says 10.20.193.16:58472) 2026-02-17T08:23:04.097 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f37fa575640 1 -- 10.20.193.16:0/3619460322 learned_addr learned my addr 10.20.193.16:0/3619460322 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:04.097 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f37fa575640 1 -- 10.20.193.16:0/3619460322 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc19bbd0 con 0x7f37fc10a640 2026-02-17T08:23:04.097 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd4604ae640 1 Processor -- start 2026-02-17T08:23:04.098 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f37fa575640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f37fc10a640 0x7f37fc19b690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f37f0004290 tx=0x7f37f00042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.098 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd4604ae640 1 -- start start 2026-02-17T08:23:04.099 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f37e37fe640 1 -- 10.20.193.16:0/3619460322 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f0038510 con 0x7f37fc10a640 2026-02-17T08:23:04.099 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f37e37fe640 1 -- 10.20.193.16:0/3619460322 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f37f0046070 con 0x7f37fc10a640 2026-02-17T08:23:04.099 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37fc19be60 con 0x7f37fc10a640 2026-02-17T08:23:04.099 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f37e37fe640 1 -- 10.20.193.16:0/3619460322 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37f0041610 con 0x7f37fc10a640 2026-02-17T08:23:04.099 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37fc19ff60 con 0x7f37fc10a640 2026-02-17T08:23:04.100 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd4604ae640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd4581014f0 0x7fd4580fd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.100 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd4604ae640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd45810aca0 con 0x7fd4581014f0 2026-02-17T08:23:04.100 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd45e223640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd4581014f0 0x7fd4580fd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.100 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd45e223640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd4581014f0 0x7fd4580fd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58480/0 (socket says 10.20.193.16:58480) 2026-02-17T08:23:04.100 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd45e223640 1 -- 10.20.193.16:0/1981296968 learned_addr learned my addr 10.20.193.16:0/1981296968 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:04.100 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7fd45e223640 1 -- 10.20.193.16:0/1981296968 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4580ff310 con 0x7fd4581014f0 2026-02-17T08:23:04.101 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37fc19c320 con 0x7f37fc10a640 2026-02-17T08:23:04.101 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3794874363 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2ecc102600 msgr2=0x7f2ecc1029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.101 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.093+0000 7f2ed3d1d640 1 --2- 10.20.193.16:0/3794874363 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2ecc102600 0x7f2ecc1029e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0099b0 tx=0x7f2ebc02f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.101 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3794874363 shutdown_connections 2026-02-17T08:23:04.101 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed3d1d640 1 --2- 10.20.193.16:0/3794874363 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2ecc102600 0x7f2ecc1029e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.101 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3794874363 >> 10.20.193.16:0/3794874363 conn(0x7f2ecc079240 msgr2=0x7f2ecc100510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.102 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3794874363 shutdown_connections 2026-02-17T08:23:04.102 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7fd45e223640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd4581014f0 0x7fd4580fd420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd448002410 tx=0x7fd448004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.102 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3794874363 wait complete. 2026-02-17T08:23:04.103 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7fd43f7fe640 1 -- 10.20.193.16:0/1981296968 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd448038510 con 0x7fd4581014f0 2026-02-17T08:23:04.103 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7fd43f7fe640 1 -- 10.20.193.16:0/1981296968 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fd448046070 con 0x7fd4581014f0 2026-02-17T08:23:04.103 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4580fd960 con 0x7fd4581014f0 2026-02-17T08:23:04.103 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7fd43f7fe640 1 -- 10.20.193.16:0/1981296968 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd448041630 con 0x7fd4581014f0 2026-02-17T08:23:04.103 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4580fde20 con 0x7fd4581014f0 2026-02-17T08:23:04.103 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37e37fe640 1 -- 10.20.193.16:0/3619460322 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f37f00386b0 con 0x7f37fc10a640 2026-02-17T08:23:04.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37e37fe640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:04.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed3d1d640 1 Processor -- start 2026-02-17T08:23:04.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37e37fe640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:04.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37e37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.104 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37e37fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.105 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37e37fe640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f37d403df10 0x7f37d40403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.105 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed3d1d640 1 -- start start 2026-02-17T08:23:04.105 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd4581029d0 con 0x7fd4581014f0 2026-02-17T08:23:04.106 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37e37fe640 1 -- 10.20.193.16:0/3619460322 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f37f0077a00 con 0x7f37fc10a640 2026-02-17T08:23:04.106 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37f9d74640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f37d403df10 0x7f37d40403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.106 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed3d1d640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2ecc102600 0x7f2ecc19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.106 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed3d1d640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc10bdb0 con 0x7f2ecc102600 2026-02-17T08:23:04.107 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37e37fe640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513] conn(0x7f37d4042d50 0x7f37d4045190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.107 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37e37fe640 1 -- 10.20.193.16:0/3619460322 --> [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37f0030e50 con 0x7f37d4042d50 2026-02-17T08:23:04.107 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37e37fe640 1 -- 10.20.193.16:0/3619460322 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f37f007c2a0 con 0x7f37fc10a640 2026-02-17T08:23:04.107 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed1a92640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2ecc102600 0x7f2ecc19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.107 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed1a92640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2ecc102600 0x7f2ecc19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58482/0 (socket says 10.20.193.16:58482) 2026-02-17T08:23:04.107 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed1a92640 1 -- 10.20.193.16:0/3076545075 learned_addr learned my addr 10.20.193.16:0/3076545075 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:04.108 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37fad76640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513] conn(0x7f37d4042d50 0x7f37d4045190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.108 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37f9d74640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f37d403df10 0x7f37d40403d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37e40099c0 tx=0x7f37e4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.108 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed1a92640 1 -- 10.20.193.16:0/3076545075 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc19bba0 con 0x7f2ecc102600 2026-02-17T08:23:04.109 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7fd43f7fe640 1 -- 10.20.193.16:0/1981296968 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7fd4480386b0 con 0x7fd4581014f0 2026-02-17T08:23:04.109 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7fd43f7fe640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:04.109 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f2ed1a92640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2ecc102600 0x7f2ecc19b660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc004290 tx=0x7f2ebc0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.109 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.094+0000 7f37fad76640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513] conn(0x7f37d4042d50 0x7f37d4045190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.110 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 1 -- 10.20.193.16:0/3076545075 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ebc038510 con 0x7f2ecc102600 2026-02-17T08:23:04.110 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc19be30 con 0x7f2ecc102600 2026-02-17T08:23:04.110 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc19ff30 con 0x7f2ecc102600 2026-02-17T08:23:04.110 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd43f7fe640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:04.110 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd43f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.110 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd43f7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.110 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd43f7fe640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd43403dec0 0x7fd434040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.111 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 1 -- 10.20.193.16:0/3076545075 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f2ebc046070 con 0x7f2ecc102600 2026-02-17T08:23:04.111 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 1 -- 10.20.193.16:0/3076545075 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ebc04b460 con 0x7f2ecc102600 2026-02-17T08:23:04.111 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd43f7fe640 1 -- 10.20.193.16:0/1981296968 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7fd4480782e0 con 0x7fd4581014f0 2026-02-17T08:23:04.112 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd45da22640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd43403dec0 0x7fd434040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.112 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd43f7fe640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540] conn(0x7fd434042d00 0x7fd434045140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.112 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd43f7fe640 1 -- 10.20.193.16:0/1981296968 --> [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd44803be90 con 0x7fd434042d00 2026-02-17T08:23:04.112 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd43f7fe640 1 -- 10.20.193.16:0/1981296968 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd4480787a0 con 0x7fd4581014f0 2026-02-17T08:23:04.112 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd45ea24640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540] conn(0x7fd434042d00 0x7fd434045140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.112 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd45da22640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd43403dec0 0x7fd434040380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0099c0 tx=0x7fd44c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.112 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f37e37fe640 1 -- 10.20.193.16:0/3619460322 <== osd.0 v2:10.20.193.16:6802/2367982513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f37f0030e50 con 0x7f37d4042d50 2026-02-17T08:23:04.113 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ecc19c2f0 con 0x7f2ecc102600 2026-02-17T08:23:04.113 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7fd45ea24640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540] conn(0x7fd434042d00 0x7fd434045140 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 1 -- 10.20.193.16:0/3076545075 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f2ebc0386b0 con 0x7f2ecc102600 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2ea803df10 0x7f2ea80403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 1 -- 10.20.193.16:0/3076545075 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f2ebc077a80 con 0x7f2ecc102600 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815] conn(0x7f2ea8042d50 0x7f2ea8045190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 1 -- 10.20.193.16:0/3076545075 --> [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ebc005740 con 0x7f2ea8042d50 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ed1291640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2ea803df10 0x7f2ea80403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.095+0000 7f2ebaffd640 1 -- 10.20.193.16:0/3076545075 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2ebc07c2a0 con 0x7f2ecc102600 2026-02-17T08:23:04.114 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.096+0000 7f2ed2293640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815] conn(0x7f2ea8042d50 0x7f2ea8045190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.115 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.096+0000 7fd43f7fe640 1 -- 10.20.193.16:0/1981296968 <== osd.1 v2:10.20.193.16:6810/914146540 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fd44803be90 con 0x7fd434042d00 2026-02-17T08:23:04.115 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.096+0000 7f2ed1291640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2ea803df10 0x7f2ea80403d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00099c0 tx=0x7f2ec0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.115 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.096+0000 7f2ed2293640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815] conn(0x7f2ea8042d50 0x7f2ea8045190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.115 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.096+0000 7f2ebaffd640 1 -- 10.20.193.16:0/3076545075 <== osd.2 v2:10.20.193.16:6818/2377130815 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f2ebc005740 con 0x7f2ea8042d50 2026-02-17T08:23:04.116 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.101+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 --> [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37fc1a0710 con 0x7f37d4042d50 2026-02-17T08:23:04.116 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f37e37fe640 1 -- 10.20.193.16:0/3619460322 <== osd.0 v2:10.20.193.16:6802/2367982513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f37fc1a0710 con 0x7f37d4042d50 2026-02-17T08:23:04.116 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513] conn(0x7f37d4042d50 msgr2=0x7f37d4045190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513] conn(0x7f37d4042d50 0x7f37d4045190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 10 mgrc shutdown 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f37d403df10 msgr2=0x7f37d40403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f37d403df10 0x7f37d40403d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37e40099c0 tx=0x7f37e4006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f37fc10a640 msgr2=0x7f37fc19b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f37fc10a640 0x7f37fc19b690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f37f0004290 tx=0x7f37f00042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 shutdown_connections 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6802/2367982513,v1:10.20.193.16:6803/2367982513] conn(0x7f37d4042d50 0x7f37d4045190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f37d403df10 0x7f37d40403d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 --2- 10.20.193.16:0/3619460322 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f37fc10a640 0x7f37fc19b690 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 >> 10.20.193.16:0/3619460322 conn(0x7f37fc1006d0 msgr2=0x7f37fc106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 shutdown_connections 2026-02-17T08:23:04.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7f3800e23640 1 -- 10.20.193.16:0/3619460322 wait complete. 2026-02-17T08:23:04.118 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 --> [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd458108f60 con 0x7fd434042d00 2026-02-17T08:23:04.118 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd43f7fe640 1 -- 10.20.193.16:0/1981296968 <== osd.1 v2:10.20.193.16:6810/914146540 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd458108f60 con 0x7fd434042d00 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540] conn(0x7fd434042d00 msgr2=0x7fd434045140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540] conn(0x7fd434042d00 0x7fd434045140 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 10 mgrc shutdown 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd43403dec0 msgr2=0x7fd434040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd43403dec0 0x7fd434040380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0099c0 tx=0x7fd44c006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd4581014f0 msgr2=0x7fd4580fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd4581014f0 0x7fd4580fd420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd448002410 tx=0x7fd448004290 comp rx=0 tx=0).stop 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 shutdown_connections 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6810/914146540,v1:10.20.193.16:6811/914146540] conn(0x7fd434042d00 0x7fd434045140 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fd43403dec0 0x7fd434040380 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.102+0000 7fd4604ae640 1 --2- 10.20.193.16:0/1981296968 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fd4581014f0 0x7fd4580fd420 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 >> 10.20.193.16:0/1981296968 conn(0x7fd4580fcf70 msgr2=0x7fd45806b780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.119 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 shutdown_connections 2026-02-17T08:23:04.120 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7fd4604ae640 1 -- 10.20.193.16:0/1981296968 wait complete. 2026-02-17T08:23:04.120 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 --> [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ecc0767e0 con 0x7f2ea8042d50 2026-02-17T08:23:04.120 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ebaffd640 1 -- 10.20.193.16:0/3076545075 <== osd.2 v2:10.20.193.16:6818/2377130815 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2ecc0767e0 con 0x7f2ea8042d50 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815] conn(0x7f2ea8042d50 msgr2=0x7f2ea8045190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815] conn(0x7f2ea8042d50 0x7f2ea8045190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 10 mgrc shutdown 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2ea803df10 msgr2=0x7f2ea80403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2ea803df10 0x7f2ea80403d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00099c0 tx=0x7f2ec0006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2ecc102600 msgr2=0x7f2ecc19b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2ecc102600 0x7f2ecc19b660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc004290 tx=0x7f2ebc0042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 shutdown_connections 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6818/2377130815,v1:10.20.193.16:6819/2377130815] conn(0x7f2ea8042d50 0x7f2ea8045190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f2ea803df10 0x7f2ea80403d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 --2- 10.20.193.16:0/3076545075 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f2ecc102600 0x7f2ecc19b660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 >> 10.20.193.16:0/3076545075 conn(0x7f2ecc079240 msgr2=0x7f2ecc10a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 shutdown_connections 2026-02-17T08:23:04.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.103+0000 7f2ed3d1d640 1 -- 10.20.193.16:0/3076545075 wait complete. 2026-02-17T08:23:04.142 INFO:teuthology.orchestra.run.trial016.stdout:38654705671 2026-02-17T08:23:04.142 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T08:23:04.145 INFO:teuthology.orchestra.run.trial016.stdout:77309411332 2026-02-17T08:23:04.146 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T08:23:04.152 INFO:teuthology.orchestra.run.trial016.stdout:60129542150 2026-02-17T08:23:04.153 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T08:23:04.293 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:04.385 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:04.386 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:04.410 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.407+0000 7f52ba1e7640 1 -- 10.20.193.16:0/305983329 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f52b410a640 msgr2=0x7f52b410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.410 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.407+0000 7f52ba1e7640 1 --2- 10.20.193.16:0/305983329 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f52b410a640 0x7f52b410aa20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f52a00099b0 tx=0x7f52a002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.407+0000 7f52ba1e7640 1 -- 10.20.193.16:0/305983329 shutdown_connections 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.407+0000 7f52ba1e7640 1 --2- 10.20.193.16:0/305983329 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f52b410a640 0x7f52b410aa20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.407+0000 7f52ba1e7640 1 -- 10.20.193.16:0/305983329 >> 10.20.193.16:0/305983329 conn(0x7f52b41006d0 msgr2=0x7f52b4102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.407+0000 7f52ba1e7640 1 -- 10.20.193.16:0/305983329 shutdown_connections 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.407+0000 7f52ba1e7640 1 -- 10.20.193.16:0/305983329 wait complete. 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52ba1e7640 1 Processor -- start 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52ba1e7640 1 -- start start 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52ba1e7640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f52b410a640 0x7f52b419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52ba1e7640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f52b410e050 con 0x7f52b410a640 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52b37fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f52b410a640 0x7f52b419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.411 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52b37fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f52b410a640 0x7f52b419b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58500/0 (socket says 10.20.193.16:58500) 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52b37fe640 1 -- 10.20.193.16:0/757506926 learned_addr learned my addr 10.20.193.16:0/757506926 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52b37fe640 1 -- 10.20.193.16:0/757506926 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b419bbd0 con 0x7f52b410a640 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52b37fe640 1 --2- 10.20.193.16:0/757506926 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f52b410a640 0x7f52b419b690 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f52a0004290 tx=0x7f52a00042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52b0ff9640 1 -- 10.20.193.16:0/757506926 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a0038510 con 0x7f52b410a640 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52b0ff9640 1 -- 10.20.193.16:0/757506926 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f52a0046070 con 0x7f52b410a640 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52ba1e7640 1 -- 10.20.193.16:0/757506926 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b419be60 con 0x7f52b410a640 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52b0ff9640 1 -- 10.20.193.16:0/757506926 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52a0041610 con 0x7f52b410a640 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.408+0000 7f52ba1e7640 1 -- 10.20.193.16:0/757506926 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b419ff60 con 0x7f52b410a640 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.409+0000 7f52b0ff9640 1 -- 10.20.193.16:0/757506926 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f52a00386b0 con 0x7f52b410a640 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.409+0000 7f52b0ff9640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.409+0000 7f52ba1e7640 1 -- 10.20.193.16:0/757506926 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b4105d80 con 0x7f52b410a640 2026-02-17T08:23:04.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.409+0000 7f52b0ff9640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:04.413 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.409+0000 7f52b0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.413 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.409+0000 7f52b0ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.413 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.409+0000 7f52b0ff9640 1 --2- 10.20.193.16:0/757506926 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f528803dec0 0x7f5288040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.413 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.409+0000 7f52b0ff9640 1 -- 10.20.193.16:0/757506926 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f52a0077ba0 con 0x7f52b410a640 2026-02-17T08:23:04.413 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.409+0000 7f52b2ffd640 1 --2- 10.20.193.16:0/757506926 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f528803dec0 0x7f5288040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.413 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.410+0000 7f52b2ffd640 1 --2- 10.20.193.16:0/757506926 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f528803dec0 0x7f5288040380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52a40099c0 tx=0x7f52a4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.412+0000 7f52b0ff9640 1 -- 10.20.193.16:0/757506926 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f52a0040360 con 0x7f52b410a640 2026-02-17T08:23:04.489 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.487+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/3511792789 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f0e54100a10 msgr2=0x7f0e54100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.490 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.487+0000 7f0e5b7dd640 1 --2- 10.20.193.16:0/3511792789 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f0e54100a10 0x7f0e54100df0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0e440099b0 tx=0x7f0e4402f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.490 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.487+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/3511792789 shutdown_connections 2026-02-17T08:23:04.490 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.487+0000 7f0e5b7dd640 1 --2- 10.20.193.16:0/3511792789 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f0e54100a10 0x7f0e54100df0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.490 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.487+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/3511792789 >> 10.20.193.16:0/3511792789 conn(0x7f0e540fc6a0 msgr2=0x7f0e540feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.490 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.487+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/3511792789 shutdown_connections 2026-02-17T08:23:04.490 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.487+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/3511792789 wait complete. 2026-02-17T08:23:04.490 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.487+0000 7f0e5b7dd640 1 Processor -- start 2026-02-17T08:23:04.490 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e5b7dd640 1 -- start start 2026-02-17T08:23:04.490 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e5b7dd640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f0e54100a10 0x7f0e5419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e5b7dd640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5410bdd0 con 0x7f0e54100a10 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e59552640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f0e54100a10 0x7f0e5419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e59552640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f0e54100a10 0x7f0e5419b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58514/0 (socket says 10.20.193.16:58514) 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e59552640 1 -- 10.20.193.16:0/1556612517 learned_addr learned my addr 10.20.193.16:0/1556612517 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e59552640 1 -- 10.20.193.16:0/1556612517 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5419bbb0 con 0x7f0e54100a10 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e59552640 1 --2- 10.20.193.16:0/1556612517 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f0e54100a10 0x7f0e5419b670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0e44004290 tx=0x7f0e440042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e427fc640 1 -- 10.20.193.16:0/1556612517 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e44038510 con 0x7f0e54100a10 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e427fc640 1 -- 10.20.193.16:0/1556612517 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0e44046070 con 0x7f0e54100a10 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/1556612517 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5419be40 con 0x7f0e54100a10 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e427fc640 1 -- 10.20.193.16:0/1556612517 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e44041610 con 0x7f0e54100a10 2026-02-17T08:23:04.491 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.488+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/1556612517 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5419ff40 con 0x7f0e54100a10 2026-02-17T08:23:04.492 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 -- 10.20.193.16:0/286044873 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f827410a640 msgr2=0x7f827410aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.492 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 --2- 10.20.193.16:0/286044873 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f827410a640 0x7f827410aa20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82600099b0 tx=0x7f826002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.492 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 -- 10.20.193.16:0/286044873 shutdown_connections 2026-02-17T08:23:04.492 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 --2- 10.20.193.16:0/286044873 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f827410a640 0x7f827410aa20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.493 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 -- 10.20.193.16:0/286044873 >> 10.20.193.16:0/286044873 conn(0x7f82741006d0 msgr2=0x7f8274102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.493 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 -- 10.20.193.16:0/286044873 shutdown_connections 2026-02-17T08:23:04.493 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 -- 10.20.193.16:0/286044873 wait complete. 2026-02-17T08:23:04.493 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/1556612517 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e54103b90 con 0x7f0e54100a10 2026-02-17T08:23:04.493 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f0e427fc640 1 -- 10.20.193.16:0/1556612517 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f0e440386b0 con 0x7f0e54100a10 2026-02-17T08:23:04.493 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f0e427fc640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:04.493 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 Processor -- start 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f0e427fc640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f0e427fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f0e427fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f0e427fc640 1 --2- 10.20.193.16:0/1556612517 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f0e3003df10 0x7f0e300403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 -- start start 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f0e427fc640 1 -- 10.20.193.16:0/1556612517 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f0e44077aa0 con 0x7f0e54100a10 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f0e58d51640 1 --2- 10.20.193.16:0/1556612517 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f0e3003df10 0x7f0e300403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f827410a640 0x7f827419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f8279c7b640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f827410e050 con 0x7f827410a640 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f82737fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f827410a640 0x7f827419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f82737fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f827410a640 0x7f827419b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58516/0 (socket says 10.20.193.16:58516) 2026-02-17T08:23:04.495 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f82737fe640 1 -- 10.20.193.16:0/1963211776 learned_addr learned my addr 10.20.193.16:0/1963211776 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:04.495 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.489+0000 7f0e58d51640 1 --2- 10.20.193.16:0/1556612517 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f0e3003df10 0x7f0e300403d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0e480099c0 tx=0x7f0e48006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.495 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.490+0000 7f82737fe640 1 -- 10.20.193.16:0/1963211776 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827419bbd0 con 0x7f827410a640 2026-02-17T08:23:04.495 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.490+0000 7f82737fe640 1 --2- 10.20.193.16:0/1963211776 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f827410a640 0x7f827419b690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8260002410 tx=0x7f8260004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.495 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8270ff9640 1 -- 10.20.193.16:0/1963211776 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8260038510 con 0x7f827410a640 2026-02-17T08:23:04.495 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8270ff9640 1 -- 10.20.193.16:0/1963211776 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8260046070 con 0x7f827410a640 2026-02-17T08:23:04.495 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8270ff9640 1 -- 10.20.193.16:0/1963211776 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8260041630 con 0x7f827410a640 2026-02-17T08:23:04.495 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8279c7b640 1 -- 10.20.193.16:0/1963211776 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827419be60 con 0x7f827410a640 2026-02-17T08:23:04.495 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8279c7b640 1 -- 10.20.193.16:0/1963211776 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827419ff60 con 0x7f827410a640 2026-02-17T08:23:04.495 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f0e427fc640 1 -- 10.20.193.16:0/1556612517 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0e44040360 con 0x7f0e54100a10 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8279c7b640 1 -- 10.20.193.16:0/1963211776 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8274105d80 con 0x7f827410a640 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8270ff9640 1 -- 10.20.193.16:0/1963211776 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f82600386b0 con 0x7f827410a640 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8270ff9640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8270ff9640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8270ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8270ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8270ff9640 1 --2- 10.20.193.16:0/1963211776 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f824803df10 0x7f82480403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8270ff9640 1 -- 10.20.193.16:0/1963211776 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f8260077b80 con 0x7f827410a640 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.492+0000 7f8272ffd640 1 --2- 10.20.193.16:0/1963211776 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f824803df10 0x7f82480403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.493+0000 7f8272ffd640 1 --2- 10.20.193.16:0/1963211776 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f824803df10 0x7f82480403d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f82640099c0 tx=0x7f8264006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:04.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.495+0000 7f8270ff9640 1 -- 10.20.193.16:0/1963211776 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8260007c50 con 0x7f827410a640 2026-02-17T08:23:04.501 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.501+0000 7f52ba1e7640 1 -- 10.20.193.16:0/757506926 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f52b410aaa0 con 0x7f52b410a640 2026-02-17T08:23:04.502 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.501+0000 7f52b0ff9640 1 -- 10.20.193.16:0/757506926 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52a0049360 con 0x7f52b410a640 2026-02-17T08:23:04.502 INFO:teuthology.orchestra.run.trial016.stdout:38654705670 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 10 mgrc shutdown 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 1 -- 10.20.193.16:0/757506926 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f528803dec0 msgr2=0x7f5288040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 1 --2- 10.20.193.16:0/757506926 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f528803dec0 0x7f5288040380 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52a40099c0 tx=0x7f52a4006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 1 -- 10.20.193.16:0/757506926 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f52b410a640 msgr2=0x7f52b419b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 1 --2- 10.20.193.16:0/757506926 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f52b410a640 0x7f52b419b690 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f52a0004290 tx=0x7f52a00042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 1 -- 10.20.193.16:0/757506926 shutdown_connections 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 1 --2- 10.20.193.16:0/757506926 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f528803dec0 0x7f5288040380 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 1 --2- 10.20.193.16:0/757506926 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f52b410a640 0x7f52b419b690 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 1 -- 10.20.193.16:0/757506926 >> 10.20.193.16:0/757506926 conn(0x7f52b41006d0 msgr2=0x7f52b4106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 1 -- 10.20.193.16:0/757506926 shutdown_connections 2026-02-17T08:23:04.504 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.503+0000 7f52ba1e7640 1 -- 10.20.193.16:0/757506926 wait complete. 2026-02-17T08:23:04.538 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.0 2026-02-17T08:23:04.579 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.579+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/1556612517 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0e54100e70 con 0x7f0e54100a10 2026-02-17T08:23:04.579 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:04 trial016 ceph-mon[39048]: pgmap v37: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T08:23:04.580 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:04 trial016 ceph-mon[39048]: osdmap e21: 3 total, 3 up, 3 in 2026-02-17T08:23:04.580 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:04 trial016 ceph-mon[39048]: mgrmap e14: a(active, since 54s) 2026-02-17T08:23:04.580 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:04 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/2340986029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T08:23:04.580 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.579+0000 7f0e427fc640 1 -- 10.20.193.16:0/1556612517 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e44049360 con 0x7f0e54100a10 2026-02-17T08:23:04.580 INFO:teuthology.orchestra.run.trial016.stdout:77309411331 2026-02-17T08:23:04.581 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.580+0000 7f8279c7b640 1 -- 10.20.193.16:0/1963211776 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f827410aaa0 con 0x7f827410a640 2026-02-17T08:23:04.581 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.580+0000 7f8270ff9640 1 -- 10.20.193.16:0/1963211776 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82600389d0 con 0x7f827410a640 2026-02-17T08:23:04.581 INFO:teuthology.orchestra.run.trial016.stdout:60129542149 2026-02-17T08:23:04.582 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 10 mgrc shutdown 2026-02-17T08:23:04.582 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/1556612517 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f0e3003df10 msgr2=0x7f0e300403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.582 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 1 --2- 10.20.193.16:0/1556612517 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f0e3003df10 0x7f0e300403d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0e480099c0 tx=0x7f0e48006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/1556612517 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f0e54100a10 msgr2=0x7f0e5419b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 1 --2- 10.20.193.16:0/1556612517 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f0e54100a10 0x7f0e5419b670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0e44004290 tx=0x7f0e440042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/1556612517 shutdown_connections 2026-02-17T08:23:04.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 1 --2- 10.20.193.16:0/1556612517 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f0e3003df10 0x7f0e300403d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 1 --2- 10.20.193.16:0/1556612517 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f0e54100a10 0x7f0e5419b670 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/1556612517 >> 10.20.193.16:0/1556612517 conn(0x7f0e540fc6a0 msgr2=0x7f0e5410a100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/1556612517 shutdown_connections 2026-02-17T08:23:04.583 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.581+0000 7f0e5b7dd640 1 -- 10.20.193.16:0/1556612517 wait complete. 2026-02-17T08:23:04.584 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 10 mgrc shutdown 2026-02-17T08:23:04.584 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 1 -- 10.20.193.16:0/1963211776 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f824803df10 msgr2=0x7f82480403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.584 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 1 --2- 10.20.193.16:0/1963211776 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f824803df10 0x7f82480403d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f82640099c0 tx=0x7f8264006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.584 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 1 -- 10.20.193.16:0/1963211776 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f827410a640 msgr2=0x7f827419b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:04.584 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 1 --2- 10.20.193.16:0/1963211776 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f827410a640 0x7f827419b690 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8260002410 tx=0x7f8260004290 comp rx=0 tx=0).stop 2026-02-17T08:23:04.585 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 1 -- 10.20.193.16:0/1963211776 shutdown_connections 2026-02-17T08:23:04.585 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 1 --2- 10.20.193.16:0/1963211776 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f824803df10 0x7f82480403d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.585 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 1 --2- 10.20.193.16:0/1963211776 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f827410a640 0x7f827419b690 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:04.585 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 1 -- 10.20.193.16:0/1963211776 >> 10.20.193.16:0/1963211776 conn(0x7f82741006d0 msgr2=0x7f8274106620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:04.585 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 1 -- 10.20.193.16:0/1963211776 shutdown_connections 2026-02-17T08:23:04.585 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:04.582+0000 7f8279c7b640 1 -- 10.20.193.16:0/1963211776 wait complete. 2026-02-17T08:23:04.618 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2026-02-17T08:23:04.628 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411331 for osd.2 2026-02-17T08:23:05.539 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T08:23:05.563 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:05 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/757506926' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T08:23:05.564 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:05 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1556612517' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T08:23:05.564 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:05 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1963211776' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T08:23:05.619 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T08:23:05.629 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T08:23:05.692 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:05.779 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:05.805 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 -- 10.20.193.16:0/4051572489 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc73010a4d0 msgr2=0x7fc73010a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:05.805 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 --2- 10.20.193.16:0/4051572489 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc73010a4d0 0x7fc73010a8b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc7200099b0 tx=0x7fc72002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.805 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 -- 10.20.193.16:0/4051572489 shutdown_connections 2026-02-17T08:23:05.805 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 --2- 10.20.193.16:0/4051572489 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc73010a4d0 0x7fc73010a8b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.805 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 -- 10.20.193.16:0/4051572489 >> 10.20.193.16:0/4051572489 conn(0x7fc730100140 msgr2=0x7fc730102560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:05.805 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 -- 10.20.193.16:0/4051572489 shutdown_connections 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 -- 10.20.193.16:0/4051572489 wait complete. 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 Processor -- start 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 -- start start 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc73010a4d0 0x7fc73019b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.802+0000 7fc736254640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc73010de50 con 0x7fc73010a4d0 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc735252640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc73010a4d0 0x7fc73019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc735252640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc73010a4d0 0x7fc73019b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58530/0 (socket says 10.20.193.16:58530) 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc735252640 1 -- 10.20.193.16:0/3608978890 learned_addr learned my addr 10.20.193.16:0/3608978890 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc735252640 1 -- 10.20.193.16:0/3608978890 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73019b9a0 con 0x7fc73010a4d0 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc735252640 1 --2- 10.20.193.16:0/3608978890 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc73010a4d0 0x7fc73019b460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc720004290 tx=0x7fc7200042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:05.806 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc71e7fc640 1 -- 10.20.193.16:0/3608978890 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc720038510 con 0x7fc73010a4d0 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc736254640 1 -- 10.20.193.16:0/3608978890 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73019bc30 con 0x7fc73010a4d0 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc71e7fc640 1 -- 10.20.193.16:0/3608978890 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc720046070 con 0x7fc73010a4d0 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc71e7fc640 1 -- 10.20.193.16:0/3608978890 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc720041610 con 0x7fc73010a4d0 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc736254640 1 -- 10.20.193.16:0/3608978890 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc73019fd30 con 0x7fc73010a4d0 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.803+0000 7fc736254640 1 -- 10.20.193.16:0/3608978890 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc730105b80 con 0x7fc73010a4d0 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.804+0000 7fc71e7fc640 1 -- 10.20.193.16:0/3608978890 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7fc7200386b0 con 0x7fc73010a4d0 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.804+0000 7fc71e7fc640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.804+0000 7fc71e7fc640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.804+0000 7fc71e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.804+0000 7fc71e7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.804+0000 7fc71e7fc640 1 --2- 10.20.193.16:0/3608978890 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc70c03dec0 0x7fc70c040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:05.807 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.804+0000 7fc71e7fc640 1 -- 10.20.193.16:0/3608978890 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7fc720077ae0 con 0x7fc73010a4d0 2026-02-17T08:23:05.808 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.804+0000 7fc734a51640 1 --2- 10.20.193.16:0/3608978890 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc70c03dec0 0x7fc70c040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:05.808 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.804+0000 7fc734a51640 1 --2- 10.20.193.16:0/3608978890 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc70c03dec0 0x7fc70c040380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc7240099c0 tx=0x7fc724006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:05.808 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.806+0000 7fc71e7fc640 1 -- 10.20.193.16:0/3608978890 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc720040360 con 0x7fc73010a4d0 2026-02-17T08:23:05.850 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:05.895 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 -- 10.20.193.16:0/3208296193 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94bc10a650 msgr2=0x7f94bc10aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:05.895 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 --2- 10.20.193.16:0/3208296193 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94bc10a650 0x7f94bc10aa30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f94a80099b0 tx=0x7f94a802f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.895 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 -- 10.20.193.16:0/3208296193 shutdown_connections 2026-02-17T08:23:05.895 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 --2- 10.20.193.16:0/3208296193 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94bc10a650 0x7f94bc10aa30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.895 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 -- 10.20.193.16:0/3208296193 >> 10.20.193.16:0/3208296193 conn(0x7f94bc100330 msgr2=0x7f94bc102750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:05.895 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 -- 10.20.193.16:0/3208296193 shutdown_connections 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 -- 10.20.193.16:0/3208296193 wait complete. 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 Processor -- start 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 -- start start 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94bc10a650 0x7f94bc19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94c24e5640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc10e060 con 0x7f94bc10a650 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94bbfff640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94bc10a650 0x7f94bc19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94bbfff640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94bc10a650 0x7f94bc19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58550/0 (socket says 10.20.193.16:58550) 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94bbfff640 1 -- 10.20.193.16:0/113409224 learned_addr learned my addr 10.20.193.16:0/113409224 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94bbfff640 1 -- 10.20.193.16:0/113409224 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc19bbc0 con 0x7f94bc10a650 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.892+0000 7f94bbfff640 1 --2- 10.20.193.16:0/113409224 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94bc10a650 0x7f94bc19b680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f94a8004290 tx=0x7f94a80042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94b97fa640 1 -- 10.20.193.16:0/113409224 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94a8038510 con 0x7f94bc10a650 2026-02-17T08:23:05.896 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94b97fa640 1 -- 10.20.193.16:0/113409224 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f94a8046070 con 0x7f94bc10a650 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94c24e5640 1 -- 10.20.193.16:0/113409224 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94bc19be50 con 0x7f94bc10a650 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94b97fa640 1 -- 10.20.193.16:0/113409224 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94a8041610 con 0x7f94bc10a650 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94c24e5640 1 -- 10.20.193.16:0/113409224 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94bc19ff50 con 0x7f94bc10a650 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94c24e5640 1 -- 10.20.193.16:0/113409224 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94bc105d90 con 0x7f94bc10a650 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94b97fa640 1 -- 10.20.193.16:0/113409224 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f94a80418e0 con 0x7f94bc10a650 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94b97fa640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94b97fa640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94b97fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94b97fa640 1 --2- 10.20.193.16:0/113409224 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f949003df10 0x7f94900403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:05.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.893+0000 7f94b97fa640 1 -- 10.20.193.16:0/113409224 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f94a8077bb0 con 0x7f94bc10a650 2026-02-17T08:23:05.898 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.894+0000 7f94bb7fe640 1 --2- 10.20.193.16:0/113409224 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f949003df10 0x7f94900403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:05.898 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.894+0000 7f94bb7fe640 1 --2- 10.20.193.16:0/113409224 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f949003df10 0x7f94900403d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0099c0 tx=0x7f94ac006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:05.898 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.896+0000 7f94b97fa640 1 -- 10.20.193.16:0/113409224 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f94a8041c00 con 0x7f94bc10a650 2026-02-17T08:23:05.899 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.897+0000 7fc736254640 1 -- 10.20.193.16:0/3608978890 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc73010a930 con 0x7fc73010a4d0 2026-02-17T08:23:05.899 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.897+0000 7fc71e7fc640 1 -- 10.20.193.16:0/3608978890 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc720049360 con 0x7fc73010a4d0 2026-02-17T08:23:05.899 INFO:teuthology.orchestra.run.trial016.stdout:38654705672 2026-02-17T08:23:05.900 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 10 mgrc shutdown 2026-02-17T08:23:05.900 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 1 -- 10.20.193.16:0/3608978890 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc70c03dec0 msgr2=0x7fc70c040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:05.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 1 --2- 10.20.193.16:0/3608978890 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc70c03dec0 0x7fc70c040380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc7240099c0 tx=0x7fc724006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 1 -- 10.20.193.16:0/3608978890 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc73010a4d0 msgr2=0x7fc73019b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:05.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 1 --2- 10.20.193.16:0/3608978890 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc73010a4d0 0x7fc73019b460 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc720004290 tx=0x7fc7200042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 1 -- 10.20.193.16:0/3608978890 shutdown_connections 2026-02-17T08:23:05.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 1 --2- 10.20.193.16:0/3608978890 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc70c03dec0 0x7fc70c040380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 1 --2- 10.20.193.16:0/3608978890 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc73010a4d0 0x7fc73019b460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 1 -- 10.20.193.16:0/3608978890 >> 10.20.193.16:0/3608978890 conn(0x7fc730100140 msgr2=0x7fc730108720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:05.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 1 -- 10.20.193.16:0/3608978890 shutdown_connections 2026-02-17T08:23:05.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.899+0000 7fc736254640 1 -- 10.20.193.16:0/3608978890 wait complete. 2026-02-17T08:23:05.937 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705671 got 38654705672 for osd.0 2026-02-17T08:23:05.937 DEBUG:teuthology.parallel:result is None 2026-02-17T08:23:05.957 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.954+0000 7fc33acc7640 1 -- 10.20.193.16:0/3071295134 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc33410d6f0 msgr2=0x7fc33410dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.954+0000 7fc33acc7640 1 --2- 10.20.193.16:0/3071295134 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc33410d6f0 0x7fc33410dad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc3240099b0 tx=0x7fc32402f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.954+0000 7fc33acc7640 1 -- 10.20.193.16:0/3071295134 shutdown_connections 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.954+0000 7fc33acc7640 1 --2- 10.20.193.16:0/3071295134 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc33410d6f0 0x7fc33410dad0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.954+0000 7fc33acc7640 1 -- 10.20.193.16:0/3071295134 >> 10.20.193.16:0/3071295134 conn(0x7fc33406cd20 msgr2=0x7fc33406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.954+0000 7fc33acc7640 1 -- 10.20.193.16:0/3071295134 shutdown_connections 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.954+0000 7fc33acc7640 1 -- 10.20.193.16:0/3071295134 wait complete. 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.954+0000 7fc33acc7640 1 Processor -- start 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc33acc7640 1 -- start start 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc33acc7640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc33410d6f0 0x7fc3341a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc33acc7640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc334116a50 con 0x7fc33410d6f0 2026-02-17T08:23:05.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc338a3c640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc33410d6f0 0x7fc3341a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc338a3c640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc33410d6f0 0x7fc3341a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58568/0 (socket says 10.20.193.16:58568) 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc338a3c640 1 -- 10.20.193.16:0/1511040875 learned_addr learned my addr 10.20.193.16:0/1511040875 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc338a3c640 1 -- 10.20.193.16:0/1511040875 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3341a45a0 con 0x7fc33410d6f0 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc338a3c640 1 --2- 10.20.193.16:0/1511040875 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc33410d6f0 0x7fc3341a4060 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc324004290 tx=0x7fc3240042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc329ffb640 1 -- 10.20.193.16:0/1511040875 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc324038510 con 0x7fc33410d6f0 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc33acc7640 1 -- 10.20.193.16:0/1511040875 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3341a4830 con 0x7fc33410d6f0 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc329ffb640 1 -- 10.20.193.16:0/1511040875 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fc324046070 con 0x7fc33410d6f0 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc329ffb640 1 -- 10.20.193.16:0/1511040875 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc324041610 con 0x7fc33410d6f0 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.955+0000 7fc33acc7640 1 -- 10.20.193.16:0/1511040875 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3341a8930 con 0x7fc33410d6f0 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.956+0000 7fc33acc7640 1 -- 10.20.193.16:0/1511040875 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33410e770 con 0x7fc33410d6f0 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.956+0000 7fc329ffb640 1 -- 10.20.193.16:0/1511040875 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7fc3240386b0 con 0x7fc33410d6f0 2026-02-17T08:23:05.959 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.956+0000 7fc329ffb640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:05.960 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.956+0000 7fc329ffb640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:05.960 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.956+0000 7fc329ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:05.960 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.956+0000 7fc329ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:05.960 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.956+0000 7fc329ffb640 1 --2- 10.20.193.16:0/1511040875 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc31003dec0 0x7fc310040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:05.960 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.956+0000 7fc329ffb640 1 -- 10.20.193.16:0/1511040875 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7fc324077ae0 con 0x7fc33410d6f0 2026-02-17T08:23:05.960 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.956+0000 7fc32bfff640 1 --2- 10.20.193.16:0/1511040875 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc31003dec0 0x7fc310040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:05.960 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.956+0000 7fc32bfff640 1 --2- 10.20.193.16:0/1511040875 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc31003dec0 0x7fc310040380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0099c0 tx=0x7fc31c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:05.961 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.959+0000 7fc329ffb640 1 -- 10.20.193.16:0/1511040875 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc324040360 con 0x7fc33410d6f0 2026-02-17T08:23:05.985 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.985+0000 7f94c24e5640 1 -- 10.20.193.16:0/113409224 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f94bc10aab0 con 0x7f94bc10a650 2026-02-17T08:23:05.986 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.985+0000 7f94b97fa640 1 -- 10.20.193.16:0/113409224 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f94a8046d80 con 0x7f94bc10a650 2026-02-17T08:23:05.986 INFO:teuthology.orchestra.run.trial016.stdout:60129542150 2026-02-17T08:23:05.988 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 10 mgrc shutdown 2026-02-17T08:23:05.988 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 1 -- 10.20.193.16:0/113409224 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f949003df10 msgr2=0x7f94900403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:05.988 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 1 --2- 10.20.193.16:0/113409224 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f949003df10 0x7f94900403d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0099c0 tx=0x7f94ac006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.988 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 1 -- 10.20.193.16:0/113409224 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94bc10a650 msgr2=0x7f94bc19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:05.988 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 1 --2- 10.20.193.16:0/113409224 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94bc10a650 0x7f94bc19b680 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f94a8004290 tx=0x7f94a80042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.988 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 1 -- 10.20.193.16:0/113409224 shutdown_connections 2026-02-17T08:23:05.988 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 1 --2- 10.20.193.16:0/113409224 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f949003df10 0x7f94900403d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.989 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 1 --2- 10.20.193.16:0/113409224 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f94bc10a650 0x7f94bc19b680 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:05.989 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 1 -- 10.20.193.16:0/113409224 >> 10.20.193.16:0/113409224 conn(0x7f94bc100330 msgr2=0x7f94bc1087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:05.989 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 1 -- 10.20.193.16:0/113409224 shutdown_connections 2026-02-17T08:23:05.989 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:05.987+0000 7f94c24e5640 1 -- 10.20.193.16:0/113409224 wait complete. 2026-02-17T08:23:06.025 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2026-02-17T08:23:06.026 DEBUG:teuthology.parallel:result is None 2026-02-17T08:23:06.046 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.045+0000 7fc33acc7640 1 -- 10.20.193.16:0/1511040875 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc33410db50 con 0x7fc33410d6f0 2026-02-17T08:23:06.047 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.046+0000 7fc329ffb640 1 -- 10.20.193.16:0/1511040875 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc324049360 con 0x7fc33410d6f0 2026-02-17T08:23:06.047 INFO:teuthology.orchestra.run.trial016.stdout:77309411332 2026-02-17T08:23:06.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.047+0000 7fc33acc7640 10 mgrc shutdown 2026-02-17T08:23:06.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.047+0000 7fc33acc7640 1 -- 10.20.193.16:0/1511040875 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc31003dec0 msgr2=0x7fc310040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:06.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.047+0000 7fc33acc7640 1 --2- 10.20.193.16:0/1511040875 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc31003dec0 0x7fc310040380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0099c0 tx=0x7fc31c006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.047+0000 7fc33acc7640 1 -- 10.20.193.16:0/1511040875 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc33410d6f0 msgr2=0x7fc3341a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:06.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.047+0000 7fc33acc7640 1 --2- 10.20.193.16:0/1511040875 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc33410d6f0 0x7fc3341a4060 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc324004290 tx=0x7fc3240042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.048+0000 7fc33acc7640 1 -- 10.20.193.16:0/1511040875 shutdown_connections 2026-02-17T08:23:06.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.048+0000 7fc33acc7640 1 --2- 10.20.193.16:0/1511040875 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7fc31003dec0 0x7fc310040380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.049 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.048+0000 7fc33acc7640 1 --2- 10.20.193.16:0/1511040875 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7fc33410d6f0 0x7fc3341a4060 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.050 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.048+0000 7fc33acc7640 1 -- 10.20.193.16:0/1511040875 >> 10.20.193.16:0/1511040875 conn(0x7fc33406cd20 msgr2=0x7fc33410cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:06.050 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.048+0000 7fc33acc7640 1 -- 10.20.193.16:0/1511040875 shutdown_connections 2026-02-17T08:23:06.050 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.048+0000 7fc33acc7640 1 -- 10.20.193.16:0/1511040875 wait complete. 2026-02-17T08:23:06.083 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411332 for osd.2 2026-02-17T08:23:06.084 DEBUG:teuthology.parallel:result is None 2026-02-17T08:23:06.084 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-17T08:23:06.084 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T08:23:06.272 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:06.380 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 -- 10.20.193.16:0/1814952208 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff61c077620 msgr2=0x7ff61c077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:06.380 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 --2- 10.20.193.16:0/1814952208 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff61c077620 0x7ff61c077a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6100099b0 tx=0x7ff61002f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.380 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 -- 10.20.193.16:0/1814952208 shutdown_connections 2026-02-17T08:23:06.380 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 --2- 10.20.193.16:0/1814952208 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff61c077620 0x7ff61c077a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.380 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 -- 10.20.193.16:0/1814952208 >> 10.20.193.16:0/1814952208 conn(0x7ff61c1006d0 msgr2=0x7ff61c102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 -- 10.20.193.16:0/1814952208 shutdown_connections 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 -- 10.20.193.16:0/1814952208 wait complete. 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 Processor -- start 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 -- start start 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff61c077620 0x7ff61c1a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff620dbf640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c1125b0 con 0x7ff61c077620 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff61a575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff61c077620 0x7ff61c1a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff61a575640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff61c077620 0x7ff61c1a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58578/0 (socket says 10.20.193.16:58578) 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff61a575640 1 -- 10.20.193.16:0/1203336306 learned_addr learned my addr 10.20.193.16:0/1203336306 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff61a575640 1 -- 10.20.193.16:0/1203336306 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c1a5d50 con 0x7ff61c077620 2026-02-17T08:23:06.381 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.377+0000 7ff61a575640 1 --2- 10.20.193.16:0/1203336306 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff61c077620 0x7ff61c1a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff610004290 tx=0x7ff6100042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff6037fe640 1 -- 10.20.193.16:0/1203336306 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff610038510 con 0x7ff61c077620 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff6037fe640 1 -- 10.20.193.16:0/1203336306 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7ff610046070 con 0x7ff61c077620 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff6037fe640 1 -- 10.20.193.16:0/1203336306 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff610041610 con 0x7ff61c077620 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff620dbf640 1 -- 10.20.193.16:0/1203336306 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c1a5fe0 con 0x7ff61c077620 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff620dbf640 1 -- 10.20.193.16:0/1203336306 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c19f9d0 con 0x7ff61c077620 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff620dbf640 1 -- 10.20.193.16:0/1203336306 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c078d60 con 0x7ff61c077620 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff6037fe640 1 -- 10.20.193.16:0/1203336306 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7ff6100386b0 con 0x7ff61c077620 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff6037fe640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff6037fe640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff6037fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff6037fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:06.382 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff6037fe640 1 --2- 10.20.193.16:0/1203336306 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff5f403dec0 0x7ff5f4040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:06.383 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff6037fe640 1 -- 10.20.193.16:0/1203336306 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7ff610077aa0 con 0x7ff61c077620 2026-02-17T08:23:06.383 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.378+0000 7ff619d74640 1 --2- 10.20.193.16:0/1203336306 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff5f403dec0 0x7ff5f4040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:06.383 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.379+0000 7ff619d74640 1 --2- 10.20.193.16:0/1203336306 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff5f403dec0 0x7ff5f4040380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6040099c0 tx=0x7ff604006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:06.383 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.381+0000 7ff6037fe640 1 -- 10.20.193.16:0/1203336306 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff610040360 con 0x7ff61c077620 2026-02-17T08:23:06.465 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.463+0000 7ff620dbf640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-17T08:23:06.465 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.463+0000 7ff620dbf640 1 -- 10.20.193.16:0/1203336306 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff61c077ab0 con 0x7ff5f403dec0 2026-02-17T08:23:06.465 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.464+0000 7ff6037fe640 1 -- 10.20.193.16:0/1203336306 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9877 (secure 0 0 0) 0x7ff61c077ab0 con 0x7ff5f403dec0 2026-02-17T08:23:06.465 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.464+0000 7ff6037fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:23:06.466 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:06.467 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-17T08:23:06.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 10 mgrc shutdown 2026-02-17T08:23:06.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 1 -- 10.20.193.16:0/1203336306 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff5f403dec0 msgr2=0x7ff5f4040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:06.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 1 --2- 10.20.193.16:0/1203336306 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff5f403dec0 0x7ff5f4040380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6040099c0 tx=0x7ff604006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 1 -- 10.20.193.16:0/1203336306 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff61c077620 msgr2=0x7ff61c1a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:06.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 1 --2- 10.20.193.16:0/1203336306 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff61c077620 0x7ff61c1a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff610004290 tx=0x7ff6100042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 1 -- 10.20.193.16:0/1203336306 shutdown_connections 2026-02-17T08:23:06.467 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 1 --2- 10.20.193.16:0/1203336306 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff5f403dec0 0x7ff5f4040380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 1 --2- 10.20.193.16:0/1203336306 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff61c077620 0x7ff61c1a5810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 1 -- 10.20.193.16:0/1203336306 >> 10.20.193.16:0/1203336306 conn(0x7ff61c1006d0 msgr2=0x7ff61c1034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:06.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 1 -- 10.20.193.16:0/1203336306 shutdown_connections 2026-02-17T08:23:06.468 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.465+0000 7ff620dbf640 1 -- 10.20.193.16:0/1203336306 wait complete. 2026-02-17T08:23:06.502 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2026-02-17T08:23:05.014910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":92164,"kb_used_data":2252,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":2201917436,"statfs":{"total":2254857830400,"available":2254763454464,"internally_reserved":0,"allocated":2306048,"data_stored":1922370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"20'72","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T08:23:03.153090+0000","last_change":"2026-02-17T08:23:02.960605+0000","last_active":"2026-02-17T08:23:03.153090+0000","last_peered":"2026-02-17T08:23:03.153090+0000","last_clean":"2026-02-17T08:23:03.153090+0000","last_became_active":"2026-02-17T08:23:02.958129+0000","last_became_peered":"2026-02-17T08:23:02.958129+0000","last_unstale":"2026-02-17T08:23:03.153090+0000","last_undegraded":"2026-02-17T08:23:03.153090+0000","last_fullsized":"2026-02-17T08:23:03.153090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:23:01.728177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:23:01.728177+0000","last_clean_scrub_stamp":"2026-02-17T08:23:01.728177+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:52:48.414658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411332,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32072,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971128,"statfs":{"total":751619276800,"available":751586435072,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":765952,"data_stored":639595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32120,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971080,"statfs":{"total":751619276800,"available":751586385920,"internally_reserved":0,"allocated":765952,"data_stored":639595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:23:06.503 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T08:23:06.618 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:06 trial016 ceph-mon[39048]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T08:23:06.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:06 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3608978890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T08:23:06.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:06 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/113409224' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T08:23:06.619 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:06 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/1511040875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T08:23:06.652 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:06.759 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.755+0000 7f5650b7f640 1 -- 10.20.193.16:0/1446014011 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f564c06b270 msgr2=0x7f564c06b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:06.759 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.755+0000 7f5650b7f640 1 --2- 10.20.193.16:0/1446014011 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f564c06b270 0x7f564c06b650 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f56380099b0 tx=0x7f563802f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.759 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.755+0000 7f5650b7f640 1 -- 10.20.193.16:0/1446014011 shutdown_connections 2026-02-17T08:23:06.759 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.755+0000 7f5650b7f640 1 --2- 10.20.193.16:0/1446014011 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f564c06b270 0x7f564c06b650 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.759 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.755+0000 7f5650b7f640 1 -- 10.20.193.16:0/1446014011 >> 10.20.193.16:0/1446014011 conn(0x7f564c0fcdc0 msgr2=0x7f564c0ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:06.759 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.755+0000 7f5650b7f640 1 -- 10.20.193.16:0/1446014011 shutdown_connections 2026-02-17T08:23:06.759 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.755+0000 7f5650b7f640 1 -- 10.20.193.16:0/1446014011 wait complete. 2026-02-17T08:23:06.759 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f5650b7f640 1 Processor -- start 2026-02-17T08:23:06.759 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f5650b7f640 1 -- start start 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f5650b7f640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f564c06b270 0x7f564c101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f5650b7f640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7f564c10bbf0 con 0x7f564c06b270 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f564b7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f564c06b270 0x7f564c101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f564b7fe640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f564c06b270 0x7f564c101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58594/0 (socket says 10.20.193.16:58594) 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f564b7fe640 1 -- 10.20.193.16:0/506642706 learned_addr learned my addr 10.20.193.16:0/506642706 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f564b7fe640 1 -- 10.20.193.16:0/506642706 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564c102f70 con 0x7f564c06b270 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f564b7fe640 1 --2- 10.20.193.16:0/506642706 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f564c06b270 0x7f564c101080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5638004290 tx=0x7f56380042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f5648ff9640 1 -- 10.20.193.16:0/506642706 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5638038510 con 0x7f564c06b270 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f5650b7f640 1 -- 10.20.193.16:0/506642706 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564c1015c0 con 0x7f564c06b270 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f5648ff9640 1 -- 10.20.193.16:0/506642706 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f5638046070 con 0x7f564c06b270 2026-02-17T08:23:06.760 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f5648ff9640 1 -- 10.20.193.16:0/506642706 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5638041610 con 0x7f564c06b270 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.756+0000 7f5650b7f640 1 -- 10.20.193.16:0/506642706 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564c101a80 con 0x7f564c06b270 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.757+0000 7f5650b7f640 1 -- 10.20.193.16:0/506642706 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f564c103920 con 0x7f564c06b270 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.757+0000 7f5648ff9640 1 -- 10.20.193.16:0/506642706 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7f56380386b0 con 0x7f564c06b270 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.757+0000 7f5648ff9640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.757+0000 7f5648ff9640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.757+0000 7f5648ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.757+0000 7f5648ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.757+0000 7f5648ff9640 1 --2- 10.20.193.16:0/506642706 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f562003dec0 0x7f5620040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.757+0000 7f5648ff9640 1 -- 10.20.193.16:0/506642706 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f5638077ae0 con 0x7f564c06b270 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.757+0000 7f564affd640 1 --2- 10.20.193.16:0/506642706 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f562003dec0 0x7f5620040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:06.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.757+0000 7f564affd640 1 --2- 10.20.193.16:0/506642706 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f562003dec0 0x7f5620040380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f563c0099c0 tx=0x7f563c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:06.762 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.759+0000 7f5648ff9640 1 -- 10.20.193.16:0/506642706 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5638040360 con 0x7f564c06b270 2026-02-17T08:23:06.844 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.842+0000 7f5650b7f640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-17T08:23:06.844 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.842+0000 7f5650b7f640 1 -- 10.20.193.16:0/506642706 --> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f564c1025b0 con 0x7f562003dec0 2026-02-17T08:23:06.844 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.843+0000 7f5648ff9640 1 -- 10.20.193.16:0/506642706 <== mgr.14150 v2:10.20.193.16:6800/2397623389 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9877 (secure 0 0 0) 0x7f564c1025b0 con 0x7f562003dec0 2026-02-17T08:23:06.844 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.843+0000 7f5648ff9640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T08:23:06.845 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:06.846 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-17T08:23:06.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 10 mgrc shutdown 2026-02-17T08:23:06.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 1 -- 10.20.193.16:0/506642706 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f562003dec0 msgr2=0x7f5620040380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:06.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 1 --2- 10.20.193.16:0/506642706 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f562003dec0 0x7f5620040380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f563c0099c0 tx=0x7f563c006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 1 -- 10.20.193.16:0/506642706 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f564c06b270 msgr2=0x7f564c101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:06.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 1 --2- 10.20.193.16:0/506642706 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f564c06b270 0x7f564c101080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5638004290 tx=0x7f56380042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 1 -- 10.20.193.16:0/506642706 shutdown_connections 2026-02-17T08:23:06.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 1 --2- 10.20.193.16:0/506642706 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7f562003dec0 0x7f5620040380 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 1 --2- 10.20.193.16:0/506642706 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7f564c06b270 0x7f564c101080 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:06.847 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 1 -- 10.20.193.16:0/506642706 >> 10.20.193.16:0/506642706 conn(0x7f564c0fcdc0 msgr2=0x7f564c106530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:06.847 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 1 -- 10.20.193.16:0/506642706 shutdown_connections 2026-02-17T08:23:06.847 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:06.844+0000 7f5650b7f640 1 -- 10.20.193.16:0/506642706 wait complete. 2026-02-17T08:23:06.879 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2026-02-17T08:23:05.014910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":92164,"kb_used_data":2252,"kb_used_omap":4,"kb_used_meta":89147,"kb_avail":2201917436,"statfs":{"total":2254857830400,"available":2254763454464,"internally_reserved":0,"allocated":2306048,"data_stored":1922370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":91286866},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"20'72","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T08:23:03.153090+0000","last_change":"2026-02-17T08:23:02.960605+0000","last_active":"2026-02-17T08:23:03.153090+0000","last_peered":"2026-02-17T08:23:03.153090+0000","last_clean":"2026-02-17T08:23:03.153090+0000","last_became_active":"2026-02-17T08:23:02.958129+0000","last_became_peered":"2026-02-17T08:23:02.958129+0000","last_unstale":"2026-02-17T08:23:03.153090+0000","last_undegraded":"2026-02-17T08:23:03.153090+0000","last_fullsized":"2026-02-17T08:23:03.153090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T08:23:01.728177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T08:23:01.728177+0000","last_clean_scrub_stamp":"2026-02-17T08:23:01.728177+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:52:48.414658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411332,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32072,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971128,"statfs":{"total":751619276800,"available":751586435072,"internally_reserved":0,"allocated":774144,"data_stored":643180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":765952,"data_stored":639595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32120,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971080,"statfs":{"total":751619276800,"available":751586385920,"internally_reserved":0,"allocated":765952,"data_stored":639595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T08:23:06.880 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-17T08:23:06.880 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T08:23:06.881 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-17T08:23:06.881 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:04cf6dd4be446d06026adad18a5fbf5da1fa8c0e shell --fsid ad06c547-0bd9-11f1-adc2-d404e6e7d460 -- ceph health --format=json 2026-02-17T08:23:07.031 INFO:teuthology.orchestra.run.trial016.stderr:Inferring config /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/mon.a/config 2026-02-17T08:23:07.136 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.132+0000 7ff30d1b4640 1 -- 10.20.193.16:0/2290797703 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff308102600 msgr2=0x7ff3081029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:07.136 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.132+0000 7ff30d1b4640 1 --2- 10.20.193.16:0/2290797703 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff308102600 0x7ff3081029e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0099b0 tx=0x7ff2fc02f2b0 comp rx=0 tx=0).stop 2026-02-17T08:23:07.136 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff30d1b4640 1 -- 10.20.193.16:0/2290797703 shutdown_connections 2026-02-17T08:23:07.136 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff30d1b4640 1 --2- 10.20.193.16:0/2290797703 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff308102600 0x7ff3081029e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:07.137 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff30d1b4640 1 -- 10.20.193.16:0/2290797703 >> 10.20.193.16:0/2290797703 conn(0x7ff308079240 msgr2=0x7ff308100510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:07.137 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff30d1b4640 1 -- 10.20.193.16:0/2290797703 shutdown_connections 2026-02-17T08:23:07.137 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff30d1b4640 1 -- 10.20.193.16:0/2290797703 wait complete. 2026-02-17T08:23:07.137 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff30d1b4640 1 Processor -- start 2026-02-17T08:23:07.137 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff30d1b4640 1 -- start start 2026-02-17T08:23:07.137 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff30d1b4640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff308102600 0x7ff30819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:07.137 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff30d1b4640 1 -- --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff30810bdb0 con 0x7ff308102600 2026-02-17T08:23:07.137 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff306d76640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff308102600 0x7ff30819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:07.137 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff306d76640 1 --2- >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff308102600 0x7ff30819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.16:3300/0 says I am v2:10.20.193.16:58620/0 (socket says 10.20.193.16:58620) 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff306d76640 1 -- 10.20.193.16:0/3663487614 learned_addr learned my addr 10.20.193.16:0/3663487614 (peer_addr_for_me v2:10.20.193.16:0/0) 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.133+0000 7ff306d76640 1 -- 10.20.193.16:0/3663487614 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30819bb90 con 0x7ff308102600 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff306d76640 1 --2- 10.20.193.16:0/3663487614 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff308102600 0x7ff30819b650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004290 tx=0x7ff2fc0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff2e7fff640 1 -- 10.20.193.16:0/3663487614 <== mon.0 v2:10.20.193.16:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2fc038510 con 0x7ff308102600 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff2e7fff640 1 -- 10.20.193.16:0/3663487614 <== mon.0 v2:10.20.193.16:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7ff2fc046070 con 0x7ff308102600 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff2e7fff640 1 -- 10.20.193.16:0/3663487614 <== mon.0 v2:10.20.193.16:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2fc041610 con 0x7ff308102600 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff30d1b4640 1 -- 10.20.193.16:0/3663487614 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30819be20 con 0x7ff308102600 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff30d1b4640 1 -- 10.20.193.16:0/3663487614 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30819ff20 con 0x7ff308102600 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff30d1b4640 1 -- 10.20.193.16:0/3663487614 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff308103ae0 con 0x7ff308102600 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff2e7fff640 1 -- 10.20.193.16:0/3663487614 <== mon.0 v2:10.20.193.16:3300/0 4 ==== mgrmap(e 14) ==== 50437+0+0 (secure 0 0 0) 0x7ff2fc0386b0 con 0x7ff308102600 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff2e7fff640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T08:23:07.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff2e7fff640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T08:23:07.139 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff2e7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:07.139 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff2e7fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] 2026-02-17T08:23:07.139 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff2e7fff640 1 --2- 10.20.193.16:0/3663487614 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff2dc03df10 0x7ff2dc0403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T08:23:07.139 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.134+0000 7ff2e7fff640 1 -- 10.20.193.16:0/3663487614 <== mon.0 v2:10.20.193.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7ff2fc077b60 con 0x7ff308102600 2026-02-17T08:23:07.139 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.135+0000 7ff306575640 1 --2- 10.20.193.16:0/3663487614 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff2dc03df10 0x7ff2dc0403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T08:23:07.139 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.135+0000 7ff306575640 1 --2- 10.20.193.16:0/3663487614 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff2dc03df10 0x7ff2dc0403d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00099c0 tx=0x7ff2f0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T08:23:07.139 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.137+0000 7ff2e7fff640 1 -- 10.20.193.16:0/3663487614 <== mon.0 v2:10.20.193.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff2fc040360 con 0x7ff308102600 2026-02-17T08:23:07.239 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.238+0000 7ff30d1b4640 1 -- 10.20.193.16:0/3663487614 --> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff308102a60 con 0x7ff308102600 2026-02-17T08:23:07.239 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.238+0000 7ff2e7fff640 1 -- 10.20.193.16:0/3663487614 <== mon.0 v2:10.20.193.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff2fc049360 con 0x7ff308102600 2026-02-17T08:23:07.240 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:07.240 INFO:teuthology.orchestra.run.trial016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T08:23:07.241 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 10 mgrc shutdown 2026-02-17T08:23:07.241 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 1 -- 10.20.193.16:0/3663487614 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff2dc03df10 msgr2=0x7ff2dc0403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:07.241 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 1 --2- 10.20.193.16:0/3663487614 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff2dc03df10 0x7ff2dc0403d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00099c0 tx=0x7ff2f0006eb0 comp rx=0 tx=0).stop 2026-02-17T08:23:07.241 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 1 -- 10.20.193.16:0/3663487614 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff308102600 msgr2=0x7ff30819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T08:23:07.241 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 1 --2- 10.20.193.16:0/3663487614 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff308102600 0x7ff30819b650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004290 tx=0x7ff2fc0042c0 comp rx=0 tx=0).stop 2026-02-17T08:23:07.242 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 1 -- 10.20.193.16:0/3663487614 shutdown_connections 2026-02-17T08:23:07.242 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 1 --2- 10.20.193.16:0/3663487614 >> [v2:10.20.193.16:6800/2397623389,v1:10.20.193.16:6801/2397623389] conn(0x7ff2dc03df10 0x7ff2dc0403d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:07.242 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 1 --2- 10.20.193.16:0/3663487614 >> [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] conn(0x7ff308102600 0x7ff30819b650 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T08:23:07.242 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 1 -- 10.20.193.16:0/3663487614 >> 10.20.193.16:0/3663487614 conn(0x7ff308079240 msgr2=0x7ff30810a100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T08:23:07.242 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 1 -- 10.20.193.16:0/3663487614 shutdown_connections 2026-02-17T08:23:07.242 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-17T08:23:07.239+0000 7ff30d1b4640 1 -- 10.20.193.16:0/3663487614 wait complete. 2026-02-17T08:23:07.275 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-17T08:23:07.275 INFO:tasks.cephadm:Setup complete, yielding 2026-02-17T08:23:07.275 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T08:23:07.289 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T08:23:07.290 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(OSD_DOWN\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T08:23:07.290 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51117', 'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'description': 'rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51117', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'], ['host.b', 'client.1']], 'seed': 3603, 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath19-testing-2026-02-13-0903-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'targets': {'trial016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCsNB/yci/ReWR4EwD/dnIH3bz+A+lgLQ0xVjQ1Rj1zotw+WFDUz+lYVyAWO+sDBFMEQOApkBHloCda5qF3uR1Y=', 'trial134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHuyah0gJQqf2xsOcmL7KELXSos58Ds70wKFG/u9b8ydFRAFKM8Cann/dvL/wb+ORm+8Vxsxd+M7jNfGt8AXiFo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'pexec': {'all': ['sudo dnf remove nvme-cli -y', 'sudo dnf install nvmetcli nvme-cli -y']}}, {'install': None}, {'cephadm': None}, {'ceph': {'log-ignorelist': ['\\(OSD_DOWN\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.1': ['cephadm/create_iscsi_disks.sh']}}}, {'workunit': {'clients': {'client.0': ['cephadm/test_dashboard_e2e.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:03:08', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T08:23:07.291 DEBUG:teuthology.orchestra.run.trial016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T08:23:07.293 DEBUG:teuthology.orchestra.run.trial134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T08:23:07.311 DEBUG:teuthology.orchestra.run.trial016:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T08:23:07.350 DEBUG:teuthology.orchestra.run.trial134:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T08:23:07.376 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:23:07.376 DEBUG:teuthology.orchestra.run.trial016:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T08:23:07.430 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T08:23:07.430 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_1 2026-02-17T08:23:07.487 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T08:23:07.488 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:23:07.488 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 3597 Links: 1 2026-02-17T08:23:07.488 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:23:07.488 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:23:07.488 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-17 08:22:53.006878702 +0000 2026-02-17T08:23:07.488 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-17 08:22:52.309981963 +0000 2026-02-17T08:23:07.488 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-17 08:22:52.309981963 +0000 2026-02-17T08:23:07.488 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-17 08:22:52.309981963 +0000 2026-02-17T08:23:07.489 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T08:23:07.550 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-17T08:23:07.550 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-17T08:23:07.551 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000150222 s, 3.4 MB/s 2026-02-17T08:23:07.552 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T08:23:07.609 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_2 2026-02-17T08:23:07.666 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T08:23:07.666 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:23:07.666 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 3980 Links: 1 2026-02-17T08:23:07.666 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:23:07.667 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:23:07.667 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-17 08:22:57.979346564 +0000 2026-02-17T08:23:07.667 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-17 08:22:57.979346564 +0000 2026-02-17T08:23:07.667 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-17 08:22:57.979346564 +0000 2026-02-17T08:23:07.667 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-17 08:22:57.979346564 +0000 2026-02-17T08:23:07.667 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T08:23:07.727 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:07 trial016 ceph-mon[39048]: from='client.? 10.20.193.16:0/3663487614' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-17T08:23:07.729 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-17T08:23:07.730 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-17T08:23:07.730 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000128811 s, 4.0 MB/s 2026-02-17T08:23:07.731 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T08:23:07.788 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_3 2026-02-17T08:23:07.844 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T08:23:07.845 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:23:07.845 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 3327 Links: 1 2026-02-17T08:23:07.845 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:23:07.845 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:23:07.845 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-17 08:22:53.006878702 +0000 2026-02-17T08:23:07.845 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-17 08:22:47.153473566 +0000 2026-02-17T08:23:07.845 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-17 08:22:47.153473566 +0000 2026-02-17T08:23:07.845 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-17 08:22:47.153473566 +0000 2026-02-17T08:23:07.846 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T08:23:07.907 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-17T08:23:07.908 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-17T08:23:07.908 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 3.7871e-05 s, 13.5 MB/s 2026-02-17T08:23:07.909 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T08:23:07.967 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_4 2026-02-17T08:23:08.023 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T08:23:08.023 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T08:23:08.023 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 2420 Links: 1 2026-02-17T08:23:08.023 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T08:23:08.023 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T08:23:08.023 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-17 08:22:53.006878702 +0000 2026-02-17T08:23:08.023 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-17 08:22:35.939665597 +0000 2026-02-17T08:23:08.023 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-17 08:22:35.940665580 +0000 2026-02-17T08:23:08.023 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-17 08:22:35.939665597 +0000 2026-02-17T08:23:08.023 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T08:23:08.085 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-17T08:23:08.085 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-17T08:23:08.085 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 2.6259e-05 s, 19.5 MB/s 2026-02-17T08:23:08.087 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T08:23:08.143 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:23:08.143 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T08:23:08.143 INFO:tasks.ceph:Generating config... 2026-02-17T08:23:08.146 INFO:tasks.ceph:[client] debug client = 20 2026-02-17T08:23:08.147 INFO:tasks.ceph:[client] debug mgrc = 20 2026-02-17T08:23:08.147 INFO:tasks.ceph:[client] debug ms = 1 2026-02-17T08:23:08.147 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-17T08:23:08.147 INFO:tasks.ceph:[mds] debug mgrc = 20 2026-02-17T08:23:08.147 INFO:tasks.ceph:[mgr] debug client = 20 2026-02-17T08:23:08.147 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T08:23:08.147 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T08:23:08.147 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T08:23:08.147 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T08:23:08.147 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T08:23:08.147 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] debug mgrc = 20 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T08:23:08.148 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T08:23:08.149 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T08:23:08.149 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T08:23:08.149 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T08:23:08.149 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T08:23:08.149 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T08:23:08.217 INFO:teuthology.orchestra.run.trial016.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T08:23:08.220 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T08:23:08.295 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T08:23:08.359 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.16')] 2026-02-17T08:23:08.359 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.16', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'mon.a': {}, 'mds': {'debug mgrc': 20}} 2026-02-17T08:23:08.360 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:23:08.360 DEBUG:teuthology.orchestra.run.trial016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T08:23:08.415 DEBUG:teuthology.orchestra.run.trial016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.16 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:23:08.486 INFO:teuthology.orchestra.run.trial016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:23:08.486 INFO:teuthology.orchestra.run.trial016.stdout:monmaptool: generated fsid 235ca975-ad7d-4075-8306-a4f8fb6e63db 2026-02-17T08:23:08.486 INFO:teuthology.orchestra.run.trial016.stdout:setting min_mon_release = quincy 2026-02-17T08:23:08.486 INFO:teuthology.orchestra.run.trial016.stdout:epoch 0 2026-02-17T08:23:08.486 INFO:teuthology.orchestra.run.trial016.stdout:fsid 235ca975-ad7d-4075-8306-a4f8fb6e63db 2026-02-17T08:23:08.486 INFO:teuthology.orchestra.run.trial016.stdout:last_changed 2026-02-17T08:23:08.485708+0000 2026-02-17T08:23:08.487 INFO:teuthology.orchestra.run.trial016.stdout:created 2026-02-17T08:23:08.485708+0000 2026-02-17T08:23:08.487 INFO:teuthology.orchestra.run.trial016.stdout:min_mon_release 17 (quincy) 2026-02-17T08:23:08.487 INFO:teuthology.orchestra.run.trial016.stdout:election_strategy: 3 2026-02-17T08:23:08.487 INFO:teuthology.orchestra.run.trial016.stdout:0: [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] mon.a 2026-02-17T08:23:08.487 INFO:teuthology.orchestra.run.trial016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T08:23:08.488 DEBUG:teuthology.orchestra.run.trial016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T08:23:08.545 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 235ca975-ad7d-4075-8306-a4f8fb6e63db... 2026-02-17T08:23:08.546 DEBUG:teuthology.orchestra.run.trial016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T08:23:08.587 DEBUG:teuthology.orchestra.run.trial134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T08:23:08.606 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:08 trial016 ceph-mon[39048]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T08:23:08.606 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:08 trial016 ceph-mon[39048]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T08:23:08.606 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:08 trial016 ceph-mon[39048]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T08:23:08.624 INFO:teuthology.orchestra.run.trial016.stdout:[global] 2026-02-17T08:23:08.624 INFO:teuthology.orchestra.run.trial016.stdout: chdir = "" 2026-02-17T08:23:08.624 INFO:teuthology.orchestra.run.trial016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T08:23:08.624 INFO:teuthology.orchestra.run.trial016.stdout: auth supported = cephx 2026-02-17T08:23:08.624 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.624 INFO:teuthology.orchestra.run.trial016.stdout: filestore xattr use omap = true 2026-02-17T08:23:08.624 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.624 INFO:teuthology.orchestra.run.trial016.stdout: mon clock drift allowed = 1.000 2026-02-17T08:23:08.624 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: osd crush chooseleaf type = 0 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: auth debug = true 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: ms die on old message = true 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: ms die on bug = true 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: mon pg warn max object skew = 0 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T08:23:08.625 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: osd pool default size = 2 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: mon osd allow primary affinity = true 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: mon osd allow pg remap = true 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: mon warn on legacy crush tunables = false 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: mon warn on crush straw calc version zero = false 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: mon warn on no sortbitwise = false 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: mon warn on osd down out interval zero = false 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: mon warn on too few osds = false 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T08:23:08.626 INFO:teuthology.orchestra.run.trial016.stdout: mon_allow_pool_size_one = true 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: osd default data pool replay window = 5 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: mon allow pool delete = true 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: mon cluster log file level = debug 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: debug asserts on shutdown = true 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: mon health detail to clog = false 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: mon host = 10.20.193.16 2026-02-17T08:23:08.627 INFO:teuthology.orchestra.run.trial016.stdout: mon election default strategy = 3 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout: fsid = 235ca975-ad7d-4075-8306-a4f8fb6e63db 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout:[osd] 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout: osd journal size = 100 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout: osd scrub load threshold = 5.0 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout: osd scrub max interval = 600 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout: osd mclock profile = high_recovery_ops 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout: osd recover clone overlap = true 2026-02-17T08:23:08.628 INFO:teuthology.orchestra.run.trial016.stdout: osd recovery max chunk = 1048576 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: osd debug shutdown = true 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: osd debug op order = true 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: osd debug verify stray on activate = true 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: osd debug trim objects = true 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: osd open classes on start = true 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: osd debug pg log writeout = true 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: osd deep scrub update digest min age = 30 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: osd map max advance = 10 2026-02-17T08:23:08.629 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: journal zero on create = true 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: filestore ondisk finisher threads = 3 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: filestore apply finisher threads = 3 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: bdev debug aio = true 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: osd debug misdirected ops = true 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: bdev async discard = True 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: bdev enable discard = True 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: bluestore allocator = stupid 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: bluestore block size = 96636764160 2026-02-17T08:23:08.630 INFO:teuthology.orchestra.run.trial016.stdout: bluestore fsck on mount = True 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: debug bluefs = 1/20 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: debug bluestore = 1/20 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: debug mgrc = 20 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: debug ms = 1 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: debug osd = 20 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: debug rocksdb = 4/10 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: mon osd full ratio = 0.9 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: mon osd nearfull ratio = 0.8 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: osd failsafe full ratio = 0.95 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: osd objectstore = bluestore 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.631 INFO:teuthology.orchestra.run.trial016.stdout:[mgr] 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: debug ms = 1 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: debug mgr = 20 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: debug mon = 20 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: debug auth = 20 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: mon reweight min pgs per osd = 4 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: mon reweight min bytes per osd = 10 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: mgr/telemetry/nag = false 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: debug client = 20 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout:[mon] 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: debug ms = 1 2026-02-17T08:23:08.632 INFO:teuthology.orchestra.run.trial016.stdout: debug mon = 20 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: debug paxos = 20 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: debug auth = 20 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: mon data avail warn = 5 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: mon mgr mkfs grace = 240 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: mon reweight min pgs per osd = 4 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: mon osd reporter subtree level = osd 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: mon osd prime pg temp = true 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: mon reweight min bytes per osd = 10 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T08:23:08.633 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: # 1m isn't quite enough 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: mon_down_mkfs_grace = 2m 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: mon_warn_on_filestore_osds = false 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout:[client] 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: rgw cache enabled = true 2026-02-17T08:23:08.634 INFO:teuthology.orchestra.run.trial016.stdout: rgw enable ops log = true 2026-02-17T08:23:08.635 INFO:teuthology.orchestra.run.trial016.stdout: rgw enable usage log = true 2026-02-17T08:23:08.635 INFO:teuthology.orchestra.run.trial016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T08:23:08.635 INFO:teuthology.orchestra.run.trial016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T08:23:08.635 INFO:teuthology.orchestra.run.trial016.stdout: debug client = 20 2026-02-17T08:23:08.635 INFO:teuthology.orchestra.run.trial016.stdout: debug mgrc = 20 2026-02-17T08:23:08.635 INFO:teuthology.orchestra.run.trial016.stdout: debug ms = 1 2026-02-17T08:23:08.635 INFO:teuthology.orchestra.run.trial016.stdout:[mon.a] 2026-02-17T08:23:08.635 INFO:teuthology.orchestra.run.trial016.stdout:[mds] 2026-02-17T08:23:08.635 INFO:teuthology.orchestra.run.trial016.stdout: debug mgrc = 20 2026-02-17T08:23:08.636 INFO:teuthology.orchestra.run.trial134.stdout:[global] 2026-02-17T08:23:08.636 INFO:teuthology.orchestra.run.trial134.stdout: chdir = "" 2026-02-17T08:23:08.636 INFO:teuthology.orchestra.run.trial134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T08:23:08.636 INFO:teuthology.orchestra.run.trial134.stdout: auth supported = cephx 2026-02-17T08:23:08.636 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.636 INFO:teuthology.orchestra.run.trial134.stdout: filestore xattr use omap = true 2026-02-17T08:23:08.636 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.637 INFO:teuthology.orchestra.run.trial134.stdout: mon clock drift allowed = 1.000 2026-02-17T08:23:08.637 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.637 INFO:teuthology.orchestra.run.trial134.stdout: osd crush chooseleaf type = 0 2026-02-17T08:23:08.637 INFO:teuthology.orchestra.run.trial134.stdout: auth debug = true 2026-02-17T08:23:08.637 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.637 INFO:teuthology.orchestra.run.trial134.stdout: ms die on old message = true 2026-02-17T08:23:08.637 INFO:teuthology.orchestra.run.trial134.stdout: ms die on bug = true 2026-02-17T08:23:08.637 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.637 INFO:teuthology.orchestra.run.trial134.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T08:23:08.637 INFO:teuthology.orchestra.run.trial134.stdout: mon pg warn max object skew = 0 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: osd pool default size = 2 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: mon osd allow primary affinity = true 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: mon osd allow pg remap = true 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: mon warn on legacy crush tunables = false 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: mon warn on crush straw calc version zero = false 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: mon warn on no sortbitwise = false 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: mon warn on osd down out interval zero = false 2026-02-17T08:23:08.638 INFO:teuthology.orchestra.run.trial134.stdout: mon warn on too few osds = false 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: mon_allow_pool_size_one = true 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: osd default data pool replay window = 5 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: mon allow pool delete = true 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: mon cluster log file level = debug 2026-02-17T08:23:08.639 INFO:teuthology.orchestra.run.trial134.stdout: debug asserts on shutdown = true 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: mon health detail to clog = false 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: mon host = 10.20.193.16 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: mon election default strategy = 3 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: fsid = 235ca975-ad7d-4075-8306-a4f8fb6e63db 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout:[osd] 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: osd journal size = 100 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: osd scrub load threshold = 5.0 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: osd scrub max interval = 600 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: osd mclock profile = high_recovery_ops 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.640 INFO:teuthology.orchestra.run.trial134.stdout: osd recover clone overlap = true 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: osd recovery max chunk = 1048576 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: osd debug shutdown = true 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: osd debug op order = true 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: osd debug verify stray on activate = true 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: osd debug trim objects = true 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: osd open classes on start = true 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: osd debug pg log writeout = true 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: osd deep scrub update digest min age = 30 2026-02-17T08:23:08.641 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: osd map max advance = 10 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: journal zero on create = true 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: filestore ondisk finisher threads = 3 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: filestore apply finisher threads = 3 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: bdev debug aio = true 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: osd debug misdirected ops = true 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: bdev async discard = True 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: bdev enable discard = True 2026-02-17T08:23:08.642 INFO:teuthology.orchestra.run.trial134.stdout: bluestore allocator = stupid 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: bluestore block size = 96636764160 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: bluestore fsck on mount = True 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: debug bluefs = 1/20 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: debug bluestore = 1/20 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: debug mgrc = 20 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: debug ms = 1 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: debug osd = 20 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: debug rocksdb = 4/10 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: mon osd full ratio = 0.9 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: mon osd nearfull ratio = 0.8 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: osd failsafe full ratio = 0.95 2026-02-17T08:23:08.643 INFO:teuthology.orchestra.run.trial134.stdout: osd objectstore = bluestore 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout:[mgr] 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: debug ms = 1 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: debug mgr = 20 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: debug mon = 20 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: debug auth = 20 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: mon reweight min pgs per osd = 4 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: mon reweight min bytes per osd = 10 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: mgr/telemetry/nag = false 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: debug client = 20 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout:[mon] 2026-02-17T08:23:08.644 INFO:teuthology.orchestra.run.trial134.stdout: debug ms = 1 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: debug mon = 20 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: debug paxos = 20 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: debug auth = 20 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: mon data avail warn = 5 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: mon mgr mkfs grace = 240 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: mon reweight min pgs per osd = 4 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: mon osd reporter subtree level = osd 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: mon osd prime pg temp = true 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: mon reweight min bytes per osd = 10 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T08:23:08.645 INFO:teuthology.orchestra.run.trial134.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: # 1m isn't quite enough 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: mon_down_mkfs_grace = 2m 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: mon_warn_on_filestore_osds = false 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout:[client] 2026-02-17T08:23:08.646 INFO:teuthology.orchestra.run.trial134.stdout: rgw cache enabled = true 2026-02-17T08:23:08.647 INFO:teuthology.orchestra.run.trial134.stdout: rgw enable ops log = true 2026-02-17T08:23:08.647 INFO:teuthology.orchestra.run.trial134.stdout: rgw enable usage log = true 2026-02-17T08:23:08.647 INFO:teuthology.orchestra.run.trial134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T08:23:08.647 INFO:teuthology.orchestra.run.trial134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T08:23:08.647 INFO:teuthology.orchestra.run.trial134.stdout: debug client = 20 2026-02-17T08:23:08.647 INFO:teuthology.orchestra.run.trial134.stdout: debug mgrc = 20 2026-02-17T08:23:08.647 INFO:teuthology.orchestra.run.trial134.stdout: debug ms = 1 2026-02-17T08:23:08.647 INFO:teuthology.orchestra.run.trial134.stdout:[mon.a] 2026-02-17T08:23:08.647 INFO:teuthology.orchestra.run.trial134.stdout:[mds] 2026-02-17T08:23:08.647 INFO:teuthology.orchestra.run.trial134.stdout: debug mgrc = 20 2026-02-17T08:23:08.649 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T08:23:08.650 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T08:23:08.730 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T08:23:08.731 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:23:08.731 DEBUG:teuthology.orchestra.run.trial016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T08:23:08.789 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:23:08.789 DEBUG:teuthology.orchestra.run.trial016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T08:23:08.846 INFO:tasks.ceph:Sending monmap to node ubuntu@trial016.front.sepia.ceph.com 2026-02-17T08:23:08.847 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:23:08.847 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T08:23:08.847 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T08:23:08.919 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-17T08:23:08.920 DEBUG:teuthology.orchestra.run.trial016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:23:08.975 INFO:tasks.ceph:Sending monmap to node ubuntu@trial134.front.sepia.ceph.com 2026-02-17T08:23:08.976 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:23:08.976 DEBUG:teuthology.orchestra.run.trial134:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T08:23:08.976 DEBUG:teuthology.orchestra.run.trial134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T08:23:09.010 DEBUG:teuthology.orchestra.run.trial134:> set -ex 2026-02-17T08:23:09.010 DEBUG:teuthology.orchestra.run.trial134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:23:09.065 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T08:23:09.065 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T08:23:09.065 DEBUG:teuthology.orchestra.run.trial016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.a /var/lib/ceph/mgr/ceph-a/keyring 2026-02-17T08:23:09.110 INFO:teuthology.orchestra.run.trial016.stdout:creating /var/lib/ceph/mgr/ceph-a/keyring 2026-02-17T08:23:09.112 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T08:23:09.113 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T08:23:09.113 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T08:23:09.148 INFO:teuthology.orchestra.run.trial016.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T08:23:09.159 DEBUG:teuthology.orchestra.run.trial134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-17T08:23:09.196 INFO:teuthology.orchestra.run.trial134.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-17T08:23:09.206 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T08:23:09.207 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T08:23:09.207 DEBUG:teuthology.orchestra.run.trial016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T08:23:09.232 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:23:09.232 INFO:tasks.ceph:role: osd.0 2026-02-17T08:23:09.233 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial016.front.sepia.ceph.com 2026-02-17T08:23:09.233 DEBUG:teuthology.orchestra.run.trial016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T08:23:09.298 INFO:teuthology.orchestra.run.trial016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T08:23:09.298 INFO:teuthology.orchestra.run.trial016.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T08:23:09.298 INFO:teuthology.orchestra.run.trial016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T08:23:09.298 INFO:teuthology.orchestra.run.trial016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T08:23:09.298 INFO:teuthology.orchestra.run.trial016.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T08:23:09.298 INFO:teuthology.orchestra.run.trial016.stdout: = sunit=0 swidth=0 blks 2026-02-17T08:23:09.298 INFO:teuthology.orchestra.run.trial016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T08:23:09.299 INFO:teuthology.orchestra.run.trial016.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T08:23:09.299 INFO:teuthology.orchestra.run.trial016.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T08:23:09.299 INFO:teuthology.orchestra.run.trial016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T08:23:09.860 INFO:teuthology.orchestra.run.trial016.stdout:Discarding blocks...Done. 2026-02-17T08:23:09.863 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial016.front.sepia.ceph.com -o noatime 2026-02-17T08:23:09.863 DEBUG:teuthology.orchestra.run.trial016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T08:23:09.937 DEBUG:teuthology.orchestra.run.trial016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T08:23:10.005 DEBUG:teuthology.orchestra.run.trial016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T08:23:10.070 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T08:23:10.070 INFO:tasks.ceph:role: osd.1 2026-02-17T08:23:10.070 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial016.front.sepia.ceph.com 2026-02-17T08:23:10.071 DEBUG:teuthology.orchestra.run.trial016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T08:23:10.134 INFO:teuthology.orchestra.run.trial016.stderr:mkfs.xfs: cannot open /dev/vg_nvme/lv_2: Device or resource busy 2026-02-17T08:23:10.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:23:10.136 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048', '-f'] on /dev/vg_nvme/lv_2 on ubuntu@trial016.front.sepia.ceph.com 2026-02-17T08:23:10.136 DEBUG:teuthology.orchestra.run.trial016:> yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2 2026-02-17T08:23:10.200 INFO:teuthology.orchestra.run.trial016.stderr:mkfs.xfs: cannot open /dev/vg_nvme/lv_2: Device or resource busy 2026-02-17T08:23:10.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:23:10.202 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 924, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial016 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 30, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 931, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial016 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2' 2026-02-17T08:23:10.209 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 924, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial016 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 1919, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 30, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/ceph.py", line 931, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial016 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2' 2026-02-17T08:23:10.215 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T08:23:10.230 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-17T08:23:10.245 INFO:tasks.cephadm:Teardown begin 2026-02-17T08:23:10.245 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T08:23:10.271 DEBUG:teuthology.orchestra.run.trial134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T08:23:10.296 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-17T08:23:10.296 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-17T08:23:10.300 DEBUG:teuthology.misc:Transferring archived files from trial016:/var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51117/remote/trial016/crash 2026-02-17T08:23:10.302 DEBUG:teuthology.orchestra.run.trial016:> sudo tar c -f - -C /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/crash -- . 2026-02-17T08:23:10.336 DEBUG:teuthology.misc:Transferring archived files from trial134:/var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51117/remote/trial134/crash 2026-02-17T08:23:10.338 DEBUG:teuthology.orchestra.run.trial134:> sudo tar c -f - -C /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/crash -- . 2026-02-17T08:23:10.363 INFO:teuthology.orchestra.run.trial134.stderr:tar: /var/lib/ceph/ad06c547-0bd9-11f1-adc2-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-17T08:23:10.363 INFO:teuthology.orchestra.run.trial134.stderr:tar: Error is not recoverable: exiting now 2026-02-17T08:23:10.364 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-17T08:23:10.364 INFO:tasks.cephadm:Removing cluster... 2026-02-17T08:23:10.365 DEBUG:teuthology.orchestra.run.trial016:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 235ca975-ad7d-4075-8306-a4f8fb6e63db --force 2026-02-17T08:23:10.489 INFO:teuthology.orchestra.run.trial016.stdout:Deleting cluster with fsid: 235ca975-ad7d-4075-8306-a4f8fb6e63db 2026-02-17T08:23:10.569 DEBUG:teuthology.orchestra.run.trial134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 235ca975-ad7d-4075-8306-a4f8fb6e63db --force 2026-02-17T08:23:10.679 INFO:teuthology.orchestra.run.trial134.stdout:Deleting cluster with fsid: 235ca975-ad7d-4075-8306-a4f8fb6e63db 2026-02-17T08:23:10.749 INFO:tasks.cephadm:Removing cephadm ... 2026-02-17T08:23:10.749 DEBUG:teuthology.orchestra.run.trial016:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-17T08:23:10.768 DEBUG:teuthology.orchestra.run.trial134:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-17T08:23:10.785 INFO:tasks.cephadm:Teardown complete 2026-02-17T08:23:10.786 ERROR:teuthology.run_tasks:Manager failed: cephadm Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-17T08:23:10.791 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T08:23:10.808 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-17T08:23:10.814 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T08:23:10.814 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T08:23:10.817 DEBUG:teuthology.orchestra.run.trial134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T08:23:10.837 INFO:journalctl@ceph.mon.a.trial016.stdout:Feb 17 08:23:10 trial016 ceph-mon[39048]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T08:23:11.000 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T08:23:11.012 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T08:23:11.012 DEBUG:teuthology.orchestra.run.trial016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:23:11.013 DEBUG:teuthology.orchestra.run.trial134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T08:23:11.026 INFO:teuthology.orchestra.run.trial016.stderr:bash: line 1: ntpq: command not found 2026-02-17T08:23:11.029 INFO:teuthology.orchestra.run.trial134.stderr:bash: line 1: ntpq: command not found 2026-02-17T08:23:11.093 INFO:teuthology.orchestra.run.trial134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T08:23:11.093 INFO:teuthology.orchestra.run.trial134.stdout:=============================================================================== 2026-02-17T08:23:11.093 INFO:teuthology.orchestra.run.trial134.stdout:^* time.cloudflare.com 3 6 77 22 -742us[-1692us] +/- 8145us 2026-02-17T08:23:11.093 INFO:teuthology.orchestra.run.trial134.stdout:^- 172-234-37-140.ip.linode> 2 6 77 24 +12ms[ +11ms] +/- 89ms 2026-02-17T08:23:11.093 INFO:teuthology.orchestra.run.trial134.stdout:^- 172-233-177-198.ip.linod> 2 6 77 23 -3450us[-4399us] +/- 84ms 2026-02-17T08:23:11.093 INFO:teuthology.orchestra.run.trial134.stdout:^- 23-95-18-208-host.colocr> 2 6 77 22 -9573us[ -11ms] +/- 44ms 2026-02-17T08:23:11.094 INFO:teuthology.orchestra.run.trial016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T08:23:11.095 INFO:teuthology.orchestra.run.trial016.stdout:=============================================================================== 2026-02-17T08:23:11.095 INFO:teuthology.orchestra.run.trial016.stdout:^* time.cloudflare.com 3 6 77 22 -61us[ +876us] +/- 6600us 2026-02-17T08:23:11.095 INFO:teuthology.orchestra.run.trial016.stdout:^- 172-234-37-140.ip.linode> 2 6 77 23 +12ms[ +13ms] +/- 90ms 2026-02-17T08:23:11.095 INFO:teuthology.orchestra.run.trial016.stdout:^- 172-233-177-198.ip.linod> 2 6 77 23 -3975us[-3038us] +/- 84ms 2026-02-17T08:23:11.095 INFO:teuthology.orchestra.run.trial016.stdout:^- 23-95-18-208-host.colocr> 2 6 77 22 -9801us[-8865us] +/- 44ms 2026-02-17T08:23:11.095 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T08:23:11.106 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T08:23:11.106 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T08:23:11.120 DEBUG:teuthology.orchestra.run.trial016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T08:23:11.190 DEBUG:teuthology.orchestra.run.trial134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T08:23:11.244 DEBUG:teuthology.orchestra.run.trial016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T08:23:11.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:23:11.271 DEBUG:teuthology.orchestra.run.trial134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T08:23:11.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:23:11.298 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T08:23:11.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T08:23:11.332 INFO:teuthology.task.internal:Duration was 323.058657 seconds 2026-02-17T08:23:11.332 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T08:23:11.348 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T08:23:11.348 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T08:23:11.351 DEBUG:teuthology.orchestra.run.trial134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T08:23:11.386 INFO:teuthology.orchestra.run.trial016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T08:23:11.387 INFO:teuthology.orchestra.run.trial134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T08:23:11.658 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T08:23:11.659 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial016.front.sepia.ceph.com 2026-02-17T08:23:11.659 DEBUG:teuthology.orchestra.run.trial016:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T08:23:11.717 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial134.front.sepia.ceph.com 2026-02-17T08:23:11.717 DEBUG:teuthology.orchestra.run.trial134:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T08:23:11.738 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T08:23:11.738 DEBUG:teuthology.orchestra.run.trial016:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:23:11.760 DEBUG:teuthology.orchestra.run.trial134:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:23:11.884 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T08:23:11.885 DEBUG:teuthology.orchestra.run.trial016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T08:23:11.887 DEBUG:teuthology.orchestra.run.trial134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T08:23:11.908 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:23:11.910 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:23:11.910 INFO:teuthology.orchestra.run.trial016.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:23:11.910 INFO:teuthology.orchestra.run.trial016.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T08:23:11.910 INFO:teuthology.orchestra.run.trial016.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T08:23:11.911 INFO:teuthology.orchestra.run.trial134.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T08:23:11.913 INFO:teuthology.orchestra.run.trial134.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T08:23:11.913 INFO:teuthology.orchestra.run.trial134.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T08:23:11.913 INFO:teuthology.orchestra.run.trial134.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T08:23:11.913 INFO:teuthology.orchestra.run.trial134.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T08:23:11.922 INFO:teuthology.orchestra.run.trial134.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T08:23:11.931 INFO:teuthology.orchestra.run.trial016.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T08:23:11.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T08:23:11.950 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T08:23:11.950 DEBUG:teuthology.orchestra.run.trial016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T08:23:11.997 DEBUG:teuthology.orchestra.run.trial134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T08:23:12.022 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T08:23:12.039 DEBUG:teuthology.orchestra.run.trial016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:23:12.041 DEBUG:teuthology.orchestra.run.trial134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:23:12.063 INFO:teuthology.orchestra.run.trial016.stdout:kernel.core_pattern = core 2026-02-17T08:23:12.086 INFO:teuthology.orchestra.run.trial134.stdout:kernel.core_pattern = core 2026-02-17T08:23:12.098 DEBUG:teuthology.orchestra.run.trial016:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:23:12.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:23:12.133 DEBUG:teuthology.orchestra.run.trial134:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T08:23:12.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:23:12.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T08:23:12.171 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T08:23:12.172 DEBUG:teuthology.misc:Transferring archived files from trial016:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51117/remote/trial016 2026-02-17T08:23:12.172 DEBUG:teuthology.orchestra.run.trial016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T08:23:12.213 DEBUG:teuthology.misc:Transferring archived files from trial134:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51117/remote/trial134 2026-02-17T08:23:12.213 DEBUG:teuthology.orchestra.run.trial134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T08:23:12.247 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T08:23:12.248 DEBUG:teuthology.orchestra.run.trial016:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T08:23:12.250 DEBUG:teuthology.orchestra.run.trial134:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T08:23:12.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T08:23:12.319 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T08:23:12.320 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T08:23:12.336 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T08:23:12.336 DEBUG:teuthology.orchestra.run.trial016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T08:23:12.339 DEBUG:teuthology.orchestra.run.trial134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T08:23:12.354 INFO:teuthology.orchestra.run.trial016.stdout: 791885 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 08:23 /home/ubuntu/cephtest 2026-02-17T08:23:12.354 INFO:teuthology.orchestra.run.trial016.stdout: 786984 4 -rw-r--r-- 1 ubuntu ubuntu 201 Feb 17 08:23 /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:23:12.354 INFO:teuthology.orchestra.run.trial016.stdout: 786981 4 -rw-r--r-- 1 root root 123 Feb 17 08:22 /home/ubuntu/cephtest/ceph.pub 2026-02-17T08:23:12.354 INFO:teuthology.orchestra.run.trial016.stdout: 786975 4 -rw-r--r-- 1 ubuntu ubuntu 3070 Feb 17 08:21 /home/ubuntu/cephtest/seed.ceph.conf 2026-02-17T08:23:12.354 INFO:teuthology.orchestra.run.trial016.stdout: 1048676 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 08:23 /home/ubuntu/cephtest/ceph.data 2026-02-17T08:23:12.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T08:23:12.356 INFO:teuthology.orchestra.run.trial016.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-17T08:23:12.356 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial016 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T08:23:12.362 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T08:23:12.379 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T08:23:12.397 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-17T08:23:12.401 INFO:teuthology.run:Summary data: description: rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/e2e} duration: 323.05865716934204 failure_reason: 'Command failed on trial016 with status 1: ''yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2''' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T08:23:12.401 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T08:23:12.405 INFO:teuthology.orchestra.run.trial134.stdout: 791885 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 08:23 /home/ubuntu/cephtest 2026-02-17T08:23:12.405 INFO:teuthology.orchestra.run.trial134.stdout: 786908 4 -rw-r--r-- 1 ubuntu ubuntu 201 Feb 17 08:23 /home/ubuntu/cephtest/ceph.monmap 2026-02-17T08:23:12.405 INFO:teuthology.orchestra.run.trial134.stdout: 1059692 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 08:23 /home/ubuntu/cephtest/ceph.data 2026-02-17T08:23:12.406 INFO:teuthology.orchestra.run.trial134.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-17T08:23:12.513 INFO:teuthology.run:FAIL