2026-02-17T11:58:39.806 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T11:58:39.820 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:58:39.898 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51396 branch: wip-bharath20-testing-2026-02-13-0906-squid description: rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51396' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath20-testing-2026-02-13-0906-squid ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 global: mon election default strategy: 3 mds: debug mgrc: 20 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug mgrc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_DEGRADED\) sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath20-testing-2026-02-13-0906-squid sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - mon.a - mgr.a - client.0 - - host.b - client.1 seed: 4581 sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath20-testing-2026-02-13-0906-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 targets: trial090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBByHcE3LUb494KNjyks1YX1XVOc1RrvJqFm/dBJ9A5NqbeoHRISJx7QDOoM4p70HMv80t3/qcAiZTLikNzjb1S4= trial198.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIVIr68a9YcwVEJSDZg+al4xvB5uszLuwhswzWvuhPMbm/l2bGpj1WcnxXSKrln4o8dc6SR42/Hl/554ml+5sIM= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: null - cephadm: null - ceph: log-ignorelist: - \(OSD_DOWN\) - workunit: clients: client.1: - cephadm/create_iscsi_disks.sh - workunit: clients: client.0: - cephadm/test_dashboard_e2e.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:10:36 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T11:58:39.898 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa; will attempt to use it 2026-02-17T11:58:39.899 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks 2026-02-17T11:58:39.899 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T11:58:39.900 INFO:teuthology.task.internal:Checking packages... 2026-02-17T11:58:39.900 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3c96dfb3f50b3d02598a82af7104764bfdcd3919' 2026-02-17T11:58:39.900 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T11:58:39.900 INFO:teuthology.packaging:ref: None 2026-02-17T11:58:39.900 INFO:teuthology.packaging:tag: None 2026-02-17T11:58:39.900 INFO:teuthology.packaging:branch: wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:58:39.900 INFO:teuthology.packaging:sha1: 3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T11:58:39.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath20-testing-2026-02-13-0906-squid 2026-02-17T11:58:40.028 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-675.g3c96dfb3 2026-02-17T11:58:40.030 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T11:58:40.040 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T11:58:40.041 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T11:58:40.053 INFO:teuthology.task.internal:Saving configuration 2026-02-17T11:58:40.062 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T11:58:40.073 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T11:58:40.147 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial090.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51396', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:55:13.010414', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBByHcE3LUb494KNjyks1YX1XVOc1RrvJqFm/dBJ9A5NqbeoHRISJx7QDOoM4p70HMv80t3/qcAiZTLikNzjb1S4='} 2026-02-17T11:58:40.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial198.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51396', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:55:13.011038', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIVIr68a9YcwVEJSDZg+al4xvB5uszLuwhswzWvuhPMbm/l2bGpj1WcnxXSKrln4o8dc6SR42/Hl/554ml+5sIM='} 2026-02-17T11:58:40.202 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T11:58:40.213 INFO:teuthology.task.internal:roles: ubuntu@trial090.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'] 2026-02-17T11:58:40.213 INFO:teuthology.task.internal:roles: ubuntu@trial198.front.sepia.ceph.com - ['host.b', 'client.1'] 2026-02-17T11:58:40.214 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T11:58:40.345 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7cef664ceca0>, signals=[15]) 2026-02-17T11:58:40.345 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T11:58:40.356 INFO:teuthology.task.internal:Opening connections... 2026-02-17T11:58:40.356 DEBUG:teuthology.task.internal:connecting to ubuntu@trial090.front.sepia.ceph.com 2026-02-17T11:58:40.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:58:40.417 DEBUG:teuthology.task.internal:connecting to ubuntu@trial198.front.sepia.ceph.com 2026-02-17T11:58:40.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:58:40.477 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T11:58:40.488 DEBUG:teuthology.orchestra.run.trial090:> uname -m 2026-02-17T11:58:40.503 INFO:teuthology.orchestra.run.trial090.stdout:x86_64 2026-02-17T11:58:40.503 DEBUG:teuthology.orchestra.run.trial090:> cat /etc/os-release 2026-02-17T11:58:40.558 INFO:teuthology.orchestra.run.trial090.stdout:NAME="CentOS Stream" 2026-02-17T11:58:40.558 INFO:teuthology.orchestra.run.trial090.stdout:VERSION="9" 2026-02-17T11:58:40.558 INFO:teuthology.orchestra.run.trial090.stdout:ID="centos" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:VERSION_ID="9" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:ANSI_COLOR="0;31" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:58:40.559 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:58:40.560 INFO:teuthology.lock.ops:Updating trial090.front.sepia.ceph.com on lock server 2026-02-17T11:58:40.631 DEBUG:teuthology.orchestra.run.trial198:> uname -m 2026-02-17T11:58:40.646 INFO:teuthology.orchestra.run.trial198.stdout:x86_64 2026-02-17T11:58:40.646 DEBUG:teuthology.orchestra.run.trial198:> cat /etc/os-release 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:NAME="CentOS Stream" 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:VERSION="9" 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:ID="centos" 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:ID_LIKE="rhel fedora" 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:VERSION_ID="9" 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:PLATFORM_ID="platform:el9" 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:ANSI_COLOR="0;31" 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:LOGO="fedora-logo-icon" 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T11:58:40.702 INFO:teuthology.orchestra.run.trial198.stdout:HOME_URL="https://centos.org/" 2026-02-17T11:58:40.703 INFO:teuthology.orchestra.run.trial198.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T11:58:40.703 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T11:58:40.703 INFO:teuthology.orchestra.run.trial198.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T11:58:40.703 INFO:teuthology.lock.ops:Updating trial198.front.sepia.ceph.com on lock server 2026-02-17T11:58:40.783 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T11:58:40.794 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T11:58:40.806 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T11:58:40.806 DEBUG:teuthology.orchestra.run.trial090:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:58:40.807 DEBUG:teuthology.orchestra.run.trial198:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:58:40.823 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T11:58:40.834 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T11:58:40.834 DEBUG:teuthology.orchestra.run.trial090:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:58:40.863 DEBUG:teuthology.orchestra.run.trial198:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:58:40.880 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T11:58:41.015 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T11:58:41.033 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T11:58:41.033 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T11:58:41.033 DEBUG:teuthology.orchestra.run.trial090:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:58:41.034 DEBUG:teuthology.orchestra.run.trial198:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:58:41.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:58:41.047 DEBUG:teuthology.orchestra.run.trial090:> uname -r 2026-02-17T11:58:41.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:58:41.048 DEBUG:teuthology.orchestra.run.trial198:> uname -r 2026-02-17T11:58:41.102 INFO:teuthology.orchestra.run.trial090.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:58:41.103 INFO:teuthology.task.kernel:Running kernel on trial090: 5.14.0-645.el9.x86_64 2026-02-17T11:58:41.103 DEBUG:teuthology.orchestra.run.trial090:> sudo yum install -y kernel 2026-02-17T11:58:41.104 INFO:teuthology.orchestra.run.trial198.stdout:5.14.0-645.el9.x86_64 2026-02-17T11:58:41.104 INFO:teuthology.task.kernel:Running kernel on trial198: 5.14.0-645.el9.x86_64 2026-02-17T11:58:41.104 DEBUG:teuthology.orchestra.run.trial198:> sudo yum install -y kernel 2026-02-17T11:58:42.007 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.9 MB 00:00 2026-02-17T11:58:42.813 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.9 MB 00:01 2026-02-17T11:58:42.942 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - AppStream 65 MB/s | 27 MB 00:00 2026-02-17T11:58:45.833 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T11:58:46.213 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 7.8 MB 00:00 2026-02-17T11:58:47.333 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 20 kB 00:00 2026-02-17T11:58:47.689 INFO:teuthology.orchestra.run.trial090.stdout:Extra Packages for Enterprise Linux 69 MB/s | 20 MB 00:00 2026-02-17T11:58:49.249 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 7.8 MB 00:01 2026-02-17T11:58:50.858 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-17T11:58:50.890 INFO:teuthology.orchestra.run.trial090.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-17T11:58:51.551 INFO:teuthology.orchestra.run.trial198.stdout:Extra Packages for Enterprise Linux 32 MB/s | 20 MB 00:00 2026-02-17T11:58:51.902 INFO:teuthology.orchestra.run.trial090.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:58:51.922 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T11:58:51.923 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T11:58:51.924 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-17T11:58:51.924 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T11:58:51.924 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T11:58:51.924 INFO:teuthology.orchestra.run.trial090.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:58:51.924 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-17T11:58:51.924 INFO:teuthology.orchestra.run.trial090.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:58:51.924 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:58:51.924 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:58:51.924 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T11:58:51.925 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T11:58:51.925 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T11:58:51.925 INFO:teuthology.orchestra.run.trial090.stdout:Install 4 Packages 2026-02-17T11:58:51.925 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T11:58:51.925 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 88 M 2026-02-17T11:58:51.925 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 135 M 2026-02-17T11:58:51.925 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T11:58:52.611 INFO:teuthology.orchestra.run.trial090.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-17T11:58:53.189 INFO:teuthology.orchestra.run.trial090.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-17T11:58:53.665 INFO:teuthology.orchestra.run.trial090.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-17T11:58:53.832 INFO:teuthology.orchestra.run.trial090.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-17T11:58:53.833 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:58:53.833 INFO:teuthology.orchestra.run.trial090.stdout:Total 46 MB/s | 88 MB 00:01 2026-02-17T11:58:54.022 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T11:58:54.226 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T11:58:54.226 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T11:58:54.573 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T11:58:54.722 INFO:teuthology.orchestra.run.trial198.stdout:lab-extras 2.3 MB/s | 50 kB 00:00 2026-02-17T11:58:55.657 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T11:58:55.738 INFO:teuthology.orchestra.run.trial198.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T11:58:55.758 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T11:58:55.759 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T11:58:55.759 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T11:58:55.760 INFO:teuthology.orchestra.run.trial198.stdout:Install 4 Packages 2026-02-17T11:58:55.761 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T11:58:55.761 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 88 M 2026-02-17T11:58:55.761 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 135 M 2026-02-17T11:58:55.761 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T11:58:55.939 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:58:55.958 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:58:56.045 INFO:teuthology.orchestra.run.trial198.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 4.0 MB/s | 803 kB 00:00 2026-02-17T11:58:56.250 INFO:teuthology.orchestra.run.trial198.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 43 MB/s | 17 MB 00:00 2026-02-17T11:58:56.382 INFO:teuthology.orchestra.run.trial198.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 92 MB/s | 31 MB 00:00 2026-02-17T11:58:56.437 INFO:teuthology.orchestra.run.trial198.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 67 MB/s | 40 MB 00:00 2026-02-17T11:58:56.437 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T11:58:56.437 INFO:teuthology.orchestra.run.trial198.stdout:Total 130 MB/s | 88 MB 00:00 2026-02-17T11:58:56.628 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T11:58:56.829 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T11:58:56.829 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T11:58:57.175 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T11:58:57.175 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T11:58:57.731 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:58:57.759 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:58:58.260 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T11:58:58.542 INFO:teuthology.orchestra.run.trial198.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:58:58.561 INFO:teuthology.orchestra.run.trial198.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:59:00.348 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:59:00.377 INFO:teuthology.orchestra.run.trial198.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:59:00.781 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:59:00.788 INFO:teuthology.orchestra.run.trial090.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:03.462 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:59:03.468 INFO:teuthology.orchestra.run.trial198.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:03.828 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:06.695 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:34.035 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:34.057 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:34.125 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:34.125 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:59:34.125 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:59:34.125 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:59:34.179 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:34.179 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T11:59:34.179 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T11:59:34.179 INFO:teuthology.orchestra.run.trial090.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:59:34.179 INFO:teuthology.orchestra.run.trial090.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:59:34.179 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:59:34.179 INFO:teuthology.orchestra.run.trial090.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:59:34.179 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T11:59:34.179 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T11:59:34.239 DEBUG:teuthology.orchestra.run.trial090:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:59:34.264 INFO:teuthology.orchestra.run.trial090.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:59:34.264 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:59:34.265 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:59:34.265 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:59:34.265 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:59:34.265 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-17T11:59:34.265 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial090.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:59:34.265 DEBUG:teuthology.orchestra.run.trial090:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:59:34.328 INFO:teuthology.orchestra.run.trial090.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:59:34.329 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:59:34.329 DEBUG:teuthology.orchestra.run.trial090:> sudo rpm -qi grub2-tools 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial090.stdout:Name : grub2-tools 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial090.stdout:Epoch : 1 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial090.stdout:Version : 2.06 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial090.stdout:Release : 118.el9 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial090.stdout:Architecture: x86_64 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial090.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:59:34.399 INFO:teuthology.orchestra.run.trial090.stdout:Group : Unspecified 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:Size : 8393909 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:License : GPLv3+ 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:Packager : builder@centos.org 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:Vendor : CentOS 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:Summary : Support tools for GRUB. 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout:Description : 2026-02-17T11:59:34.400 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial090.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial090.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial090.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial090.stdout:hardware devices. 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T11:59:34.401 INFO:teuthology.orchestra.run.trial090.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:59:34.402 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:59:34.402 INFO:teuthology.task.kernel:Updating grub on trial090 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:59:34.402 DEBUG:teuthology.orchestra.run.trial090:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:59:34.467 INFO:teuthology.orchestra.run.trial090.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:59:34.469 DEBUG:teuthology.orchestra.run.trial090:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:59:34.532 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/grubby 2026-02-17T11:59:34.533 INFO:teuthology.orchestra.run.trial090.stdout:yes 2026-02-17T11:59:34.534 DEBUG:teuthology.orchestra.run.trial090:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:59:34.597 INFO:teuthology.orchestra.run.trial090.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:59:34.598 DEBUG:teuthology.orchestra.run.trial090:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:59:34.673 DEBUG:teuthology.orchestra.run.trial090:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:59:34.879 INFO:teuthology.orchestra.run.trial090.stderr:Generating grub configuration file ... 2026-02-17T11:59:34.943 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:59:34.949 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:59:35.197 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:59:35.204 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:59:35.235 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:59:35.242 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:59:35.265 INFO:teuthology.orchestra.run.trial090.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:59:35.271 INFO:teuthology.orchestra.run.trial090.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:59:35.351 INFO:teuthology.orchestra.run.trial090.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:59:35.359 INFO:teuthology.orchestra.run.trial090.stderr:done 2026-02-17T11:59:35.362 DEBUG:teuthology.orchestra.run.trial090:> test -d /sys/firmware/efi 2026-02-17T11:59:35.377 DEBUG:teuthology.orchestra.run.trial090:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:59:35.442 INFO:teuthology.orchestra.run.trial090.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:59:35.442 INFO:teuthology.orchestra.run.trial090.stdout:/boot/efi/EFI/centos 2026-02-17T11:59:35.444 DEBUG:teuthology.orchestra.run.trial090:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:59:35.509 INFO:teuthology.orchestra.run.trial090.stdout:no 2026-02-17T11:59:35.509 DEBUG:teuthology.orchestra.run.trial090:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:59:35.573 INFO:teuthology.orchestra.run.trial090.stdout:yes 2026-02-17T11:59:35.574 DEBUG:teuthology.orchestra.run.trial090:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:59:35.639 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial090 2026-02-17T11:59:35.640 DEBUG:teuthology.orchestra.run.trial090:> sudo bash -c ' 2026-02-17T11:59:35.640 DEBUG:teuthology.orchestra.run.trial090:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:59:35.640 DEBUG:teuthology.orchestra.run.trial090:> ' 2026-02-17T11:59:37.239 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:37.261 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:37.327 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:37.327 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T11:59:37.327 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T11:59:37.327 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T11:59:37.379 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T11:59:37.380 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T11:59:37.380 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T11:59:37.380 INFO:teuthology.orchestra.run.trial198.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T11:59:37.380 INFO:teuthology.orchestra.run.trial198.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T11:59:37.380 INFO:teuthology.orchestra.run.trial198.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T11:59:37.380 INFO:teuthology.orchestra.run.trial198.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T11:59:37.380 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T11:59:37.380 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T11:59:37.438 DEBUG:teuthology.orchestra.run.trial198:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:59:37.464 INFO:teuthology.orchestra.run.trial198.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:59:37.465 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:59:37.465 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T11:59:37.465 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:59:37.465 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:59:37.465 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-17T11:59:37.466 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial198.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:59:37.466 DEBUG:teuthology.orchestra.run.trial198:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T11:59:37.530 INFO:teuthology.orchestra.run.trial198.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T11:59:37.531 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T11:59:37.531 DEBUG:teuthology.orchestra.run.trial198:> sudo rpm -qi grub2-tools 2026-02-17T11:59:37.600 INFO:teuthology.orchestra.run.trial198.stdout:Name : grub2-tools 2026-02-17T11:59:37.600 INFO:teuthology.orchestra.run.trial198.stdout:Epoch : 1 2026-02-17T11:59:37.600 INFO:teuthology.orchestra.run.trial198.stdout:Version : 2.06 2026-02-17T11:59:37.600 INFO:teuthology.orchestra.run.trial198.stdout:Release : 118.el9 2026-02-17T11:59:37.600 INFO:teuthology.orchestra.run.trial198.stdout:Architecture: x86_64 2026-02-17T11:59:37.600 INFO:teuthology.orchestra.run.trial198.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:Group : Unspecified 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:Size : 8393909 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:License : GPLv3+ 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:Packager : builder@centos.org 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:Vendor : CentOS 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:Summary : Support tools for GRUB. 2026-02-17T11:59:37.601 INFO:teuthology.orchestra.run.trial198.stdout:Description : 2026-02-17T11:59:37.602 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T11:59:37.602 INFO:teuthology.orchestra.run.trial198.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T11:59:37.602 INFO:teuthology.orchestra.run.trial198.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T11:59:37.602 INFO:teuthology.orchestra.run.trial198.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T11:59:37.602 INFO:teuthology.orchestra.run.trial198.stdout:hardware devices. 2026-02-17T11:59:37.602 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T11:59:37.602 INFO:teuthology.orchestra.run.trial198.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T11:59:37.603 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T11:59:37.603 INFO:teuthology.task.kernel:Updating grub on trial198 to boot 5.14.0-681.el9.x86_64 2026-02-17T11:59:37.604 DEBUG:teuthology.orchestra.run.trial198:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T11:59:37.669 INFO:teuthology.orchestra.run.trial198.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:59:37.670 DEBUG:teuthology.orchestra.run.trial198:> sudo command -v grubby && echo yes || echo no 2026-02-17T11:59:37.734 INFO:teuthology.orchestra.run.trial198.stdout:/sbin/grubby 2026-02-17T11:59:37.736 INFO:teuthology.orchestra.run.trial198.stdout:yes 2026-02-17T11:59:37.736 DEBUG:teuthology.orchestra.run.trial198:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T11:59:37.800 INFO:teuthology.orchestra.run.trial198.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T11:59:37.801 DEBUG:teuthology.orchestra.run.trial198:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T11:59:37.875 DEBUG:teuthology.orchestra.run.trial198:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T11:59:38.084 INFO:teuthology.orchestra.run.trial198.stderr:Generating grub configuration file ... 2026-02-17T11:59:38.148 INFO:teuthology.orchestra.run.trial198.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T11:59:38.154 INFO:teuthology.orchestra.run.trial198.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T11:59:38.407 INFO:teuthology.orchestra.run.trial198.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T11:59:38.413 INFO:teuthology.orchestra.run.trial198.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T11:59:38.445 INFO:teuthology.orchestra.run.trial198.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T11:59:38.451 INFO:teuthology.orchestra.run.trial198.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T11:59:38.475 INFO:teuthology.orchestra.run.trial198.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T11:59:38.481 INFO:teuthology.orchestra.run.trial198.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T11:59:38.565 INFO:teuthology.orchestra.run.trial198.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:59:38.573 INFO:teuthology.orchestra.run.trial198.stderr:done 2026-02-17T11:59:38.575 DEBUG:teuthology.orchestra.run.trial198:> test -d /sys/firmware/efi 2026-02-17T11:59:38.590 DEBUG:teuthology.orchestra.run.trial198:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T11:59:38.656 INFO:teuthology.orchestra.run.trial198.stdout:/boot/efi/EFI/BOOT 2026-02-17T11:59:38.656 INFO:teuthology.orchestra.run.trial198.stdout:/boot/efi/EFI/centos 2026-02-17T11:59:38.658 DEBUG:teuthology.orchestra.run.trial198:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T11:59:38.722 INFO:teuthology.orchestra.run.trial198.stdout:no 2026-02-17T11:59:38.723 DEBUG:teuthology.orchestra.run.trial198:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T11:59:38.788 INFO:teuthology.orchestra.run.trial198.stdout:yes 2026-02-17T11:59:38.788 DEBUG:teuthology.orchestra.run.trial198:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T11:59:38.851 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial198 2026-02-17T11:59:38.851 DEBUG:teuthology.orchestra.run.trial198:> sudo bash -c ' 2026-02-17T11:59:38.852 DEBUG:teuthology.orchestra.run.trial198:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:59:38.852 DEBUG:teuthology.orchestra.run.trial198:> ' 2026-02-17T12:00:05.682 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-17T12:00:05.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-17T12:00:05.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:00:08.895 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-17T12:00:08.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-17T12:00:08.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:01:05.742 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T12:01:08.901 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T12:01:14.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-17T12:01:14.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:01:14.874 DEBUG:teuthology.orchestra.run.trial090:> true 2026-02-17T12:01:15.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-17T12:01:15.047 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T12:01:15.048 DEBUG:teuthology.orchestra.run.trial090:> uname -r 2026-02-17T12:01:15.106 INFO:teuthology.orchestra.run.trial090.stdout:5.14.0-681.el9.x86_64 2026-02-17T12:01:15.107 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T12:01:15.107 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T12:01:15.107 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T12:01:16.108 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-17T12:01:16.108 DEBUG:teuthology.orchestra.run.trial090:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T12:01:16.137 INFO:teuthology.orchestra.run.trial090.stdout:ttyS1 2026-02-17T12:01:16.163 DEBUG:teuthology.parallel:result is None 2026-02-17T12:01:17.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-17T12:01:17.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:01:18.037 DEBUG:teuthology.orchestra.run.trial198:> true 2026-02-17T12:01:18.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-17T12:01:18.203 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-681.el9.x86_64"... 2026-02-17T12:01:18.203 DEBUG:teuthology.orchestra.run.trial198:> uname -r 2026-02-17T12:01:18.260 INFO:teuthology.orchestra.run.trial198.stdout:5.14.0-681.el9.x86_64 2026-02-17T12:01:18.260 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T12:01:18.260 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T12:01:18.260 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T12:01:19.261 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-17T12:01:19.261 DEBUG:teuthology.orchestra.run.trial198:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T12:01:19.292 INFO:teuthology.orchestra.run.trial198.stdout:ttyS1 2026-02-17T12:01:19.326 DEBUG:teuthology.parallel:result is None 2026-02-17T12:01:19.326 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T12:01:19.359 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T12:01:19.359 DEBUG:teuthology.orchestra.run.trial090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T12:01:19.362 DEBUG:teuthology.orchestra.run.trial198:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T12:01:19.383 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T12:01:19.395 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T12:01:19.407 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T12:01:19.408 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T12:01:19.419 DEBUG:teuthology.orchestra.run.trial198:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T12:01:19.446 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T12:01:19.456 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T12:01:19.456 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T12:01:19.476 DEBUG:teuthology.orchestra.run.trial198:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T12:01:19.499 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:01:19.505 INFO:teuthology.orchestra.run.trial198.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:01:19.507 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:01:19.514 INFO:teuthology.orchestra.run.trial198.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T12:01:19.515 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T12:01:19.528 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T12:01:19.528 DEBUG:teuthology.orchestra.run.trial090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T12:01:19.551 DEBUG:teuthology.orchestra.run.trial198:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T12:01:19.580 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T12:01:19.595 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T12:01:19.595 DEBUG:teuthology.orchestra.run.trial090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T12:01:19.616 DEBUG:teuthology.orchestra.run.trial198:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T12:01:19.637 DEBUG:teuthology.orchestra.run.trial090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:01:19.789 DEBUG:teuthology.orchestra.run.trial090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:01:19.815 DEBUG:teuthology.orchestra.run.trial090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:01:20.022 DEBUG:teuthology.orchestra.run.trial090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:01:20.047 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:01:20.047 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T12:01:20.111 DEBUG:teuthology.orchestra.run.trial198:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:01:20.190 DEBUG:teuthology.orchestra.run.trial198:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:01:20.215 DEBUG:teuthology.orchestra.run.trial198:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:01:20.350 DEBUG:teuthology.orchestra.run.trial198:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:01:20.374 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:01:20.374 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T12:01:20.440 DEBUG:teuthology.orchestra.run.trial090:> sudo service rsyslog restart 2026-02-17T12:01:20.443 DEBUG:teuthology.orchestra.run.trial198:> sudo service rsyslog restart 2026-02-17T12:01:20.469 INFO:teuthology.orchestra.run.trial090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:01:20.509 INFO:teuthology.orchestra.run.trial198.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:01:20.996 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T12:01:21.009 INFO:teuthology.task.internal:Starting timer... 2026-02-17T12:01:21.009 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T12:01:21.024 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T12:01:21.037 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-17T12:01:21.037 DEBUG:teuthology.orchestra.run.trial090:> sudo service auditd rotate 2026-02-17T12:01:21.065 INFO:teuthology.orchestra.run.trial090.stdout:Rotating logs: 2026-02-17T12:01:21.067 DEBUG:teuthology.orchestra.run.trial198:> sudo service auditd rotate 2026-02-17T12:01:21.097 INFO:teuthology.orchestra.run.trial198.stdout:Rotating logs: 2026-02-17T12:01:21.098 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T12:01:21.099 DEBUG:teuthology.orchestra.run.trial090:> /usr/sbin/getenforce 2026-02-17T12:01:21.123 INFO:teuthology.orchestra.run.trial090.stdout:Permissive 2026-02-17T12:01:21.123 DEBUG:teuthology.orchestra.run.trial198:> /usr/sbin/getenforce 2026-02-17T12:01:21.155 INFO:teuthology.orchestra.run.trial198.stdout:Permissive 2026-02-17T12:01:21.156 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial090.front.sepia.ceph.com': 'permissive', 'ubuntu@trial198.front.sepia.ceph.com': 'permissive'} 2026-02-17T12:01:21.156 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:01:21.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:01:21.188 DEBUG:teuthology.orchestra.run.trial198:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:01:21.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:01:21.221 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T12:01:21.221 DEBUG:teuthology.orchestra.run.trial090:> sudo /usr/sbin/setenforce permissive 2026-02-17T12:01:21.251 DEBUG:teuthology.orchestra.run.trial198:> sudo /usr/sbin/setenforce permissive 2026-02-17T12:01:21.285 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T12:01:21.302 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T12:01:21.314 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T12:01:21.315 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial090.front.sepia.ceph.com,trial198.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T12:04:04.822 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial090.front.sepia.ceph.com'), Remote(name='ubuntu@trial198.front.sepia.ceph.com')] 2026-02-17T12:04:04.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-17T12:04:04.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:04:04.968 DEBUG:teuthology.orchestra.run.trial090:> true 2026-02-17T12:04:05.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-17T12:04:05.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-17T12:04:05.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T12:04:05.140 DEBUG:teuthology.orchestra.run.trial198:> true 2026-02-17T12:04:05.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial198.front.sepia.ceph.com' 2026-02-17T12:04:05.215 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T12:04:05.228 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T12:04:05.228 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T12:04:05.229 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:04:05.231 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T12:04:05.231 DEBUG:teuthology.orchestra.run.trial198:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:04:05.258 INFO:teuthology.orchestra.run.trial090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T12:04:05.270 INFO:teuthology.orchestra.run.trial090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T12:04:05.283 INFO:teuthology.orchestra.run.trial198.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T12:04:05.291 INFO:teuthology.orchestra.run.trial090.stderr:sudo: ntpd: command not found 2026-02-17T12:04:05.295 INFO:teuthology.orchestra.run.trial198.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T12:04:05.301 INFO:teuthology.orchestra.run.trial090.stdout:506 Cannot talk to daemon 2026-02-17T12:04:05.313 INFO:teuthology.orchestra.run.trial090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T12:04:05.315 INFO:teuthology.orchestra.run.trial198.stderr:sudo: ntpd: command not found 2026-02-17T12:04:05.324 INFO:teuthology.orchestra.run.trial198.stdout:506 Cannot talk to daemon 2026-02-17T12:04:05.326 INFO:teuthology.orchestra.run.trial090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T12:04:05.335 INFO:teuthology.orchestra.run.trial198.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T12:04:05.347 INFO:teuthology.orchestra.run.trial198.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T12:04:05.374 INFO:teuthology.orchestra.run.trial090.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:04:05.395 INFO:teuthology.orchestra.run.trial198.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:04:05.416 INFO:teuthology.orchestra.run.trial198.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:04:05.416 INFO:teuthology.orchestra.run.trial198.stdout:=============================================================================== 2026-02-17T12:04:05.416 INFO:teuthology.orchestra.run.trial198.stdout:^? 172-104-28-175.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:04:05.416 INFO:teuthology.orchestra.run.trial198.stdout:^? 66.59.198.178 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:04:05.416 INFO:teuthology.orchestra.run.trial198.stdout:^? 172-234-37-140.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:04:05.417 INFO:teuthology.orchestra.run.trial198.stdout:^? time.ecansol.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:04:05.420 INFO:teuthology.orchestra.run.trial090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:04:05.421 INFO:teuthology.orchestra.run.trial090.stdout:=============================================================================== 2026-02-17T12:04:05.421 INFO:teuthology.orchestra.run.trial090.stdout:^? 172-234-25-10.ip.linodeu> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:04:05.421 INFO:teuthology.orchestra.run.trial090.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:04:05.421 INFO:teuthology.orchestra.run.trial090.stdout:^? 38.134.40.65 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:04:05.421 INFO:teuthology.orchestra.run.trial090.stdout:^? hydra.frangipani.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T12:04:05.422 INFO:teuthology.run_tasks:Running task pexec... 2026-02-17T12:04:05.441 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-17T12:04:05.441 DEBUG:teuthology.orchestra.run.trial090:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T12:04:05.442 DEBUG:teuthology.orchestra.run.trial198:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T12:04:05.461 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial198.front.sepia.ceph.com 2026-02-17T12:04:05.461 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-17T12:04:05.461 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-17T12:04:05.464 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial090.front.sepia.ceph.com 2026-02-17T12:04:05.464 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-17T12:04:05.465 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-17T12:04:05.633 INFO:teuthology.orchestra.run.trial198.stdout:No match for argument: nvme-cli 2026-02-17T12:04:05.634 INFO:teuthology.orchestra.run.trial198.stderr:No packages marked for removal. 2026-02-17T12:04:05.636 INFO:teuthology.orchestra.run.trial090.stdout:No match for argument: nvme-cli 2026-02-17T12:04:05.636 INFO:teuthology.orchestra.run.trial090.stderr:No packages marked for removal. 2026-02-17T12:04:05.637 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:05.637 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:05.637 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:05.638 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:04:05.639 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:04:05.639 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:04:05.944 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 12:03:36 PM UTC. 2026-02-17T12:04:05.944 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 12:03:36 PM UTC. 2026-02-17T12:04:06.025 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:06.026 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:06.026 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-17T12:04:06.026 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:06.026 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:04:06.026 INFO:teuthology.orchestra.run.trial198.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-17T12:04:06.026 INFO:teuthology.orchestra.run.trial198.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-17T12:04:06.026 INFO:teuthology.orchestra.run.trial198.stdout:Upgrading: 2026-02-17T12:04:06.026 INFO:teuthology.orchestra.run.trial198.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-17T12:04:06.026 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-17T12:04:06.026 INFO:teuthology.orchestra.run.trial198.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout:Install 6 Packages 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout:Upgrade 1 Package 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 2.4 M 2026-02-17T12:04:06.027 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:04:06.028 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:04:06.028 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout:Upgrading: 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T12:04:06.029 INFO:teuthology.orchestra.run.trial090.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-17T12:04:06.030 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:06.030 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:04:06.030 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:04:06.030 INFO:teuthology.orchestra.run.trial090.stdout:Install 6 Packages 2026-02-17T12:04:06.030 INFO:teuthology.orchestra.run.trial090.stdout:Upgrade 1 Package 2026-02-17T12:04:06.030 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:06.030 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 2.4 M 2026-02-17T12:04:06.030 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:04:06.178 INFO:teuthology.orchestra.run.trial198.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 498 kB/s | 44 kB 00:00 2026-02-17T12:04:06.178 INFO:teuthology.orchestra.run.trial198.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 814 kB/s | 72 kB 00:00 2026-02-17T12:04:06.222 INFO:teuthology.orchestra.run.trial198.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.9 MB/s | 84 kB 00:00 2026-02-17T12:04:06.222 INFO:teuthology.orchestra.run.trial198.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 3.3 MB/s | 150 kB 00:00 2026-02-17T12:04:06.241 INFO:teuthology.orchestra.run.trial198.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 7.6 MB/s | 1.2 MB 00:00 2026-02-17T12:04:06.247 INFO:teuthology.orchestra.run.trial198.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 4.6 MB/s | 116 kB 00:00 2026-02-17T12:04:06.289 INFO:teuthology.orchestra.run.trial198.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 12 MB/s | 837 kB 00:00 2026-02-17T12:04:06.289 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:06.289 INFO:teuthology.orchestra.run.trial198.stdout:Total 9.2 MB/s | 2.4 MB 00:00 2026-02-17T12:04:06.349 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:04:06.357 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:04:06.357 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:04:06.407 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:04:06.407 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:04:06.476 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:04:06.544 INFO:teuthology.orchestra.run.trial198.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-17T12:04:06.550 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-17T12:04:06.559 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-17T12:04:06.565 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-17T12:04:06.570 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-17T12:04:06.571 INFO:teuthology.orchestra.run.trial198.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T12:04:06.699 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T12:04:06.701 INFO:teuthology.orchestra.run.trial198.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T12:04:06.798 INFO:teuthology.orchestra.run.trial090.stdout:(1/7): python3-configshell-1.1.30-1.el9.noarch. 107 kB/s | 72 kB 00:00 2026-02-17T12:04:06.812 INFO:teuthology.orchestra.run.trial090.stdout:(2/7): nvmetcli-0.8-3.el9.noarch.rpm 64 kB/s | 44 kB 00:00 2026-02-17T12:04:06.981 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T12:04:06.982 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T12:04:06.982 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:07.005 INFO:teuthology.orchestra.run.trial198.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T12:04:07.046 INFO:teuthology.orchestra.run.trial090.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 339 kB/s | 84 kB 00:00 2026-02-17T12:04:07.140 INFO:teuthology.orchestra.run.trial090.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 459 kB/s | 150 kB 00:00 2026-02-17T12:04:07.234 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T12:04:07.234 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-17T12:04:07.234 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-17T12:04:07.235 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-17T12:04:07.235 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-17T12:04:07.235 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-17T12:04:07.235 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-17T12:04:07.235 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-17T12:04:07.286 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T12:04:07.286 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:07.287 INFO:teuthology.orchestra.run.trial198.stdout:Upgraded: 2026-02-17T12:04:07.287 INFO:teuthology.orchestra.run.trial198.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-17T12:04:07.287 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:04:07.287 INFO:teuthology.orchestra.run.trial198.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-17T12:04:07.287 INFO:teuthology.orchestra.run.trial198.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-17T12:04:07.287 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-17T12:04:07.287 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:07.287 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:07.316 DEBUG:teuthology.parallel:result is None 2026-02-17T12:04:07.388 INFO:teuthology.orchestra.run.trial090.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 468 kB/s | 116 kB 00:00 2026-02-17T12:04:08.081 INFO:teuthology.orchestra.run.trial090.stdout:(6/7): nvme-cli-2.16-1.el9.x86_64.rpm 604 kB/s | 1.2 MB 00:01 2026-02-17T12:04:08.203 INFO:teuthology.orchestra.run.trial090.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 724 kB/s | 837 kB 00:01 2026-02-17T12:04:08.204 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:08.205 INFO:teuthology.orchestra.run.trial090.stdout:Total 1.1 MB/s | 2.4 MB 00:02 2026-02-17T12:04:08.267 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:04:08.276 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:04:08.276 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:04:08.327 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:04:08.327 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:04:08.400 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:04:08.469 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-17T12:04:08.475 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-17T12:04:08.484 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-17T12:04:08.490 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-17T12:04:08.495 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-17T12:04:08.496 INFO:teuthology.orchestra.run.trial090.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T12:04:08.628 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-17T12:04:08.631 INFO:teuthology.orchestra.run.trial090.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T12:04:08.909 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-17T12:04:08.909 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T12:04:08.909 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:08.933 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T12:04:09.161 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T12:04:09.161 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-17T12:04:09.161 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-17T12:04:09.161 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-17T12:04:09.161 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-17T12:04:09.161 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-17T12:04:09.161 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-17T12:04:09.161 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-17T12:04:09.214 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-17T12:04:09.214 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:09.215 INFO:teuthology.orchestra.run.trial090.stdout:Upgraded: 2026-02-17T12:04:09.215 INFO:teuthology.orchestra.run.trial090.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-17T12:04:09.215 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:04:09.215 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-17T12:04:09.215 INFO:teuthology.orchestra.run.trial090.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-17T12:04:09.215 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-17T12:04:09.215 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:09.215 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:04:09.244 DEBUG:teuthology.parallel:result is None 2026-02-17T12:04:09.245 INFO:teuthology.run_tasks:Running task install... 2026-02-17T12:04:09.257 DEBUG:teuthology.task.install:project ceph 2026-02-17T12:04:09.258 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}} 2026-02-17T12:04:09.258 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T12:04:09.258 INFO:teuthology.task.install:Using flavor: default 2026-02-17T12:04:09.266 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T12:04:09.267 INFO:teuthology.task.install:extra packages: [] 2026-02-17T12:04:09.267 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T12:04:09.268 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:04:09.270 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'tag': None, 'wait_for_package': False} 2026-02-17T12:04:09.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:04:09.467 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T12:04:09.467 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T12:04:09.476 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/ 2026-02-17T12:04:09.476 INFO:teuthology.task.install.rpm:Package version is 19.2.3-675.g3c96dfb3 2026-02-17T12:04:09.626 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T12:04:09.626 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:04:09.626 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T12:04:09.636 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T12:04:09.636 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:04:09.636 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T12:04:09.653 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T12:04:09.653 DEBUG:teuthology.orchestra.run.trial090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T12:04:09.665 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T12:04:09.665 DEBUG:teuthology.orchestra.run.trial198:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c96dfb3f50b3d02598a82af7104764bfdcd3919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T12:04:09.720 DEBUG:teuthology.orchestra.run.trial090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T12:04:09.730 DEBUG:teuthology.orchestra.run.trial198:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T12:04:09.794 DEBUG:teuthology.orchestra.run.trial090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T12:04:09.804 DEBUG:teuthology.orchestra.run.trial198:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T12:04:09.857 INFO:teuthology.orchestra.run.trial090.stdout:check_obsoletes = 1 2026-02-17T12:04:09.859 DEBUG:teuthology.orchestra.run.trial090:> sudo yum clean all 2026-02-17T12:04:09.868 INFO:teuthology.orchestra.run.trial198.stdout:check_obsoletes = 1 2026-02-17T12:04:09.869 DEBUG:teuthology.orchestra.run.trial198:> sudo yum clean all 2026-02-17T12:04:10.010 INFO:teuthology.orchestra.run.trial090.stdout:41 files removed 2026-02-17T12:04:10.019 INFO:teuthology.orchestra.run.trial198.stdout:41 files removed 2026-02-17T12:04:10.025 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-radosgw 2026-02-17T12:04:10.033 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-radosgw 2026-02-17T12:04:10.333 INFO:teuthology.orchestra.run.trial090.stdout:ceph packages for x86_64 526 kB/s | 86 kB 00:00 2026-02-17T12:04:10.343 INFO:teuthology.orchestra.run.trial198.stdout:ceph packages for x86_64 528 kB/s | 86 kB 00:00 2026-02-17T12:04:10.461 INFO:teuthology.orchestra.run.trial090.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-17T12:04:10.473 INFO:teuthology.orchestra.run.trial198.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-17T12:04:10.586 INFO:teuthology.orchestra.run.trial090.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T12:04:10.598 INFO:teuthology.orchestra.run.trial198.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T12:04:11.353 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-17T12:04:11.962 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.9 MB 00:01 2026-02-17T12:04:12.228 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - AppStream 79 MB/s | 27 MB 00:00 2026-02-17T12:04:15.226 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 27 MB 00:02 2026-02-17T12:04:15.633 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 7.8 MB 00:00 2026-02-17T12:04:17.338 INFO:teuthology.orchestra.run.trial198.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:00 2026-02-17T12:04:18.195 INFO:teuthology.orchestra.run.trial198.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-17T12:04:21.419 INFO:teuthology.orchestra.run.trial198.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-17T12:04:22.635 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:22.636 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:22.636 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repository Size 2026-02-17T12:04:22.636 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:22.636 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:04:22.636 INFO:teuthology.orchestra.run.trial198.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout:Upgrading: 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T12:04:22.637 INFO:teuthology.orchestra.run.trial198.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T12:04:22.638 INFO:teuthology.orchestra.run.trial198.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T12:04:22.639 INFO:teuthology.orchestra.run.trial198.stdout:Installing weak dependencies: 2026-02-17T12:04:22.640 INFO:teuthology.orchestra.run.trial198.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T12:04:22.640 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:22.640 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:04:22.640 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:22.640 INFO:teuthology.orchestra.run.trial198.stdout:Install 32 Packages 2026-02-17T12:04:22.640 INFO:teuthology.orchestra.run.trial198.stdout:Upgrade 2 Packages 2026-02-17T12:04:22.640 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:22.641 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 62 M 2026-02-17T12:04:22.641 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:04:23.845 INFO:teuthology.orchestra.run.trial198.stdout:(1/34): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 5.6 MB/s | 5.5 MB 00:00 2026-02-17T12:04:23.859 INFO:teuthology.orchestra.run.trial198.stdout:(2/34): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 1.8 MB/s | 25 kB 00:00 2026-02-17T12:04:23.922 INFO:teuthology.orchestra.run.trial198.stdout:(3/34): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 16 MB/s | 999 kB 00:00 2026-02-17T12:04:23.968 INFO:teuthology.orchestra.run.trial198.stdout:(4/34): libradosstriper1-19.2.3-675.g3c96dfb3.e 11 MB/s | 503 kB 00:00 2026-02-17T12:04:24.096 INFO:teuthology.orchestra.run.trial198.stdout:(5/34): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 8.7 MB/s | 11 MB 00:01 2026-02-17T12:04:24.108 INFO:teuthology.orchestra.run.trial198.stdout:(6/34): python3-ceph-argparse-19.2.3-675.g3c96d 3.8 MB/s | 45 kB 00:00 2026-02-17T12:04:24.133 INFO:teuthology.orchestra.run.trial198.stdout:(7/34): python3-ceph-common-19.2.3-675.g3c96dfb 5.7 MB/s | 142 kB 00:00 2026-02-17T12:04:24.158 INFO:teuthology.orchestra.run.trial198.stdout:(8/34): python3-cephfs-19.2.3-675.g3c96dfb3.el9 6.4 MB/s | 165 kB 00:00 2026-02-17T12:04:24.189 INFO:teuthology.orchestra.run.trial198.stdout:(9/34): python3-rados-19.2.3-675.g3c96dfb3.el9. 10 MB/s | 322 kB 00:00 2026-02-17T12:04:24.220 INFO:teuthology.orchestra.run.trial198.stdout:(10/34): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 9.5 MB/s | 303 kB 00:00 2026-02-17T12:04:24.249 INFO:teuthology.orchestra.run.trial198.stdout:(11/34): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 3.4 MB/s | 100 kB 00:00 2026-02-17T12:04:24.266 INFO:teuthology.orchestra.run.trial198.stdout:(12/34): librgw2-19.2.3-675.g3c96dfb3.el9.x86_6 18 MB/s | 5.4 MB 00:00 2026-02-17T12:04:24.277 INFO:teuthology.orchestra.run.trial198.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 1.2 MB/s | 33 kB 00:00 2026-02-17T12:04:24.302 INFO:teuthology.orchestra.run.trial198.stdout:(14/34): pciutils-3.7.0-7.el9.x86_64.rpm 2.5 MB/s | 93 kB 00:00 2026-02-17T12:04:24.361 INFO:teuthology.orchestra.run.trial198.stdout:(15/34): ceph-common-19.2.3-675.g3c96dfb3.el9.x 15 MB/s | 22 MB 00:01 2026-02-17T12:04:24.361 INFO:teuthology.orchestra.run.trial198.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 1.2 MB/s | 104 kB 00:00 2026-02-17T12:04:24.383 INFO:teuthology.orchestra.run.trial198.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-17T12:04:24.386 INFO:teuthology.orchestra.run.trial198.stdout:(18/34): libnbd-1.20.3-4.el9.x86_64.rpm 1.9 MB/s | 164 kB 00:00 2026-02-17T12:04:24.432 INFO:teuthology.orchestra.run.trial198.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.2 MB/s | 292 kB 00:00 2026-02-17T12:04:24.445 INFO:teuthology.orchestra.run.trial198.stdout:(20/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2026-02-17T12:04:24.447 INFO:teuthology.orchestra.run.trial198.stdout:(21/34): librdkafka-1.6.1-102.el9.x86_64.rpm 10 MB/s | 662 kB 00:00 2026-02-17T12:04:24.456 INFO:teuthology.orchestra.run.trial198.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 10 MB/s | 240 kB 00:00 2026-02-17T12:04:24.466 INFO:teuthology.orchestra.run.trial198.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-17T12:04:24.469 INFO:teuthology.orchestra.run.trial198.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.0 MB/s | 66 kB 00:00 2026-02-17T12:04:24.699 INFO:teuthology.orchestra.run.trial198.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 108 kB/s | 25 kB 00:00 2026-02-17T12:04:24.855 INFO:teuthology.orchestra.run.trial198.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 313 kB/s | 49 kB 00:00 2026-02-17T12:04:24.907 INFO:teuthology.orchestra.run.trial198.stdout:(27/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 681 kB/s | 308 kB 00:00 2026-02-17T12:04:24.968 INFO:teuthology.orchestra.run.trial198.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 594 kB/s | 67 kB 00:00 2026-02-17T12:04:25.109 INFO:teuthology.orchestra.run.trial198.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2026-02-17T12:04:25.151 INFO:teuthology.orchestra.run.trial198.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2026-02-17T12:04:25.243 INFO:teuthology.orchestra.run.trial198.stdout:(31/34): librados2-19.2.3-675.g3c96dfb3.el9.x86 37 MB/s | 3.4 MB 00:00 2026-02-17T12:04:25.254 INFO:teuthology.orchestra.run.trial198.stdout:(32/34): libarrow-9.0.0-15.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2026-02-17T12:04:25.271 INFO:teuthology.orchestra.run.trial198.stdout:(33/34): thrift-0.15.0-4.el9.x86_64.rpm 9.8 MB/s | 1.6 MB 00:00 2026-02-17T12:04:25.307 INFO:teuthology.orchestra.run.trial198.stdout:(34/34): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 50 MB/s | 3.2 MB 00:00 2026-02-17T12:04:25.308 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:25.308 INFO:teuthology.orchestra.run.trial198.stdout:Total 23 MB/s | 62 MB 00:02 2026-02-17T12:04:25.399 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:04:25.416 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:04:25.417 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:04:25.645 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:04:25.646 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:04:25.929 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:04:25.937 INFO:teuthology.orchestra.run.trial198.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-17T12:04:25.939 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-17T12:04:25.951 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-17T12:04:26.103 INFO:teuthology.orchestra.run.trial198.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-17T12:04:26.106 INFO:teuthology.orchestra.run.trial198.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/36 2026-02-17T12:04:26.137 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/36 2026-02-17T12:04:26.181 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/36 2026-02-17T12:04:26.182 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/36 2026-02-17T12:04:26.194 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/36 2026-02-17T12:04:26.199 INFO:teuthology.orchestra.run.trial198.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-17T12:04:26.208 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/36 2026-02-17T12:04:26.231 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/36 2026-02-17T12:04:26.232 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/36 2026-02-17T12:04:26.245 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/36 2026-02-17T12:04:26.284 INFO:teuthology.orchestra.run.trial198.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-17T12:04:26.287 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-17T12:04:26.294 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-17T12:04:26.296 INFO:teuthology.orchestra.run.trial198.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-17T12:04:26.299 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-17T12:04:26.304 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-17T12:04:26.446 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-17T12:04:26.447 INFO:teuthology.orchestra.run.trial198.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/36 2026-02-17T12:04:26.474 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/36 2026-02-17T12:04:26.477 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/36 2026-02-17T12:04:26.483 INFO:teuthology.orchestra.run.trial198.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-17T12:04:26.709 INFO:teuthology.orchestra.run.trial198.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-17T12:04:26.710 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/36 2026-02-17T12:04:26.726 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/36 2026-02-17T12:04:26.730 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/36 2026-02-17T12:04:26.735 INFO:teuthology.orchestra.run.trial198.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-17T12:04:26.738 INFO:teuthology.orchestra.run.trial198.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-17T12:04:26.739 INFO:teuthology.orchestra.run.trial198.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T12:04:26.756 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T12:04:26.759 INFO:teuthology.orchestra.run.trial198.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-17T12:04:26.786 INFO:teuthology.orchestra.run.trial198.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-17T12:04:26.788 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 30/36 2026-02-17T12:04:26.906 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - CRB 853 kB/s | 7.8 MB 00:09 2026-02-17T12:04:27.744 INFO:teuthology.orchestra.run.trial090.stdout:CentOS Stream 9 - Extras packages 174 kB/s | 20 kB 00:00 2026-02-17T12:04:27.775 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 31/36 2026-02-17T12:04:27.777 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 31/36 2026-02-17T12:04:28.058 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 31/36 2026-02-17T12:04:28.061 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/36 2026-02-17T12:04:28.102 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/36 2026-02-17T12:04:28.103 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T12:04:28.103 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T12:04:28.103 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:28.106 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/36 2026-02-17T12:04:28.486 INFO:teuthology.orchestra.run.trial090.stdout:Extra Packages for Enterprise Linux 30 MB/s | 20 MB 00:00 2026-02-17T12:04:31.711 INFO:teuthology.orchestra.run.trial090.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-17T12:04:32.588 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/36 2026-02-17T12:04:32.588 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /sys 2026-02-17T12:04:32.588 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /proc 2026-02-17T12:04:32.588 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /mnt 2026-02-17T12:04:32.588 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /var/tmp 2026-02-17T12:04:32.588 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /home 2026-02-17T12:04:32.588 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /root 2026-02-17T12:04:32.588 INFO:teuthology.orchestra.run.trial198.stdout:skipping the directory /tmp 2026-02-17T12:04:32.588 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:32.958 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:04:32.960 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:04:32.960 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-17T12:04:32.960 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:04:32.960 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:04:32.960 INFO:teuthology.orchestra.run.trial090.stdout: ceph-radosgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 11 M 2026-02-17T12:04:32.960 INFO:teuthology.orchestra.run.trial090.stdout:Upgrading: 2026-02-17T12:04:32.960 INFO:teuthology.orchestra.run.trial090.stdout: librados2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.4 M 2026-02-17T12:04:32.960 INFO:teuthology.orchestra.run.trial090.stdout: librbd1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.2 M 2026-02-17T12:04:32.960 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: ceph-base x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.5 M 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 22 M 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: ceph-selinux x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 25 k 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 999 k 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T12:04:32.961 INFO:teuthology.orchestra.run.trial090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: libradosstriper1 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 503 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: librgw2 x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 5.4 M 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-argparse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 45 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-common x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 142 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: python3-cephfs x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 165 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: python3-rados x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 322 k 2026-02-17T12:04:32.962 INFO:teuthology.orchestra.run.trial090.stdout: python3-rbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 303 k 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout: python3-rgw x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 100 k 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout:Installing weak dependencies: 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:04:32.963 INFO:teuthology.orchestra.run.trial090.stdout:Install 32 Packages 2026-02-17T12:04:32.964 INFO:teuthology.orchestra.run.trial090.stdout:Upgrade 2 Packages 2026-02-17T12:04:32.964 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:32.964 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 62 M 2026-02-17T12:04:32.964 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:04:33.046 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/36 2026-02-17T12:04:33.070 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/36 2026-02-17T12:04:33.070 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:33.070 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T12:04:33.070 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:04:33.071 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:04:33.071 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:33.072 INFO:teuthology.orchestra.run.trial198.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T12:04:33.086 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T12:04:33.086 INFO:teuthology.orchestra.run.trial198.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T12:04:33.141 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T12:04:33.141 INFO:teuthology.orchestra.run.trial198.stdout:Creating group 'qat' with GID 992. 2026-02-17T12:04:33.141 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-17T12:04:33.417 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-17T12:04:33.418 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-17T12:04:33.418 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-17T12:04:33.418 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-17T12:04:33.418 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-17T12:04:33.418 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-17T12:04:33.418 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-17T12:04:33.418 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-17T12:04:33.418 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/36 2026-02-17T12:04:33.418 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-17T12:04:33.418 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/36 2026-02-17T12:04:33.478 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout:Upgraded: 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.479 INFO:teuthology.orchestra.run.trial198.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T12:04:33.480 INFO:teuthology.orchestra.run.trial198.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T12:04:33.481 INFO:teuthology.orchestra.run.trial198.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T12:04:33.482 INFO:teuthology.orchestra.run.trial198.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T12:04:33.482 INFO:teuthology.orchestra.run.trial198.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T12:04:33.482 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:33.482 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:33.500 INFO:teuthology.orchestra.run.trial090.stdout:(1/34): ceph-base-19.2.3-675.g3c96dfb3.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-17T12:04:33.521 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-test 2026-02-17T12:04:33.539 INFO:teuthology.orchestra.run.trial090.stdout:(2/34): ceph-selinux-19.2.3-675.g3c96dfb3.el9.x 641 kB/s | 25 kB 00:00 2026-02-17T12:04:33.599 INFO:teuthology.orchestra.run.trial090.stdout:(3/34): libcephfs2-19.2.3-675.g3c96dfb3.el9.x86 16 MB/s | 999 kB 00:00 2026-02-17T12:04:33.652 INFO:teuthology.orchestra.run.trial090.stdout:(4/34): libradosstriper1-19.2.3-675.g3c96dfb3.e 9.4 MB/s | 503 kB 00:00 2026-02-17T12:04:33.753 INFO:teuthology.orchestra.run.trial090.stdout:(5/34): ceph-radosgw-19.2.3-675.g3c96dfb3.el9.x 18 MB/s | 11 MB 00:00 2026-02-17T12:04:33.794 INFO:teuthology.orchestra.run.trial090.stdout:(6/34): python3-ceph-argparse-19.2.3-675.g3c96d 1.1 MB/s | 45 kB 00:00 2026-02-17T12:04:33.825 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:33.847 INFO:teuthology.orchestra.run.trial090.stdout:(7/34): python3-ceph-common-19.2.3-675.g3c96dfb 2.6 MB/s | 142 kB 00:00 2026-02-17T12:04:33.883 INFO:teuthology.orchestra.run.trial090.stdout:(8/34): librgw2-19.2.3-675.g3c96dfb3.el9.x86_64 23 MB/s | 5.4 MB 00:00 2026-02-17T12:04:33.897 INFO:teuthology.orchestra.run.trial090.stdout:(9/34): python3-cephfs-19.2.3-675.g3c96dfb3.el9 3.2 MB/s | 165 kB 00:00 2026-02-17T12:04:33.907 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:33.908 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:33.908 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repository Size 2026-02-17T12:04:33.908 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:33.908 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:04:33.908 INFO:teuthology.orchestra.run.trial198.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T12:04:33.908 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout:Install 5 Packages 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 50 M 2026-02-17T12:04:33.909 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 212 M 2026-02-17T12:04:33.910 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:04:33.918 INFO:teuthology.orchestra.run.trial090.stdout:(10/34): python3-rados-19.2.3-675.g3c96dfb3.el9 8.9 MB/s | 322 kB 00:00 2026-02-17T12:04:33.935 INFO:teuthology.orchestra.run.trial090.stdout:(11/34): python3-rbd-19.2.3-675.g3c96dfb3.el9.x 7.7 MB/s | 303 kB 00:00 2026-02-17T12:04:33.946 INFO:teuthology.orchestra.run.trial090.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 3.1 MB/s | 33 kB 00:00 2026-02-17T12:04:33.953 INFO:teuthology.orchestra.run.trial090.stdout:(13/34): python3-rgw-19.2.3-675.g3c96dfb3.el9.x 2.8 MB/s | 100 kB 00:00 2026-02-17T12:04:33.954 INFO:teuthology.orchestra.run.trial090.stdout:(14/34): pciutils-3.7.0-7.el9.x86_64.rpm 12 MB/s | 93 kB 00:00 2026-02-17T12:04:34.016 INFO:teuthology.orchestra.run.trial198.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 11 MB/s | 233 kB 00:00 2026-02-17T12:04:34.032 INFO:teuthology.orchestra.run.trial198.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 18 MB/s | 303 kB 00:00 2026-02-17T12:04:34.037 INFO:teuthology.orchestra.run.trial198.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-17T12:04:34.056 INFO:teuthology.orchestra.run.trial090.stdout:(15/34): ceph-common-19.2.3-675.g3c96dfb3.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T12:04:34.086 INFO:teuthology.orchestra.run.trial090.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 781 kB/s | 104 kB 00:00 2026-02-17T12:04:34.096 INFO:teuthology.orchestra.run.trial198.stdout:(4/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 1.6 MB/s | 163 kB 00:00 2026-02-17T12:04:34.103 INFO:teuthology.orchestra.run.trial090.stdout:(17/34): libnbd-1.20.3-4.el9.x86_64.rpm 1.1 MB/s | 164 kB 00:00 2026-02-17T12:04:34.121 INFO:teuthology.orchestra.run.trial090.stdout:(18/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2026-02-17T12:04:34.191 INFO:teuthology.orchestra.run.trial090.stdout:(19/34): librdkafka-1.6.1-102.el9.x86_64.rpm 7.4 MB/s | 662 kB 00:00 2026-02-17T12:04:34.196 INFO:teuthology.orchestra.run.trial090.stdout:(20/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2026-02-17T12:04:34.200 INFO:teuthology.orchestra.run.trial090.stdout:(21/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.6 MB/s | 292 kB 00:00 2026-02-17T12:04:34.220 INFO:teuthology.orchestra.run.trial090.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 8.0 MB/s | 240 kB 00:00 2026-02-17T12:04:34.224 INFO:teuthology.orchestra.run.trial090.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.3 MB/s | 37 kB 00:00 2026-02-17T12:04:34.228 INFO:teuthology.orchestra.run.trial090.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.4 MB/s | 66 kB 00:00 2026-02-17T12:04:34.302 INFO:teuthology.orchestra.run.trial090.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 333 kB/s | 25 kB 00:00 2026-02-17T12:04:34.352 INFO:teuthology.orchestra.run.trial090.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 974 kB/s | 49 kB 00:00 2026-02-17T12:04:34.378 INFO:teuthology.orchestra.run.trial090.stdout:(27/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.9 MB/s | 308 kB 00:00 2026-02-17T12:04:34.388 INFO:teuthology.orchestra.run.trial090.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.8 MB/s | 67 kB 00:00 2026-02-17T12:04:34.447 INFO:teuthology.orchestra.run.trial090.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-17T12:04:34.447 INFO:teuthology.orchestra.run.trial090.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2026-02-17T12:04:34.504 INFO:teuthology.orchestra.run.trial090.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 28 MB/s | 1.6 MB 00:00 2026-02-17T12:04:34.546 INFO:teuthology.orchestra.run.trial090.stdout:(32/34): libarrow-9.0.0-15.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2026-02-17T12:04:34.795 INFO:teuthology.orchestra.run.trial090.stdout:(33/34): librados2-19.2.3-675.g3c96dfb3.el9.x86 9.9 MB/s | 3.4 MB 00:00 2026-02-17T12:04:34.910 INFO:teuthology.orchestra.run.trial090.stdout:(34/34): librbd1-19.2.3-675.g3c96dfb3.el9.x86_6 7.8 MB/s | 3.2 MB 00:00 2026-02-17T12:04:34.911 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:34.912 INFO:teuthology.orchestra.run.trial090.stdout:Total 32 MB/s | 62 MB 00:01 2026-02-17T12:04:35.004 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:04:35.022 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:04:35.023 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:04:35.140 INFO:teuthology.orchestra.run.trial198.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 43 MB/s | 50 MB 00:01 2026-02-17T12:04:35.141 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:35.141 INFO:teuthology.orchestra.run.trial198.stdout:Total 41 MB/s | 50 MB 00:01 2026-02-17T12:04:35.168 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:04:35.176 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:04:35.177 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:04:35.252 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:04:35.252 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:04:35.363 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:04:35.363 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:04:35.548 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:04:35.556 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-17T12:04:35.558 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/36 2026-02-17T12:04:35.570 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/36 2026-02-17T12:04:35.576 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:04:35.583 INFO:teuthology.orchestra.run.trial198.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T12:04:35.587 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T12:04:35.595 INFO:teuthology.orchestra.run.trial198.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T12:04:35.597 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T12:04:35.719 INFO:teuthology.orchestra.run.trial090.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/36 2026-02-17T12:04:35.723 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/36 2026-02-17T12:04:35.754 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/36 2026-02-17T12:04:35.796 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/36 2026-02-17T12:04:35.797 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/36 2026-02-17T12:04:35.809 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/36 2026-02-17T12:04:35.813 INFO:teuthology.orchestra.run.trial090.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/36 2026-02-17T12:04:35.822 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 9/36 2026-02-17T12:04:35.844 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/36 2026-02-17T12:04:35.845 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/36 2026-02-17T12:04:35.857 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/36 2026-02-17T12:04:35.887 INFO:teuthology.orchestra.run.trial090.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/36 2026-02-17T12:04:35.891 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/36 2026-02-17T12:04:35.899 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/36 2026-02-17T12:04:35.901 INFO:teuthology.orchestra.run.trial090.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/36 2026-02-17T12:04:35.904 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/36 2026-02-17T12:04:35.909 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/36 2026-02-17T12:04:36.048 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-17T12:04:36.049 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/36 2026-02-17T12:04:36.075 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 19/36 2026-02-17T12:04:36.079 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 20/36 2026-02-17T12:04:36.086 INFO:teuthology.orchestra.run.trial090.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-17T12:04:36.310 INFO:teuthology.orchestra.run.trial090.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-17T12:04:36.311 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/36 2026-02-17T12:04:36.327 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 23/36 2026-02-17T12:04:36.331 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 24/36 2026-02-17T12:04:36.335 INFO:teuthology.orchestra.run.trial090.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-17T12:04:36.337 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-17T12:04:36.338 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T12:04:36.355 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-17T12:04:36.358 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-17T12:04:36.386 INFO:teuthology.orchestra.run.trial090.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-17T12:04:36.387 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 30/36 2026-02-17T12:04:37.368 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 31/36 2026-02-17T12:04:37.371 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 31/36 2026-02-17T12:04:37.653 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 31/36 2026-02-17T12:04:37.657 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/36 2026-02-17T12:04:37.695 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 32/36 2026-02-17T12:04:37.695 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T12:04:37.696 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T12:04:37.696 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:37.698 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/36 2026-02-17T12:04:37.879 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T12:04:37.897 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T12:04:38.126 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T12:04:38.126 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T12:04:38.126 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T12:04:38.126 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T12:04:38.126 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T12:04:38.177 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T12:04:38.177 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:38.177 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:04:38.177 INFO:teuthology.orchestra.run.trial198.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:38.177 INFO:teuthology.orchestra.run.trial198.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:38.177 INFO:teuthology.orchestra.run.trial198.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T12:04:38.177 INFO:teuthology.orchestra.run.trial198.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T12:04:38.178 INFO:teuthology.orchestra.run.trial198.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T12:04:38.178 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:38.178 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:38.209 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph 2026-02-17T12:04:38.508 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:38.592 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:38.595 INFO:teuthology.orchestra.run.trial198.stdout:====================================================================================== 2026-02-17T12:04:38.595 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repository Size 2026-02-17T12:04:38.595 INFO:teuthology.orchestra.run.trial198.stdout:====================================================================================== 2026-02-17T12:04:38.596 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:04:38.596 INFO:teuthology.orchestra.run.trial198.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T12:04:38.596 INFO:teuthology.orchestra.run.trial198.stdout:Installing dependencies: 2026-02-17T12:04:38.596 INFO:teuthology.orchestra.run.trial198.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T12:04:38.596 INFO:teuthology.orchestra.run.trial198.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T12:04:38.596 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T12:04:38.596 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T12:04:38.597 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T12:04:38.597 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T12:04:38.597 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T12:04:38.597 INFO:teuthology.orchestra.run.trial198.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T12:04:38.597 INFO:teuthology.orchestra.run.trial198.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T12:04:38.597 INFO:teuthology.orchestra.run.trial198.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T12:04:38.598 INFO:teuthology.orchestra.run.trial198.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T12:04:38.599 INFO:teuthology.orchestra.run.trial198.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T12:04:38.600 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T12:04:38.601 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T12:04:38.602 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T12:04:38.602 INFO:teuthology.orchestra.run.trial198.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T12:04:38.602 INFO:teuthology.orchestra.run.trial198.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T12:04:38.602 INFO:teuthology.orchestra.run.trial198.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T12:04:38.602 INFO:teuthology.orchestra.run.trial198.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T12:04:38.602 INFO:teuthology.orchestra.run.trial198.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T12:04:38.603 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T12:04:38.603 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T12:04:38.603 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T12:04:38.603 INFO:teuthology.orchestra.run.trial198.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T12:04:38.603 INFO:teuthology.orchestra.run.trial198.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T12:04:38.603 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T12:04:38.604 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T12:04:38.604 INFO:teuthology.orchestra.run.trial198.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T12:04:38.604 INFO:teuthology.orchestra.run.trial198.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T12:04:38.604 INFO:teuthology.orchestra.run.trial198.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T12:04:38.604 INFO:teuthology.orchestra.run.trial198.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T12:04:38.605 INFO:teuthology.orchestra.run.trial198.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T12:04:38.605 INFO:teuthology.orchestra.run.trial198.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T12:04:38.605 INFO:teuthology.orchestra.run.trial198.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T12:04:38.605 INFO:teuthology.orchestra.run.trial198.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T12:04:38.605 INFO:teuthology.orchestra.run.trial198.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T12:04:38.605 INFO:teuthology.orchestra.run.trial198.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T12:04:38.606 INFO:teuthology.orchestra.run.trial198.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T12:04:38.606 INFO:teuthology.orchestra.run.trial198.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T12:04:38.606 INFO:teuthology.orchestra.run.trial198.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T12:04:38.606 INFO:teuthology.orchestra.run.trial198.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T12:04:38.606 INFO:teuthology.orchestra.run.trial198.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T12:04:38.606 INFO:teuthology.orchestra.run.trial198.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T12:04:38.607 INFO:teuthology.orchestra.run.trial198.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T12:04:38.607 INFO:teuthology.orchestra.run.trial198.stdout:Installing weak dependencies: 2026-02-17T12:04:38.607 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T12:04:38.607 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T12:04:38.607 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T12:04:38.608 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T12:04:38.608 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T12:04:38.608 INFO:teuthology.orchestra.run.trial198.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T12:04:38.608 INFO:teuthology.orchestra.run.trial198.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T12:04:38.608 INFO:teuthology.orchestra.run.trial198.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T12:04:38.608 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:38.609 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:04:38.609 INFO:teuthology.orchestra.run.trial198.stdout:====================================================================================== 2026-02-17T12:04:38.609 INFO:teuthology.orchestra.run.trial198.stdout:Install 98 Packages 2026-02-17T12:04:38.609 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:38.611 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 95 M 2026-02-17T12:04:38.611 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 519 M 2026-02-17T12:04:38.611 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:04:39.061 INFO:teuthology.orchestra.run.trial198.stdout:(1/98): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 32 kB/s | 6.5 kB 00:00 2026-02-17T12:04:39.694 INFO:teuthology.orchestra.run.trial198.stdout:(2/98): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 1.3 MB/s | 1.1 MB 00:00 2026-02-17T12:04:39.835 INFO:teuthology.orchestra.run.trial198.stdout:(3/98): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 2.5 MB/s | 2.4 MB 00:00 2026-02-17T12:04:39.848 INFO:teuthology.orchestra.run.trial198.stdout:(4/98): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 6.0 MB/s | 4.7 MB 00:00 2026-02-17T12:04:39.848 INFO:teuthology.orchestra.run.trial198.stdout:(5/98): ceph-grafana-dashboards-19.2.3-675.g3c9 2.4 MB/s | 31 kB 00:00 2026-02-17T12:04:39.859 INFO:teuthology.orchestra.run.trial198.stdout:(6/98): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 12 MB/s | 150 kB 00:00 2026-02-17T12:04:40.063 INFO:teuthology.orchestra.run.trial198.stdout:(7/98): ceph-mgr-diskprediction-local-19.2.3-67 36 MB/s | 7.4 MB 00:00 2026-02-17T12:04:40.075 INFO:teuthology.orchestra.run.trial198.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 1.9 MB/s | 22 kB 00:00 2026-02-17T12:04:40.087 INFO:teuthology.orchestra.run.trial198.stdout:(9/98): ceph-mgr-modules-core-19.2.3-675.g3c96d 21 MB/s | 253 kB 00:00 2026-02-17T12:04:40.098 INFO:teuthology.orchestra.run.trial198.stdout:(10/98): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 4.3 MB/s | 49 kB 00:00 2026-02-17T12:04:40.109 INFO:teuthology.orchestra.run.trial198.stdout:(11/98): ceph-prometheus-alerts-19.2.3-675.g3c9 1.5 MB/s | 17 kB 00:00 2026-02-17T12:04:40.122 INFO:teuthology.orchestra.run.trial198.stdout:(12/98): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 24 MB/s | 299 kB 00:00 2026-02-17T12:04:40.145 INFO:teuthology.orchestra.run.trial198.stdout:(13/98): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 33 MB/s | 769 kB 00:00 2026-02-17T12:04:40.256 INFO:teuthology.orchestra.run.trial198.stdout:(14/98): cryptsetup-2.8.1-2.el9.x86_64.rpm 3.1 MB/s | 350 kB 00:00 2026-02-17T12:04:40.278 INFO:teuthology.orchestra.run.trial198.stdout:(15/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.8 MB/s | 40 kB 00:00 2026-02-17T12:04:40.301 INFO:teuthology.orchestra.run.trial198.stdout:(16/98): libconfig-1.7.2-9.el9.x86_64.rpm 3.2 MB/s | 72 kB 00:00 2026-02-17T12:04:40.345 INFO:teuthology.orchestra.run.trial198.stdout:(17/98): libgfortran-11.5.0-14.el9.x86_64.rpm 18 MB/s | 794 kB 00:00 2026-02-17T12:04:40.372 INFO:teuthology.orchestra.run.trial198.stdout:(18/98): ceph-mgr-dashboard-19.2.3-675.g3c96dfb 7.3 MB/s | 3.8 MB 00:00 2026-02-17T12:04:40.373 INFO:teuthology.orchestra.run.trial198.stdout:(19/98): libquadmath-11.5.0-14.el9.x86_64.rpm 6.5 MB/s | 184 kB 00:00 2026-02-17T12:04:40.400 INFO:teuthology.orchestra.run.trial198.stdout:(20/98): python3-cryptography-36.0.1-5.el9.x86_ 45 MB/s | 1.2 MB 00:00 2026-02-17T12:04:40.423 INFO:teuthology.orchestra.run.trial198.stdout:(21/98): python3-ply-3.11-14.el9.noarch.rpm 4.5 MB/s | 106 kB 00:00 2026-02-17T12:04:40.446 INFO:teuthology.orchestra.run.trial198.stdout:(22/98): python3-pycparser-2.20-6.el9.noarch.rp 5.9 MB/s | 135 kB 00:00 2026-02-17T12:04:40.456 INFO:teuthology.orchestra.run.trial198.stdout:(23/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 253 kB 00:00 2026-02-17T12:04:40.469 INFO:teuthology.orchestra.run.trial198.stdout:(24/98): python3-requests-2.25.1-10.el9.noarch. 5.2 MB/s | 126 kB 00:00 2026-02-17T12:04:40.482 INFO:teuthology.orchestra.run.trial198.stdout:(25/98): python3-urllib3-1.26.5-7.el9.noarch.rp 8.3 MB/s | 218 kB 00:00 2026-02-17T12:04:40.491 INFO:teuthology.orchestra.run.trial198.stdout:(26/98): unzip-6.0-59.el9.x86_64.rpm 8.1 MB/s | 182 kB 00:00 2026-02-17T12:04:40.506 INFO:teuthology.orchestra.run.trial198.stdout:(27/98): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-17T12:04:40.516 INFO:teuthology.orchestra.run.trial198.stdout:(28/98): flexiblas-3.0.4-9.el9.x86_64.rpm 1.2 MB/s | 30 kB 00:00 2026-02-17T12:04:40.525 INFO:teuthology.orchestra.run.trial198.stdout:(29/98): flexiblas-openblas-openmp-3.0.4-9.el9. 1.8 MB/s | 15 kB 00:00 2026-02-17T12:04:40.555 INFO:teuthology.orchestra.run.trial198.stdout:(30/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 8.0 MB/s | 246 kB 00:00 2026-02-17T12:04:40.566 INFO:teuthology.orchestra.run.trial198.stdout:(31/98): lua-5.4.4-4.el9.x86_64.rpm 17 MB/s | 188 kB 00:00 2026-02-17T12:04:40.575 INFO:teuthology.orchestra.run.trial198.stdout:(32/98): openblas-0.3.29-1.el9.x86_64.rpm 4.9 MB/s | 42 kB 00:00 2026-02-17T12:04:40.581 INFO:teuthology.orchestra.run.trial198.stdout:(33/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 40 MB/s | 3.0 MB 00:00 2026-02-17T12:04:40.594 INFO:teuthology.orchestra.run.trial198.stdout:(34/98): protobuf-3.14.0-17.el9.x86_64.rpm 77 MB/s | 1.0 MB 00:00 2026-02-17T12:04:40.618 INFO:teuthology.orchestra.run.trial198.stdout:(35/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 122 MB/s | 5.3 MB 00:00 2026-02-17T12:04:40.630 INFO:teuthology.orchestra.run.trial198.stdout:(36/98): python3-devel-3.9.25-2.el9.x86_64.rpm 21 MB/s | 244 kB 00:00 2026-02-17T12:04:40.641 INFO:teuthology.orchestra.run.trial198.stdout:(37/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 22 MB/s | 249 kB 00:00 2026-02-17T12:04:40.652 INFO:teuthology.orchestra.run.trial198.stdout:(38/98): python3-libstoragemgmt-1.10.1-1.el9.x8 16 MB/s | 177 kB 00:00 2026-02-17T12:04:40.665 INFO:teuthology.orchestra.run.trial198.stdout:(39/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 90 MB/s | 1.2 MB 00:00 2026-02-17T12:04:40.676 INFO:teuthology.orchestra.run.trial198.stdout:(40/98): python3-mako-1.1.4-6.el9.noarch.rpm 16 MB/s | 172 kB 00:00 2026-02-17T12:04:40.685 INFO:teuthology.orchestra.run.trial198.stdout:(41/98): python3-markupsafe-1.1.1-12.el9.x86_64 3.9 MB/s | 35 kB 00:00 2026-02-17T12:04:40.711 INFO:teuthology.orchestra.run.trial198.stdout:(42/98): python3-babel-2.9.1-2.el9.noarch.rpm 51 MB/s | 6.0 MB 00:00 2026-02-17T12:04:40.723 INFO:teuthology.orchestra.run.trial198.stdout:(43/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 164 MB/s | 6.1 MB 00:00 2026-02-17T12:04:40.724 INFO:teuthology.orchestra.run.trial198.stdout:(44/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 34 MB/s | 442 kB 00:00 2026-02-17T12:04:40.732 INFO:teuthology.orchestra.run.trial198.stdout:(45/98): python3-packaging-20.9-5.el9.noarch.rp 7.9 MB/s | 77 kB 00:00 2026-02-17T12:04:40.733 INFO:teuthology.orchestra.run.trial198.stdout:(46/98): python3-protobuf-3.14.0-17.el9.noarch. 30 MB/s | 267 kB 00:00 2026-02-17T12:04:40.742 INFO:teuthology.orchestra.run.trial198.stdout:(47/98): python3-pyasn1-modules-0.4.8-6.el9.noa 32 MB/s | 279 kB 00:00 2026-02-17T12:04:40.742 INFO:teuthology.orchestra.run.trial198.stdout:(48/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 16 MB/s | 159 kB 00:00 2026-02-17T12:04:40.749 INFO:teuthology.orchestra.run.trial198.stdout:(49/98): python3-requests-oauthlib-1.3.0-12.el9 6.9 MB/s | 54 kB 00:00 2026-02-17T12:04:40.757 INFO:teuthology.orchestra.run.trial198.stdout:(50/98): python3-toml-0.10.2-6.el9.noarch.rpm 5.4 MB/s | 42 kB 00:00 2026-02-17T12:04:40.766 INFO:teuthology.orchestra.run.trial198.stdout:(51/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 22 MB/s | 189 kB 00:00 2026-02-17T12:04:40.774 INFO:teuthology.orchestra.run.trial198.stdout:(52/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 11 MB/s | 90 kB 00:00 2026-02-17T12:04:40.784 INFO:teuthology.orchestra.run.trial198.stdout:(53/98): lua-devel-5.4.4-4.el9.x86_64.rpm 2.1 MB/s | 22 kB 00:00 2026-02-17T12:04:40.803 INFO:teuthology.orchestra.run.trial198.stdout:(54/98): protobuf-compiler-3.14.0-17.el9.x86_64 44 MB/s | 862 kB 00:00 2026-02-17T12:04:40.831 INFO:teuthology.orchestra.run.trial198.stdout:(55/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 217 MB/s | 19 MB 00:00 2026-02-17T12:04:41.034 INFO:teuthology.orchestra.run.trial198.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 96 kB/s | 19 kB 00:00 2026-02-17T12:04:41.280 INFO:teuthology.orchestra.run.trial198.stdout:(57/98): luarocks-3.9.2-5.el9.noarch.rpm 615 kB/s | 151 kB 00:00 2026-02-17T12:04:41.355 INFO:teuthology.orchestra.run.trial198.stdout:(58/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-17T12:04:41.427 INFO:teuthology.orchestra.run.trial198.stdout:(59/98): python3-autocommand-2.2.2-8.el9.noarch 411 kB/s | 29 kB 00:00 2026-02-17T12:04:41.495 INFO:teuthology.orchestra.run.trial198.stdout:(60/98): python3-asyncssh-2.13.2-5.el9.noarch.r 2.5 MB/s | 548 kB 00:00 2026-02-17T12:04:41.501 INFO:teuthology.orchestra.run.trial198.stdout:(61/98): python3-backports-tarfile-1.2.0-1.el9. 808 kB/s | 60 kB 00:00 2026-02-17T12:04:41.531 INFO:teuthology.orchestra.run.trial198.stdout:(62/98): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 9.3 MB/s | 17 MB 00:01 2026-02-17T12:04:41.565 INFO:teuthology.orchestra.run.trial198.stdout:(63/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 621 kB/s | 43 kB 00:00 2026-02-17T12:04:41.573 INFO:teuthology.orchestra.run.trial198.stdout:(64/98): python3-cachetools-4.2.4-1.el9.noarch. 450 kB/s | 32 kB 00:00 2026-02-17T12:04:41.645 INFO:teuthology.orchestra.run.trial198.stdout:(65/98): python3-cheroot-10.0.1-4.el9.noarch.rp 2.1 MB/s | 173 kB 00:00 2026-02-17T12:04:41.674 INFO:teuthology.orchestra.run.trial198.stdout:(66/98): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2026-02-17T12:04:41.730 INFO:teuthology.orchestra.run.trial198.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 2.9 MB/s | 254 kB 00:00 2026-02-17T12:04:41.737 INFO:teuthology.orchestra.run.trial198.stdout:(68/98): python3-certifi-2023.05.07-4.el9.noarc 68 kB/s | 14 kB 00:00 2026-02-17T12:04:41.808 INFO:teuthology.orchestra.run.trial198.stdout:(69/98): python3-grpcio-tools-1.46.7-10.el9.x86 1.8 MB/s | 144 kB 00:00 2026-02-17T12:04:41.879 INFO:teuthology.orchestra.run.trial198.stdout:(70/98): python3-isodate-0.6.1-3.el9.noarch.rpm 791 kB/s | 56 kB 00:00 2026-02-17T12:04:41.896 INFO:teuthology.orchestra.run.trial198.stdout:(71/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.2 MB/s | 2.0 MB 00:00 2026-02-17T12:04:41.947 INFO:teuthology.orchestra.run.trial198.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 158 kB/s | 11 kB 00:00 2026-02-17T12:04:41.966 INFO:teuthology.orchestra.run.trial198.stdout:(73/98): python3-jaraco-classes-3.2.1-5.el9.noa 252 kB/s | 18 kB 00:00 2026-02-17T12:04:41.996 INFO:teuthology.orchestra.run.trial198.stdout:(74/98): python3-influxdb-5.3.1-1.el9.noarch.rp 537 kB/s | 139 kB 00:00 2026-02-17T12:04:42.015 INFO:teuthology.orchestra.run.trial198.stdout:(75/98): python3-jaraco-collections-3.0.0-8.el9 340 kB/s | 23 kB 00:00 2026-02-17T12:04:42.036 INFO:teuthology.orchestra.run.trial198.stdout:(76/98): python3-jaraco-context-6.0.1-3.el9.noa 281 kB/s | 20 kB 00:00 2026-02-17T12:04:42.071 INFO:teuthology.orchestra.run.trial198.stdout:(77/98): python3-jaraco-functools-3.5.0-2.el9.n 261 kB/s | 19 kB 00:00 2026-02-17T12:04:42.084 INFO:teuthology.orchestra.run.trial198.stdout:(78/98): python3-jaraco-text-4.0.0-2.el9.noarch 383 kB/s | 26 kB 00:00 2026-02-17T12:04:42.128 INFO:teuthology.orchestra.run.trial198.stdout:(79/98): python3-kubernetes-26.1.0-3.el9.noarch 11 MB/s | 1.0 MB 00:00 2026-02-17T12:04:42.154 INFO:teuthology.orchestra.run.trial198.stdout:(80/98): python3-logutils-0.3.5-21.el9.noarch.r 555 kB/s | 46 kB 00:00 2026-02-17T12:04:42.157 INFO:teuthology.orchestra.run.trial198.stdout:(81/98): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2026-02-17T12:04:42.200 INFO:teuthology.orchestra.run.trial198.stdout:(82/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2026-02-17T12:04:42.227 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/36 2026-02-17T12:04:42.227 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /sys 2026-02-17T12:04:42.227 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /proc 2026-02-17T12:04:42.227 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /mnt 2026-02-17T12:04:42.227 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /var/tmp 2026-02-17T12:04:42.227 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /home 2026-02-17T12:04:42.228 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /root 2026-02-17T12:04:42.228 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /tmp 2026-02-17T12:04:42.228 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:42.241 INFO:teuthology.orchestra.run.trial198.stdout:(83/98): python3-natsort-7.1.1-5.el9.noarch.rpm 661 kB/s | 58 kB 00:00 2026-02-17T12:04:42.244 INFO:teuthology.orchestra.run.trial198.stdout:(84/98): python3-pecan-1.4.2-3.el9.noarch.rpm 3.1 MB/s | 272 kB 00:00 2026-02-17T12:04:42.270 INFO:teuthology.orchestra.run.trial198.stdout:(85/98): python3-portend-3.1.0-2.el9.noarch.rpm 234 kB/s | 16 kB 00:00 2026-02-17T12:04:42.313 INFO:teuthology.orchestra.run.trial198.stdout:(86/98): python3-repoze-lru-0.7-16.el9.noarch.r 446 kB/s | 31 kB 00:00 2026-02-17T12:04:42.339 INFO:teuthology.orchestra.run.trial198.stdout:(87/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 921 kB/s | 90 kB 00:00 2026-02-17T12:04:42.343 INFO:teuthology.orchestra.run.trial198.stdout:(88/98): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2026-02-17T12:04:42.384 INFO:teuthology.orchestra.run.trial198.stdout:(89/98): python3-rsa-4.9-2.el9.noarch.rpm 834 kB/s | 59 kB 00:00 2026-02-17T12:04:42.413 INFO:teuthology.orchestra.run.trial198.stdout:(90/98): python3-tempora-5.0.0-2.el9.noarch.rpm 510 kB/s | 36 kB 00:00 2026-02-17T12:04:42.448 INFO:teuthology.orchestra.run.trial198.stdout:(91/98): python3-saml-1.16.0-1.el9.noarch.rpm 1.1 MB/s | 125 kB 00:00 2026-02-17T12:04:42.457 INFO:teuthology.orchestra.run.trial198.stdout:(92/98): python3-typing-extensions-4.15.0-1.el9 1.2 MB/s | 86 kB 00:00 2026-02-17T12:04:42.487 INFO:teuthology.orchestra.run.trial198.stdout:(93/98): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2026-02-17T12:04:42.544 INFO:teuthology.orchestra.run.trial198.stdout:(94/98): python3-websocket-client-1.2.3-2.el9.n 938 kB/s | 90 kB 00:00 2026-02-17T12:04:42.556 INFO:teuthology.orchestra.run.trial198.stdout:(95/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2026-02-17T12:04:42.559 INFO:teuthology.orchestra.run.trial198.stdout:(96/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 685 kB/s | 48 kB 00:00 2026-02-17T12:04:42.620 INFO:teuthology.orchestra.run.trial198.stdout:(97/98): python3-xmltodict-0.12.0-15.el9.noarch 292 kB/s | 22 kB 00:00 2026-02-17T12:04:42.625 INFO:teuthology.orchestra.run.trial198.stdout:(98/98): python3-zc-lockfile-2.0-10.el9.noarch. 290 kB/s | 20 kB 00:00 2026-02-17T12:04:42.631 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:42.633 INFO:teuthology.orchestra.run.trial198.stdout:Total 24 MB/s | 95 MB 00:04 2026-02-17T12:04:42.681 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/36 2026-02-17T12:04:42.705 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 34/36 2026-02-17T12:04:42.705 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:42.705 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T12:04:42.705 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:04:42.705 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T12:04:42.705 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:42.706 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T12:04:42.719 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-17T12:04:42.719 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T12:04:42.776 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T12:04:42.776 INFO:teuthology.orchestra.run.trial090.stdout:Creating group 'qat' with GID 992. 2026-02-17T12:04:42.776 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:43.041 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/36 2026-02-17T12:04:43.041 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/36 2026-02-17T12:04:43.041 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/36 2026-02-17T12:04:43.041 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/36 2026-02-17T12:04:43.041 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 6/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 7/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x 8/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86 9/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 10/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 11/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 12/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 13/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-17T12:04:43.042 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-17T12:04:43.043 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-17T12:04:43.044 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-17T12:04:43.044 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-17T12:04:43.044 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-17T12:04:43.044 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 33/36 2026-02-17T12:04:43.044 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-17T12:04:43.044 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 35/36 2026-02-17T12:04:43.044 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:04:43.081 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:04:43.081 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:04:43.101 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-17T12:04:43.102 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:43.102 INFO:teuthology.orchestra.run.trial090.stdout:Upgraded: 2026-02-17T12:04:43.102 INFO:teuthology.orchestra.run.trial090.stdout: librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.102 INFO:teuthology.orchestra.run.trial090.stdout: librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.102 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:04:43.102 INFO:teuthology.orchestra.run.trial090.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: ceph-radosgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: ceph-selinux-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T12:04:43.103 INFO:teuthology.orchestra.run.trial090.stdout: libradosstriper1-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: librgw2-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-argparse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-common-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.104 INFO:teuthology.orchestra.run.trial090.stdout: python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.105 INFO:teuthology.orchestra.run.trial090.stdout: python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:43.105 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T12:04:43.105 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T12:04:43.105 INFO:teuthology.orchestra.run.trial090.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T12:04:43.105 INFO:teuthology.orchestra.run.trial090.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T12:04:43.105 INFO:teuthology.orchestra.run.trial090.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T12:04:43.105 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:43.105 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:04:43.145 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-test 2026-02-17T12:04:43.460 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:04:43.496 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:04:43.496 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:04:43.544 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:04:43.544 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:04:43.544 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-17T12:04:43.544 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:04:43.545 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:04:43.545 INFO:teuthology.orchestra.run.trial090.stdout: ceph-test x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 50 M 2026-02-17T12:04:43.545 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-17T12:04:43.545 INFO:teuthology.orchestra.run.trial090.stdout: libcephsqlite x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 163 k 2026-02-17T12:04:43.545 INFO:teuthology.orchestra.run.trial090.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T12:04:43.545 INFO:teuthology.orchestra.run.trial090.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T12:04:43.545 INFO:teuthology.orchestra.run.trial090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T12:04:43.545 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:43.546 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:04:43.546 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:04:43.546 INFO:teuthology.orchestra.run.trial090.stdout:Install 5 Packages 2026-02-17T12:04:43.546 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:43.546 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 50 M 2026-02-17T12:04:43.546 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 212 M 2026-02-17T12:04:43.546 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:04:43.715 INFO:teuthology.orchestra.run.trial090.stdout:(1/5): libcephsqlite-19.2.3-675.g3c96dfb3.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T12:04:43.716 INFO:teuthology.orchestra.run.trial090.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 2.7 MB/s | 233 kB 00:00 2026-02-17T12:04:43.738 INFO:teuthology.orchestra.run.trial090.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-17T12:04:43.801 INFO:teuthology.orchestra.run.trial090.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 3.5 MB/s | 303 kB 00:00 2026-02-17T12:04:43.934 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:04:43.936 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-17T12:04:43.967 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-17T12:04:43.972 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-17T12:04:43.993 INFO:teuthology.orchestra.run.trial198.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-17T12:04:44.004 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-17T12:04:44.009 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-17T12:04:44.042 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-17T12:04:44.052 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-17T12:04:44.057 INFO:teuthology.orchestra.run.trial198.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-17T12:04:44.059 INFO:teuthology.orchestra.run.trial198.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-17T12:04:44.064 INFO:teuthology.orchestra.run.trial198.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-17T12:04:44.087 INFO:teuthology.orchestra.run.trial198.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-17T12:04:44.099 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-17T12:04:44.102 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-17T12:04:44.108 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-17T12:04:44.110 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-17T12:04:44.121 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T12:04:44.127 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-17T12:04:44.151 INFO:teuthology.orchestra.run.trial198.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-17T12:04:44.155 INFO:teuthology.orchestra.run.trial198.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-17T12:04:44.162 INFO:teuthology.orchestra.run.trial198.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-17T12:04:44.186 INFO:teuthology.orchestra.run.trial198.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-17T12:04:44.237 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-17T12:04:44.250 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-17T12:04:44.252 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-17T12:04:44.257 INFO:teuthology.orchestra.run.trial198.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-17T12:04:44.262 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-17T12:04:44.267 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-17T12:04:44.270 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-17T12:04:44.284 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-17T12:04:44.305 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-17T12:04:44.310 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-17T12:04:44.315 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-17T12:04:44.326 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-17T12:04:44.335 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-17T12:04:44.341 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-17T12:04:44.361 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-17T12:04:44.370 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-17T12:04:44.424 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-17T12:04:44.436 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-17T12:04:44.452 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-17T12:04:44.457 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-17T12:04:44.464 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-17T12:04:44.504 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-17T12:04:44.684 INFO:teuthology.orchestra.run.trial090.stdout:(5/5): ceph-test-19.2.3-675.g3c96dfb3.el9.x86_6 47 MB/s | 50 MB 00:01 2026-02-17T12:04:44.686 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:44.686 INFO:teuthology.orchestra.run.trial090.stdout:Total 44 MB/s | 50 MB 00:01 2026-02-17T12:04:44.713 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:04:44.722 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:04:44.722 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:04:44.830 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-17T12:04:44.840 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-17T12:04:44.844 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-17T12:04:44.850 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-17T12:04:44.852 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-17T12:04:44.879 INFO:teuthology.orchestra.run.trial198.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-17T12:04:44.907 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:04:44.907 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:04:44.923 INFO:teuthology.orchestra.run.trial198.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-17T12:04:44.929 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-17T12:04:44.933 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-17T12:04:44.939 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-17T12:04:44.942 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-17T12:04:44.950 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-17T12:04:44.953 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-17T12:04:44.981 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-17T12:04:44.991 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-17T12:04:45.025 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-17T12:04:45.118 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:04:45.124 INFO:teuthology.orchestra.run.trial090.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T12:04:45.129 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T12:04:45.137 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T12:04:45.138 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T12:04:45.250 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 61/98 2026-02-17T12:04:45.274 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-17T12:04:45.278 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-17T12:04:45.336 INFO:teuthology.orchestra.run.trial198.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-17T12:04:45.338 INFO:teuthology.orchestra.run.trial198.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-17T12:04:45.359 INFO:teuthology.orchestra.run.trial198.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-17T12:04:45.685 INFO:teuthology.orchestra.run.trial198.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-17T12:04:45.759 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-17T12:04:46.433 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-17T12:04:46.452 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-17T12:04:46.465 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-17T12:04:46.481 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-17T12:04:46.556 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-17T12:04:46.565 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-17T12:04:46.588 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-17T12:04:46.618 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-17T12:04:46.669 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-17T12:04:46.675 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-17T12:04:46.679 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-17T12:04:46.680 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-17T12:04:46.697 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T12:04:46.698 INFO:teuthology.orchestra.run.trial198.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T12:04:46.698 INFO:teuthology.orchestra.run.trial198.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T12:04:46.698 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:46.705 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T12:04:46.731 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T12:04:46.731 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T12:04:46.731 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:46.766 INFO:teuthology.orchestra.run.trial198.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-17T12:04:46.829 INFO:teuthology.orchestra.run.trial198.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 83/98 2026-02-17T12:04:46.832 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 84/98 2026-02-17T12:04:46.845 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 84/98 2026-02-17T12:04:46.845 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:46.846 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T12:04:46.846 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:47.389 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/5 2026-02-17T12:04:47.408 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T12:04:47.544 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 85/98 2026-02-17T12:04:47.570 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 85/98 2026-02-17T12:04:47.570 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:47.570 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T12:04:47.570 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T12:04:47.571 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T12:04:47.571 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:47.626 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 86/98 2026-02-17T12:04:47.628 INFO:teuthology.orchestra.run.trial198.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 86/98 2026-02-17T12:04:47.633 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 87/98 2026-02-17T12:04:47.636 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/5 2026-02-17T12:04:47.636 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/5 2026-02-17T12:04:47.636 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/5 2026-02-17T12:04:47.636 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T12:04:47.636 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T12:04:47.653 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 88/98 2026-02-17T12:04:47.654 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 89/98 2026-02-17T12:04:47.688 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T12:04:47.688 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:47.688 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:04:47.688 INFO:teuthology.orchestra.run.trial090.stdout: ceph-test-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:47.688 INFO:teuthology.orchestra.run.trial090.stdout: libcephsqlite-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:47.688 INFO:teuthology.orchestra.run.trial090.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T12:04:47.689 INFO:teuthology.orchestra.run.trial090.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T12:04:47.689 INFO:teuthology.orchestra.run.trial090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T12:04:47.689 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:47.689 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:04:47.720 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph 2026-02-17T12:04:48.028 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:17 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:04:48.114 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:04:48.117 INFO:teuthology.orchestra.run.trial090.stdout:====================================================================================== 2026-02-17T12:04:48.117 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-17T12:04:48.117 INFO:teuthology.orchestra.run.trial090.stdout:====================================================================================== 2026-02-17T12:04:48.117 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:04:48.117 INFO:teuthology.orchestra.run.trial090.stdout: ceph x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 6.5 k 2026-02-17T12:04:48.117 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: ceph-grafana-dashboards noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 31 k 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mds x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 2.4 M 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.1 M 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-modules-core noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 253 k 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mon x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 4.7 M 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 17 M 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: ceph-prometheus-alerts noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 17 k 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 769 k 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T12:04:48.118 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T12:04:48.119 INFO:teuthology.orchestra.run.trial090.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T12:04:48.120 INFO:teuthology.orchestra.run.trial090.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T12:04:48.121 INFO:teuthology.orchestra.run.trial090.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T12:04:48.122 INFO:teuthology.orchestra.run.trial090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T12:04:48.123 INFO:teuthology.orchestra.run.trial090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T12:04:48.124 INFO:teuthology.orchestra.run.trial090.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout:Installing weak dependencies: 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-cephadm noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 150 k 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-dashboard noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 3.8 M 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 7.4 M 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 22 k 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-rook noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 49 k 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout: ceph-volume noarch 2:19.2.3-675.g3c96dfb3.el9 ceph-noarch 299 k 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:04:48.125 INFO:teuthology.orchestra.run.trial090.stdout:====================================================================================== 2026-02-17T12:04:48.126 INFO:teuthology.orchestra.run.trial090.stdout:Install 98 Packages 2026-02-17T12:04:48.126 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:48.126 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 95 M 2026-02-17T12:04:48.127 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 519 M 2026-02-17T12:04:48.127 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:04:48.145 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 89/98 2026-02-17T12:04:48.148 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 90/98 2026-02-17T12:04:48.600 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 90/98 2026-02-17T12:04:48.601 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 91/98 2026-02-17T12:04:48.614 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 91/98 2026-02-17T12:04:48.614 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 92/98 2026-02-17T12:04:48.669 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 92/98 2026-02-17T12:04:48.719 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 93/98 2026-02-17T12:04:48.720 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 94/98 2026-02-17T12:04:48.742 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 94/98 2026-02-17T12:04:48.742 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:48.743 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T12:04:48.743 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T12:04:48.743 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T12:04:48.743 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:48.747 INFO:teuthology.orchestra.run.trial090.stdout:(1/98): ceph-19.2.3-675.g3c96dfb3.el9.x86_64.rp 129 kB/s | 6.5 kB 00:00 2026-02-17T12:04:48.754 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 95/98 2026-02-17T12:04:48.835 INFO:teuthology.orchestra.run.trial090.stdout:(2/98): ceph-mgr-19.2.3-675.g3c96dfb3.el9.x86_6 7.8 MB/s | 1.1 MB 00:00 2026-02-17T12:04:48.866 INFO:teuthology.orchestra.run.trial090.stdout:(3/98): ceph-mds-19.2.3-675.g3c96dfb3.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-17T12:04:48.897 INFO:teuthology.orchestra.run.trial090.stdout:(4/98): ceph-grafana-dashboards-19.2.3-675.g3c9 1.0 MB/s | 31 kB 00:00 2026-02-17T12:04:48.932 INFO:teuthology.orchestra.run.trial090.stdout:(5/98): ceph-mgr-cephadm-19.2.3-675.g3c96dfb3.e 4.1 MB/s | 150 kB 00:00 2026-02-17T12:04:48.970 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 95/98 2026-02-17T12:04:48.972 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 96/98 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 96/98 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T12:04:48.993 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T12:04:48.994 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T12:04:48.994 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:49.008 INFO:teuthology.orchestra.run.trial090.stdout:(6/98): ceph-mon-19.2.3-675.g3c96dfb3.el9.x86_6 18 MB/s | 4.7 MB 00:00 2026-02-17T12:04:49.095 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/98 2026-02-17T12:04:49.115 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/98 2026-02-17T12:04:49.115 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:49.115 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T12:04:49.115 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T12:04:49.115 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T12:04:49.116 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:49.124 INFO:teuthology.orchestra.run.trial090.stdout:(7/98): ceph-mgr-dashboard-19.2.3-675.g3c96dfb3 20 MB/s | 3.8 MB 00:00 2026-02-17T12:04:49.134 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/98 2026-02-17T12:04:49.165 INFO:teuthology.orchestra.run.trial090.stdout:(8/98): ceph-mgr-k8sevents-19.2.3-675.g3c96dfb3 536 kB/s | 22 kB 00:00 2026-02-17T12:04:49.213 INFO:teuthology.orchestra.run.trial090.stdout:(9/98): ceph-mgr-modules-core-19.2.3-675.g3c96d 5.2 MB/s | 253 kB 00:00 2026-02-17T12:04:49.258 INFO:teuthology.orchestra.run.trial090.stdout:(10/98): ceph-mgr-rook-19.2.3-675.g3c96dfb3.el9 1.1 MB/s | 49 kB 00:00 2026-02-17T12:04:49.305 INFO:teuthology.orchestra.run.trial090.stdout:(11/98): ceph-prometheus-alerts-19.2.3-675.g3c9 354 kB/s | 17 kB 00:00 2026-02-17T12:04:49.342 INFO:teuthology.orchestra.run.trial090.stdout:(12/98): ceph-mgr-diskprediction-local-19.2.3-6 22 MB/s | 7.4 MB 00:00 2026-02-17T12:04:49.343 INFO:teuthology.orchestra.run.trial090.stdout:(13/98): ceph-volume-19.2.3-675.g3c96dfb3.el9.n 7.8 MB/s | 299 kB 00:00 2026-02-17T12:04:49.383 INFO:teuthology.orchestra.run.trial090.stdout:(14/98): cephadm-19.2.3-675.g3c96dfb3.el9.noarc 18 MB/s | 769 kB 00:00 2026-02-17T12:04:49.419 INFO:teuthology.orchestra.run.trial090.stdout:(15/98): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.1 MB/s | 40 kB 00:00 2026-02-17T12:04:49.420 INFO:teuthology.orchestra.run.trial090.stdout:(16/98): cryptsetup-2.8.1-2.el9.x86_64.rpm 4.4 MB/s | 350 kB 00:00 2026-02-17T12:04:49.451 INFO:teuthology.orchestra.run.trial090.stdout:(17/98): ceph-osd-19.2.3-675.g3c96dfb3.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T12:04:49.453 INFO:teuthology.orchestra.run.trial090.stdout:(18/98): libconfig-1.7.2-9.el9.x86_64.rpm 2.1 MB/s | 72 kB 00:00 2026-02-17T12:04:49.454 INFO:teuthology.orchestra.run.trial090.stdout:(19/98): libgfortran-11.5.0-14.el9.x86_64.rpm 23 MB/s | 794 kB 00:00 2026-02-17T12:04:49.477 INFO:teuthology.orchestra.run.trial090.stdout:(20/98): libquadmath-11.5.0-14.el9.x86_64.rpm 7.4 MB/s | 184 kB 00:00 2026-02-17T12:04:49.482 INFO:teuthology.orchestra.run.trial090.stdout:(21/98): python3-cffi-1.14.5-5.el9.x86_64.rpm 8.7 MB/s | 253 kB 00:00 2026-02-17T12:04:49.486 INFO:teuthology.orchestra.run.trial090.stdout:(22/98): python3-cryptography-36.0.1-5.el9.x86_ 39 MB/s | 1.2 MB 00:00 2026-02-17T12:04:49.500 INFO:teuthology.orchestra.run.trial090.stdout:(23/98): python3-ply-3.11-14.el9.noarch.rpm 4.5 MB/s | 106 kB 00:00 2026-02-17T12:04:49.509 INFO:teuthology.orchestra.run.trial090.stdout:(24/98): python3-pycparser-2.20-6.el9.noarch.rp 5.2 MB/s | 135 kB 00:00 2026-02-17T12:04:49.512 INFO:teuthology.orchestra.run.trial090.stdout:(25/98): python3-requests-2.25.1-10.el9.noarch. 4.8 MB/s | 126 kB 00:00 2026-02-17T12:04:49.528 INFO:teuthology.orchestra.run.trial090.stdout:(26/98): python3-urllib3-1.26.5-7.el9.noarch.rp 7.7 MB/s | 218 kB 00:00 2026-02-17T12:04:49.537 INFO:teuthology.orchestra.run.trial090.stdout:(27/98): zip-3.0-35.el9.x86_64.rpm 10 MB/s | 266 kB 00:00 2026-02-17T12:04:49.538 INFO:teuthology.orchestra.run.trial090.stdout:(28/98): unzip-6.0-59.el9.x86_64.rpm 6.0 MB/s | 182 kB 00:00 2026-02-17T12:04:49.636 INFO:teuthology.orchestra.run.trial090.stdout:(29/98): flexiblas-3.0.4-9.el9.x86_64.rpm 275 kB/s | 30 kB 00:00 2026-02-17T12:04:49.642 INFO:teuthology.orchestra.run.trial090.stdout:(30/98): flexiblas-openblas-openmp-3.0.4-9.el9. 143 kB/s | 15 kB 00:00 2026-02-17T12:04:49.709 INFO:teuthology.orchestra.run.trial090.stdout:(31/98): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2026-02-17T12:04:49.712 INFO:teuthology.orchestra.run.trial090.stdout:(32/98): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.1 MB/s | 246 kB 00:00 2026-02-17T12:04:49.739 INFO:teuthology.orchestra.run.trial090.stdout:(33/98): openblas-0.3.29-1.el9.x86_64.rpm 1.4 MB/s | 42 kB 00:00 2026-02-17T12:04:49.778 INFO:teuthology.orchestra.run.trial090.stdout:(34/98): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 12 MB/s | 3.0 MB 00:00 2026-02-17T12:04:49.784 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/98 2026-02-17T12:04:49.784 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/98 2026-02-17T12:04:49.784 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/98 2026-02-17T12:04:49.784 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/98 2026-02-17T12:04:49.784 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/98 2026-02-17T12:04:49.784 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/98 2026-02-17T12:04:49.784 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/98 2026-02-17T12:04:49.784 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/98 2026-02-17T12:04:49.784 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-17T12:04:49.785 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-17T12:04:49.786 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 38/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-17T12:04:49.788 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-17T12:04:49.789 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-17T12:04:49.790 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-17T12:04:49.821 INFO:teuthology.orchestra.run.trial090.stdout:(35/98): protobuf-3.14.0-17.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2026-02-17T12:04:49.854 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-17T12:04:49.855 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:49.855 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:04:49.855 INFO:teuthology.orchestra.run.trial198.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T12:04:49.855 INFO:teuthology.orchestra.run.trial198.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:49.855 INFO:teuthology.orchestra.run.trial198.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:49.855 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:49.855 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:49.856 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:49.856 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:49.856 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:49.856 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:49.856 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:49.856 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:49.856 INFO:teuthology.orchestra.run.trial198.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:49.856 INFO:teuthology.orchestra.run.trial198.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:49.856 INFO:teuthology.orchestra.run.trial198.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:49.856 INFO:teuthology.orchestra.run.trial198.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:49.857 INFO:teuthology.orchestra.run.trial198.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:49.857 INFO:teuthology.orchestra.run.trial198.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T12:04:49.857 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T12:04:49.857 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T12:04:49.857 INFO:teuthology.orchestra.run.trial198.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T12:04:49.857 INFO:teuthology.orchestra.run.trial198.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T12:04:49.857 INFO:teuthology.orchestra.run.trial198.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T12:04:49.857 INFO:teuthology.orchestra.run.trial198.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T12:04:49.857 INFO:teuthology.orchestra.run.trial198.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T12:04:49.858 INFO:teuthology.orchestra.run.trial198.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T12:04:49.859 INFO:teuthology.orchestra.run.trial198.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T12:04:49.859 INFO:teuthology.orchestra.run.trial198.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T12:04:49.859 INFO:teuthology.orchestra.run.trial198.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T12:04:49.859 INFO:teuthology.orchestra.run.trial198.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T12:04:49.859 INFO:teuthology.orchestra.run.trial198.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T12:04:49.859 INFO:teuthology.orchestra.run.trial198.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T12:04:49.859 INFO:teuthology.orchestra.run.trial198.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T12:04:49.859 INFO:teuthology.orchestra.run.trial198.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T12:04:49.859 INFO:teuthology.orchestra.run.trial198.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T12:04:49.859 INFO:teuthology.orchestra.run.trial198.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T12:04:49.860 INFO:teuthology.orchestra.run.trial198.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T12:04:49.861 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T12:04:49.862 INFO:teuthology.orchestra.run.trial198.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T12:04:49.862 INFO:teuthology.orchestra.run.trial198.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T12:04:49.862 INFO:teuthology.orchestra.run.trial198.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T12:04:49.862 INFO:teuthology.orchestra.run.trial198.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T12:04:49.862 INFO:teuthology.orchestra.run.trial198.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T12:04:49.862 INFO:teuthology.orchestra.run.trial198.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T12:04:49.862 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T12:04:49.862 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T12:04:49.862 INFO:teuthology.orchestra.run.trial198.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T12:04:49.862 INFO:teuthology.orchestra.run.trial198.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T12:04:49.863 INFO:teuthology.orchestra.run.trial198.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: zip-3.0-35.el9.x86_64 2026-02-17T12:04:49.864 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:49.865 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:49.888 INFO:teuthology.orchestra.run.trial090.stdout:(36/98): python3-devel-3.9.25-2.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2026-02-17T12:04:49.913 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-base 2026-02-17T12:04:49.918 INFO:teuthology.orchestra.run.trial090.stdout:(37/98): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.1 MB/s | 249 kB 00:00 2026-02-17T12:04:50.023 INFO:teuthology.orchestra.run.trial090.stdout:(38/98): python3-libstoragemgmt-1.10.1-1.el9.x8 1.6 MB/s | 177 kB 00:00 2026-02-17T12:04:50.096 INFO:teuthology.orchestra.run.trial090.stdout:(39/98): python3-lxml-4.6.5-3.el9.x86_64.rpm 17 MB/s | 1.2 MB 00:00 2026-02-17T12:04:50.103 INFO:teuthology.orchestra.run.trial090.stdout:(40/98): openblas-openmp-0.3.29-1.el9.x86_64.rp 14 MB/s | 5.3 MB 00:00 2026-02-17T12:04:50.137 INFO:teuthology.orchestra.run.trial090.stdout:(41/98): python3-markupsafe-1.1.1-12.el9.x86_64 1.0 MB/s | 35 kB 00:00 2026-02-17T12:04:50.154 INFO:teuthology.orchestra.run.trial090.stdout:(42/98): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2026-02-17T12:04:50.171 INFO:teuthology.orchestra.run.trial090.stdout:(43/98): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2026-02-17T12:04:50.195 INFO:teuthology.orchestra.run.trial090.stdout:(44/98): python3-packaging-20.9-5.el9.noarch.rp 3.2 MB/s | 77 kB 00:00 2026-02-17T12:04:50.201 INFO:teuthology.orchestra.run.trial090.stdout:(45/98): python3-numpy-f2py-1.23.5-2.el9.x86_64 9.2 MB/s | 442 kB 00:00 2026-02-17T12:04:50.219 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:50.241 INFO:teuthology.orchestra.run.trial090.stdout:(46/98): python3-protobuf-3.14.0-17.el9.noarch. 5.7 MB/s | 267 kB 00:00 2026-02-17T12:04:50.258 INFO:teuthology.orchestra.run.trial090.stdout:(47/98): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2026-02-17T12:04:50.284 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:04:50.294 INFO:teuthology.orchestra.run.trial090.stdout:(48/98): python3-requests-oauthlib-1.3.0-12.el9 1.4 MB/s | 54 kB 00:00 2026-02-17T12:04:50.301 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:50.302 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:50.302 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:50.318 INFO:teuthology.orchestra.run.trial090.stdout:(49/98): python3-pyasn1-modules-0.4.8-6.el9.noa 3.5 MB/s | 279 kB 00:00 2026-02-17T12:04:50.323 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install cephadm 2026-02-17T12:04:50.342 INFO:teuthology.orchestra.run.trial090.stdout:(50/98): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-17T12:04:50.366 INFO:teuthology.orchestra.run.trial090.stdout:(51/98): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.8 MB/s | 189 kB 00:00 2026-02-17T12:04:50.389 INFO:teuthology.orchestra.run.trial090.stdout:(52/98): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.8 MB/s | 90 kB 00:00 2026-02-17T12:04:50.411 INFO:teuthology.orchestra.run.trial090.stdout:(53/98): lua-devel-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 22 kB 00:00 2026-02-17T12:04:50.436 INFO:teuthology.orchestra.run.trial090.stdout:(54/98): protobuf-compiler-3.14.0-17.el9.x86_64 34 MB/s | 862 kB 00:00 2026-02-17T12:04:50.490 INFO:teuthology.orchestra.run.trial090.stdout:(55/98): python3-numpy-1.23.5-2.el9.x86_64.rpm 17 MB/s | 6.1 MB 00:00 2026-02-17T12:04:50.633 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:50.698 INFO:teuthology.orchestra.run.trial198.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:04:50.715 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:50.716 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:50.716 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:50.737 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T12:04:50.741 INFO:teuthology.orchestra.run.trial090.stdout:(56/98): grpc-data-1.46.7-10.el9.noarch.rpm 77 kB/s | 19 kB 00:00 2026-02-17T12:04:50.950 INFO:teuthology.orchestra.run.trial090.stdout:(57/98): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-17T12:04:50.955 INFO:teuthology.orchestra.run.trial090.stdout:(58/98): luarocks-3.9.2-5.el9.noarch.rpm 706 kB/s | 151 kB 00:00 2026-02-17T12:04:51.024 INFO:teuthology.orchestra.run.trial090.stdout:(59/98): python3-autocommand-2.2.2-8.el9.noarch 431 kB/s | 29 kB 00:00 2026-02-17T12:04:51.049 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:51.052 INFO:teuthology.orchestra.run.trial090.stdout:(60/98): python3-asyncssh-2.13.2-5.el9.noarch.r 5.3 MB/s | 548 kB 00:00 2026-02-17T12:04:51.100 INFO:teuthology.orchestra.run.trial090.stdout:(61/98): python3-backports-tarfile-1.2.0-1.el9. 795 kB/s | 60 kB 00:00 2026-02-17T12:04:51.115 INFO:teuthology.orchestra.run.trial090.stdout:(62/98): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 689 kB/s | 43 kB 00:00 2026-02-17T12:04:51.130 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:51.131 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:51.131 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repo Size 2026-02-17T12:04:51.131 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:51.131 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:04:51.131 INFO:teuthology.orchestra.run.trial198.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T12:04:51.131 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:51.131 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:04:51.131 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:51.132 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T12:04:51.132 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:51.132 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 145 k 2026-02-17T12:04:51.132 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 431 k 2026-02-17T12:04:51.132 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:04:51.168 INFO:teuthology.orchestra.run.trial090.stdout:(63/98): python3-cachetools-4.2.4-1.el9.noarch. 470 kB/s | 32 kB 00:00 2026-02-17T12:04:51.176 INFO:teuthology.orchestra.run.trial090.stdout:(64/98): python3-certifi-2023.05.07-4.el9.noarc 230 kB/s | 14 kB 00:00 2026-02-17T12:04:51.217 INFO:teuthology.orchestra.run.trial198.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.7 MB/s | 145 kB 00:00 2026-02-17T12:04:51.218 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:51.218 INFO:teuthology.orchestra.run.trial198.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T12:04:51.218 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:04:51.221 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:04:51.221 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:04:51.252 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:04:51.253 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:04:51.259 INFO:teuthology.orchestra.run.trial090.stdout:(65/98): python3-cherrypy-18.6.1-2.el9.noarch.r 4.2 MB/s | 358 kB 00:00 2026-02-17T12:04:51.272 INFO:teuthology.orchestra.run.trial090.stdout:(66/98): python3-cheroot-10.0.1-4.el9.noarch.rp 1.6 MB/s | 173 kB 00:00 2026-02-17T12:04:51.308 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:04:51.309 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:04:51.332 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:04:51.332 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:51.332 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T12:04:51.332 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:51.336 INFO:teuthology.orchestra.run.trial090.stdout:(67/98): python3-google-auth-2.45.0-1.el9.noarc 3.2 MB/s | 254 kB 00:00 2026-02-17T12:04:51.406 INFO:teuthology.orchestra.run.trial090.stdout:(68/98): python3-grpcio-tools-1.46.7-10.el9.x86 2.0 MB/s | 144 kB 00:00 2026-02-17T12:04:51.475 INFO:teuthology.orchestra.run.trial090.stdout:(69/98): python3-influxdb-5.3.1-1.el9.noarch.rp 2.0 MB/s | 139 kB 00:00 2026-02-17T12:04:51.545 INFO:teuthology.orchestra.run.trial090.stdout:(70/98): python3-isodate-0.6.1-3.el9.noarch.rpm 805 kB/s | 56 kB 00:00 2026-02-17T12:04:51.549 INFO:teuthology.orchestra.run.trial090.stdout:(71/98): python3-grpcio-1.46.7-10.el9.x86_64.rp 7.4 MB/s | 2.0 MB 00:00 2026-02-17T12:04:51.606 INFO:teuthology.orchestra.run.trial090.stdout:(72/98): python3-jaraco-8.2.1-3.el9.noarch.rpm 175 kB/s | 11 kB 00:00 2026-02-17T12:04:51.610 INFO:teuthology.orchestra.run.trial090.stdout:(73/98): python3-jaraco-classes-3.2.1-5.el9.noa 290 kB/s | 18 kB 00:00 2026-02-17T12:04:51.627 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:04:51.627 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:51.628 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:04:51.628 INFO:teuthology.orchestra.run.trial198.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:51.628 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:51.628 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:51.656 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-mgr 2026-02-17T12:04:51.667 INFO:teuthology.orchestra.run.trial090.stdout:(74/98): python3-jaraco-collections-3.0.0-8.el9 377 kB/s | 23 kB 00:00 2026-02-17T12:04:51.671 INFO:teuthology.orchestra.run.trial090.stdout:(75/98): python3-jaraco-context-6.0.1-3.el9.noa 322 kB/s | 20 kB 00:00 2026-02-17T12:04:51.729 INFO:teuthology.orchestra.run.trial090.stdout:(76/98): python3-jaraco-functools-3.5.0-2.el9.n 317 kB/s | 19 kB 00:00 2026-02-17T12:04:51.732 INFO:teuthology.orchestra.run.trial090.stdout:(77/98): python3-jaraco-text-4.0.0-2.el9.noarch 433 kB/s | 26 kB 00:00 2026-02-17T12:04:51.799 INFO:teuthology.orchestra.run.trial090.stdout:(78/98): python3-scipy-1.9.3-2.el9.x86_64.rpm 13 MB/s | 19 MB 00:01 2026-02-17T12:04:51.800 INFO:teuthology.orchestra.run.trial090.stdout:(79/98): python3-logutils-0.3.5-21.el9.noarch.r 689 kB/s | 46 kB 00:00 2026-02-17T12:04:51.865 INFO:teuthology.orchestra.run.trial090.stdout:(80/98): python3-kubernetes-26.1.0-3.el9.noarch 7.5 MB/s | 1.0 MB 00:00 2026-02-17T12:04:51.865 INFO:teuthology.orchestra.run.trial090.stdout:(81/98): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2026-02-17T12:04:51.927 INFO:teuthology.orchestra.run.trial090.stdout:(82/98): python3-natsort-7.1.1-5.el9.noarch.rpm 931 kB/s | 58 kB 00:00 2026-02-17T12:04:51.931 INFO:teuthology.orchestra.run.trial090.stdout:(83/98): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2026-02-17T12:04:51.968 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:51.988 INFO:teuthology.orchestra.run.trial090.stdout:(84/98): python3-portend-3.1.0-2.el9.noarch.rpm 269 kB/s | 16 kB 00:00 2026-02-17T12:04:51.995 INFO:teuthology.orchestra.run.trial090.stdout:(85/98): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.4 MB/s | 90 kB 00:00 2026-02-17T12:04:52.033 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:04:52.049 INFO:teuthology.orchestra.run.trial090.stdout:(86/98): python3-repoze-lru-0.7-16.el9.noarch.r 503 kB/s | 31 kB 00:00 2026-02-17T12:04:52.050 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:52.051 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:52.051 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:52.059 INFO:teuthology.orchestra.run.trial090.stdout:(87/98): python3-routes-2.5.1-5.el9.noarch.rpm 2.9 MB/s | 188 kB 00:00 2026-02-17T12:04:52.072 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T12:04:52.111 INFO:teuthology.orchestra.run.trial090.stdout:(88/98): python3-rsa-4.9-2.el9.noarch.rpm 954 kB/s | 59 kB 00:00 2026-02-17T12:04:52.121 INFO:teuthology.orchestra.run.trial090.stdout:(89/98): python3-saml-1.16.0-1.el9.noarch.rpm 2.0 MB/s | 125 kB 00:00 2026-02-17T12:04:52.135 INFO:teuthology.orchestra.run.trial090.stdout:(90/98): python3-more-itertools-8.12.0-2.el9.no 234 kB/s | 79 kB 00:00 2026-02-17T12:04:52.172 INFO:teuthology.orchestra.run.trial090.stdout:(91/98): python3-tempora-5.0.0-2.el9.noarch.rpm 584 kB/s | 36 kB 00:00 2026-02-17T12:04:52.184 INFO:teuthology.orchestra.run.trial090.stdout:(92/98): python3-typing-extensions-4.15.0-1.el9 1.4 MB/s | 86 kB 00:00 2026-02-17T12:04:52.235 INFO:teuthology.orchestra.run.trial090.stdout:(93/98): python3-websocket-client-1.2.3-2.el9.n 1.4 MB/s | 90 kB 00:00 2026-02-17T12:04:52.253 INFO:teuthology.orchestra.run.trial090.stdout:(94/98): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.0 MB/s | 427 kB 00:00 2026-02-17T12:04:52.296 INFO:teuthology.orchestra.run.trial090.stdout:(95/98): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 790 kB/s | 48 kB 00:00 2026-02-17T12:04:52.315 INFO:teuthology.orchestra.run.trial090.stdout:(96/98): python3-xmltodict-0.12.0-15.el9.noarch 363 kB/s | 22 kB 00:00 2026-02-17T12:04:52.318 INFO:teuthology.orchestra.run.trial090.stdout:(97/98): python3-webob-1.8.8-2.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2026-02-17T12:04:52.358 INFO:teuthology.orchestra.run.trial090.stdout:(98/98): python3-zc-lockfile-2.0-10.el9.noarch. 321 kB/s | 20 kB 00:00 2026-02-17T12:04:52.364 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:52.364 INFO:teuthology.orchestra.run.trial090.stdout:Total 22 MB/s | 95 MB 00:04 2026-02-17T12:04:52.390 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:52.454 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:04:52.472 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:52.472 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:52.472 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:52.495 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T12:04:52.779 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:04:52.807 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:52.816 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:04:52.817 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:04:52.873 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:04:52.890 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:52.891 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:52.891 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:52.913 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-mgr-rook 2026-02-17T12:04:53.220 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:53.236 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:04:53.236 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:04:53.287 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:04:53.304 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:53.305 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:53.305 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:53.326 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T12:04:53.644 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:53.679 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:04:53.681 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/98 2026-02-17T12:04:53.709 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:04:53.712 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/98 2026-02-17T12:04:53.717 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/98 2026-02-17T12:04:53.727 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:53.727 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:53.727 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:53.739 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/98 2026-02-17T12:04:53.749 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-fuse 2026-02-17T12:04:53.750 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/98 2026-02-17T12:04:53.755 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 6/98 2026-02-17T12:04:53.788 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 7/98 2026-02-17T12:04:53.797 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 8/98 2026-02-17T12:04:53.803 INFO:teuthology.orchestra.run.trial090.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 9/98 2026-02-17T12:04:53.805 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lua-5.4.4-4.el9.x86_64 10/98 2026-02-17T12:04:53.810 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 11/98 2026-02-17T12:04:53.833 INFO:teuthology.orchestra.run.trial090.stdout: Installing : unzip-6.0-59.el9.x86_64 12/98 2026-02-17T12:04:53.845 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 13/98 2026-02-17T12:04:53.848 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 14/98 2026-02-17T12:04:53.854 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 15/98 2026-02-17T12:04:53.856 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 16/98 2026-02-17T12:04:53.867 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T12:04:53.873 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 18/98 2026-02-17T12:04:53.898 INFO:teuthology.orchestra.run.trial090.stdout: Installing : zip-3.0-35.el9.x86_64 19/98 2026-02-17T12:04:53.901 INFO:teuthology.orchestra.run.trial090.stdout: Installing : luarocks-3.9.2-5.el9.noarch 20/98 2026-02-17T12:04:53.908 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 21/98 2026-02-17T12:04:53.932 INFO:teuthology.orchestra.run.trial090.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 22/98 2026-02-17T12:04:53.984 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 23/98 2026-02-17T12:04:53.996 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 24/98 2026-02-17T12:04:53.999 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 25/98 2026-02-17T12:04:54.003 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 26/98 2026-02-17T12:04:54.009 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 27/98 2026-02-17T12:04:54.013 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 28/98 2026-02-17T12:04:54.016 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 29/98 2026-02-17T12:04:54.031 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 30/98 2026-02-17T12:04:54.052 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 31/98 2026-02-17T12:04:54.056 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 32/98 2026-02-17T12:04:54.062 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 33/98 2026-02-17T12:04:54.067 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:54.073 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 34/98 2026-02-17T12:04:54.082 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 35/98 2026-02-17T12:04:54.089 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 36/98 2026-02-17T12:04:54.108 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 37/98 2026-02-17T12:04:54.117 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 38/98 2026-02-17T12:04:54.152 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:54.153 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:54.153 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-17T12:04:54.153 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:54.153 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:04:54.153 INFO:teuthology.orchestra.run.trial198.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T12:04:54.154 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:54.154 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:04:54.154 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:54.154 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T12:04:54.154 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:54.154 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 1.2 M 2026-02-17T12:04:54.154 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 3.6 M 2026-02-17T12:04:54.154 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:04:54.171 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 39/98 2026-02-17T12:04:54.183 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 40/98 2026-02-17T12:04:54.199 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 41/98 2026-02-17T12:04:54.203 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 42/98 2026-02-17T12:04:54.211 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 43/98 2026-02-17T12:04:54.251 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/98 2026-02-17T12:04:54.577 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 45/98 2026-02-17T12:04:54.587 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 46/98 2026-02-17T12:04:54.591 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 47/98 2026-02-17T12:04:54.597 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 48/98 2026-02-17T12:04:54.599 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 49/98 2026-02-17T12:04:54.626 INFO:teuthology.orchestra.run.trial090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 50/98 2026-02-17T12:04:54.670 INFO:teuthology.orchestra.run.trial090.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 51/98 2026-02-17T12:04:54.677 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 52/98 2026-02-17T12:04:54.680 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 53/98 2026-02-17T12:04:54.686 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 54/98 2026-02-17T12:04:54.689 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 55/98 2026-02-17T12:04:54.697 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 56/98 2026-02-17T12:04:54.700 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 57/98 2026-02-17T12:04:54.728 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 58/98 2026-02-17T12:04:54.738 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 59/98 2026-02-17T12:04:54.773 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 60/98 2026-02-17T12:04:54.820 INFO:teuthology.orchestra.run.trial198.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2026-02-17T12:04:54.821 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:54.822 INFO:teuthology.orchestra.run.trial198.stdout:Total 1.7 MB/s | 1.2 MB 00:00 2026-02-17T12:04:54.822 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:04:54.826 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:04:54.826 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:04:54.860 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:04:54.861 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:04:54.962 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:04:54.979 INFO:teuthology.orchestra.run.trial198.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:04:55.001 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 61/98 2026-02-17T12:04:55.025 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 62/98 2026-02-17T12:04:55.029 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 63/98 2026-02-17T12:04:55.088 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openblas-0.3.29-1.el9.x86_64 64/98 2026-02-17T12:04:55.090 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 65/98 2026-02-17T12:04:55.112 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 66/98 2026-02-17T12:04:55.214 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:04:55.272 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:04:55.272 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:55.272 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:04:55.272 INFO:teuthology.orchestra.run.trial198.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:55.273 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:55.273 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:55.301 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install ceph-volume 2026-02-17T12:04:55.439 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 67/98 2026-02-17T12:04:55.512 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 68/98 2026-02-17T12:04:55.613 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:55.677 INFO:teuthology.orchestra.run.trial198.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:04:55.695 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:55.696 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:55.696 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:55.717 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install librados-devel 2026-02-17T12:04:56.026 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:56.108 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:56.109 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:56.109 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repo Size 2026-02-17T12:04:56.109 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:56.109 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:04:56.109 INFO:teuthology.orchestra.run.trial198.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T12:04:56.109 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:56.109 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:04:56.109 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:56.109 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T12:04:56.110 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:56.110 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 127 k 2026-02-17T12:04:56.110 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 456 k 2026-02-17T12:04:56.110 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:04:56.185 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 69/98 2026-02-17T12:04:56.194 INFO:teuthology.orchestra.run.trial198.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 1.4 MB/s | 127 kB 00:00 2026-02-17T12:04:56.195 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:56.196 INFO:teuthology.orchestra.run.trial198.stdout:Total 1.4 MB/s | 127 kB 00:00 2026-02-17T12:04:56.196 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:04:56.198 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:04:56.198 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:04:56.203 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 70/98 2026-02-17T12:04:56.217 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ply-3.11-14.el9.noarch 71/98 2026-02-17T12:04:56.229 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:04:56.230 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:04:56.232 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 72/98 2026-02-17T12:04:56.285 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:04:56.301 INFO:teuthology.orchestra.run.trial198.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:04:56.307 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 73/98 2026-02-17T12:04:56.316 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 74/98 2026-02-17T12:04:56.340 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 75/98 2026-02-17T12:04:56.370 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 76/98 2026-02-17T12:04:56.382 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:04:56.420 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 77/98 2026-02-17T12:04:56.426 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 78/98 2026-02-17T12:04:56.430 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 79/98 2026-02-17T12:04:56.431 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 80/98 2026-02-17T12:04:56.441 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:04:56.441 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:56.441 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:04:56.441 INFO:teuthology.orchestra.run.trial198.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:56.441 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:56.442 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:56.449 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T12:04:56.449 INFO:teuthology.orchestra.run.trial090.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T12:04:56.449 INFO:teuthology.orchestra.run.trial090.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T12:04:56.449 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:56.457 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T12:04:56.471 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install libcephfs2 2026-02-17T12:04:56.483 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 81/98 2026-02-17T12:04:56.484 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T12:04:56.484 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:56.520 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 82/98 2026-02-17T12:04:56.584 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 83/98 2026-02-17T12:04:56.587 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 84/98 2026-02-17T12:04:56.601 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 84/98 2026-02-17T12:04:56.601 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:56.602 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T12:04:56.602 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:56.796 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:56.860 INFO:teuthology.orchestra.run.trial198.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:04:56.878 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:56.879 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:56.879 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:56.901 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install libcephfs-devel 2026-02-17T12:04:57.213 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:57.296 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:57.296 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:57.296 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repo Size 2026-02-17T12:04:57.296 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:57.296 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:04:57.297 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T12:04:57.297 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:57.297 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:04:57.297 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:04:57.297 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T12:04:57.297 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:57.297 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 34 k 2026-02-17T12:04:57.297 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 153 k 2026-02-17T12:04:57.297 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:04:57.312 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 85/98 2026-02-17T12:04:57.337 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 85/98 2026-02-17T12:04:57.337 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:57.337 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T12:04:57.337 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T12:04:57.337 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T12:04:57.338 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:57.359 INFO:teuthology.orchestra.run.trial198.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 539 kB/s | 34 kB 00:00 2026-02-17T12:04:57.360 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:04:57.360 INFO:teuthology.orchestra.run.trial198.stdout:Total 533 kB/s | 34 kB 00:00 2026-02-17T12:04:57.360 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:04:57.361 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:04:57.361 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:04:57.363 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:04:57.363 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:04:57.384 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:04:57.388 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 86/98 2026-02-17T12:04:57.390 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 86/98 2026-02-17T12:04:57.395 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 87/98 2026-02-17T12:04:57.400 INFO:teuthology.orchestra.run.trial198.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:04:57.414 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 88/98 2026-02-17T12:04:57.416 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 89/98 2026-02-17T12:04:57.457 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:04:57.513 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:04:57.514 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:57.514 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:04:57.514 INFO:teuthology.orchestra.run.trial198.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:57.514 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:04:57.514 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:57.542 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install librados2 2026-02-17T12:04:57.859 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:57.914 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 89/98 2026-02-17T12:04:57.917 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 90/98 2026-02-17T12:04:57.924 INFO:teuthology.orchestra.run.trial198.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:04:57.941 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:57.942 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:57.942 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:57.964 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install librbd1 2026-02-17T12:04:58.276 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:58.341 INFO:teuthology.orchestra.run.trial198.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:04:58.358 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:58.359 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:58.359 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:58.375 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 90/98 2026-02-17T12:04:58.376 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 91/98 2026-02-17T12:04:58.381 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install python3-rados 2026-02-17T12:04:58.388 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 91/98 2026-02-17T12:04:58.389 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 92/98 2026-02-17T12:04:58.444 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 92/98 2026-02-17T12:04:58.494 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 93/98 2026-02-17T12:04:58.495 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 94/98 2026-02-17T12:04:58.516 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 94/98 2026-02-17T12:04:58.516 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:58.516 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T12:04:58.516 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T12:04:58.516 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T12:04:58.516 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:58.528 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 95/98 2026-02-17T12:04:58.692 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:58.747 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 95/98 2026-02-17T12:04:58.749 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 96/98 2026-02-17T12:04:58.757 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:04:58.770 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 96/98 2026-02-17T12:04:58.770 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:58.770 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T12:04:58.770 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T12:04:58.771 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T12:04:58.771 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:58.774 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:58.775 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:58.775 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:58.797 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install python3-rgw 2026-02-17T12:04:58.873 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/98 2026-02-17T12:04:58.894 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 97/98 2026-02-17T12:04:58.894 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:04:58.894 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T12:04:58.894 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T12:04:58.895 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T12:04:58.895 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:58.912 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/98 2026-02-17T12:04:59.111 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:59.176 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:04:59.194 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:59.194 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:59.195 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:59.218 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install python3-cephfs 2026-02-17T12:04:59.534 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:04:59.599 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:04:59.601 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 98/98 2026-02-17T12:04:59.601 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/98 2026-02-17T12:04:59.601 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2/98 2026-02-17T12:04:59.601 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 3/98 2026-02-17T12:04:59.601 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 4/98 2026-02-17T12:04:59.601 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 5/98 2026-02-17T12:04:59.601 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9 6/98 2026-02-17T12:04:59.601 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 7/98 2026-02-17T12:04:59.601 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noar 8/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96df 9/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noar 10/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.n 11/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 12/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9. 13/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 14/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 15/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/98 2026-02-17T12:04:59.602 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 25/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 26/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : unzip-6.0-59.el9.x86_64 27/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : zip-3.0-35.el9.x86_64 28/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 29/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 30/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 31/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 32/98 2026-02-17T12:04:59.603 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 33/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 34/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 35/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 36/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 37/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 38/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 39/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 40/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 41/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 42/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 43/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 44/98 2026-02-17T12:04:59.604 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 45/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 46/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 47/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 48/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 49/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 50/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 51/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 52/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 53/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 54/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 55/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 56/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 57/98 2026-02-17T12:04:59.605 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 58/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 59/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 60/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 61/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 62/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 63/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 64/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 65/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 66/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 67/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 68/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 69/98 2026-02-17T12:04:59.606 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 70/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 71/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 72/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 73/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 74/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 75/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 76/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 77/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 78/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 79/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 80/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/98 2026-02-17T12:04:59.607 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 84/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 93/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 94/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 95/98 2026-02-17T12:04:59.608 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 96/98 2026-02-17T12:04:59.609 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 97/98 2026-02-17T12:04:59.617 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:04:59.617 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:04:59.617 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:04:59.639 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install python3-rbd 2026-02-17T12:04:59.665 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 98/98 2026-02-17T12:04:59.665 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:59.665 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:04:59.665 INFO:teuthology.orchestra.run.trial090.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T12:04:59.665 INFO:teuthology.orchestra.run.trial090.stdout: ceph-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:59.665 INFO:teuthology.orchestra.run.trial090.stdout: ceph-grafana-dashboards-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:59.666 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mds-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:59.666 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:59.666 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:59.666 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:59.666 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:59.666 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-k8sevents-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:59.666 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-modules-core-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:59.666 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:59.666 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mon-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: ceph-prometheus-alerts-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T12:04:59.667 INFO:teuthology.orchestra.run.trial090.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T12:04:59.668 INFO:teuthology.orchestra.run.trial090.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T12:04:59.668 INFO:teuthology.orchestra.run.trial090.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T12:04:59.668 INFO:teuthology.orchestra.run.trial090.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T12:04:59.668 INFO:teuthology.orchestra.run.trial090.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T12:04:59.668 INFO:teuthology.orchestra.run.trial090.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T12:04:59.668 INFO:teuthology.orchestra.run.trial090.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T12:04:59.668 INFO:teuthology.orchestra.run.trial090.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T12:04:59.668 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T12:04:59.668 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T12:04:59.668 INFO:teuthology.orchestra.run.trial090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T12:04:59.669 INFO:teuthology.orchestra.run.trial090.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T12:04:59.670 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T12:04:59.671 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T12:04:59.672 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T12:04:59.672 INFO:teuthology.orchestra.run.trial090.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T12:04:59.672 INFO:teuthology.orchestra.run.trial090.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T12:04:59.672 INFO:teuthology.orchestra.run.trial090.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T12:04:59.672 INFO:teuthology.orchestra.run.trial090.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T12:04:59.672 INFO:teuthology.orchestra.run.trial090.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T12:04:59.672 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T12:04:59.672 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T12:04:59.672 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T12:04:59.672 INFO:teuthology.orchestra.run.trial090.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T12:04:59.673 INFO:teuthology.orchestra.run.trial090.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout: zip-3.0-35.el9.x86_64 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:04:59.674 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:04:59.721 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-base 2026-02-17T12:04:59.948 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:05:00.012 INFO:teuthology.orchestra.run.trial198.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:05:00.030 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:05:00.030 INFO:teuthology.orchestra.run.trial198.stdout:Nothing to do. 2026-02-17T12:05:00.030 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:05:00.036 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:00.051 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install rbd-fuse 2026-02-17T12:05:00.101 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-base-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:05:00.118 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:00.119 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:00.119 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:00.140 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install cephadm 2026-02-17T12:05:00.363 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:05:00.445 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:05:00.446 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:05:00.446 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-17T12:05:00.446 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:05:00.446 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:05:00.446 INFO:teuthology.orchestra.run.trial198.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T12:05:00.447 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:00.447 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:05:00.447 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:05:00.447 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T12:05:00.447 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:00.447 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 85 k 2026-02-17T12:05:00.447 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 227 k 2026-02-17T12:05:00.447 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:05:00.449 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:00.515 INFO:teuthology.orchestra.run.trial090.stdout:Package cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:05:00.521 INFO:teuthology.orchestra.run.trial198.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T12:05:00.521 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:00.521 INFO:teuthology.orchestra.run.trial198.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T12:05:00.521 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:05:00.524 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:05:00.524 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:05:00.534 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:00.534 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:00.534 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:00.555 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T12:05:00.556 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:05:00.556 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:05:00.606 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:05:00.623 INFO:teuthology.orchestra.run.trial198.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:00.702 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:00.761 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:00.761 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:00.762 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:05:00.762 INFO:teuthology.orchestra.run.trial198.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:05:00.762 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:00.762 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:05:00.791 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install rbd-mirror 2026-02-17T12:05:00.865 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:00.948 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:00.948 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:00.948 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-17T12:05:00.948 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:00.948 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:05:00.948 INFO:teuthology.orchestra.run.trial090.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 145 k 2026-02-17T12:05:00.949 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:00.949 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:05:00.949 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:00.949 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T12:05:00.949 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:00.949 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 145 k 2026-02-17T12:05:00.949 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 431 k 2026-02-17T12:05:00.949 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:05:01.033 INFO:teuthology.orchestra.run.trial090.stdout:ceph-immutable-object-cache-19.2.3-675.g3c96dfb 1.7 MB/s | 145 kB 00:00 2026-02-17T12:05:01.034 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:01.034 INFO:teuthology.orchestra.run.trial090.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-17T12:05:01.034 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:05:01.038 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:05:01.038 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:05:01.071 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:05:01.071 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:05:01.103 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:05:01.126 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:05:01.127 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:05:01.149 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:05:01.149 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:05:01.149 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T12:05:01.149 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:01.186 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:05:01.187 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:05:01.187 INFO:teuthology.orchestra.run.trial198.stdout: Package Arch Version Repo Size 2026-02-17T12:05:01.187 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:05:01.188 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:05:01.188 INFO:teuthology.orchestra.run.trial198.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T12:05:01.188 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:01.188 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:05:01.188 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:05:01.188 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T12:05:01.188 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:01.188 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 3.1 M 2026-02-17T12:05:01.188 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 13 M 2026-02-17T12:05:01.188 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:05:01.337 INFO:teuthology.orchestra.run.trial198.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T12:05:01.337 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:01.337 INFO:teuthology.orchestra.run.trial198.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T12:05:01.337 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:05:01.341 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:05:01.341 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:05:01.382 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:05:01.382 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:05:01.454 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.e 1/1 2026-02-17T12:05:01.455 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:01.455 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:05:01.455 INFO:teuthology.orchestra.run.trial090.stdout: ceph-immutable-object-cache-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:05:01.455 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:01.455 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:01.483 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr 2026-02-17T12:05:01.578 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:05:01.580 INFO:teuthology.orchestra.run.trial198.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:01.603 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:01.603 INFO:teuthology.orchestra.run.trial198.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:05:01.603 INFO:teuthology.orchestra.run.trial198.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T12:05:01.603 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T12:05:01.603 INFO:teuthology.orchestra.run.trial198.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T12:05:01.603 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:01.797 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:01.865 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:05:01.882 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:01.883 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:01.883 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:01.894 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:01.894 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:01.894 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:05:01.894 INFO:teuthology.orchestra.run.trial198.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:05:01.894 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:01.894 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:05:01.904 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T12:05:01.923 DEBUG:teuthology.orchestra.run.trial198:> sudo yum -y install rbd-nbd 2026-02-17T12:05:02.218 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:02.236 INFO:teuthology.orchestra.run.trial198.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 12:04:21 PM UTC. 2026-02-17T12:05:02.283 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-dashboard-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:05:02.301 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:02.301 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:02.301 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:02.321 INFO:teuthology.orchestra.run.trial198.stdout:Dependencies resolved. 2026-02-17T12:05:02.322 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:05:02.322 INFO:teuthology.orchestra.run.trial198.stdout: Package Architecture Version Repository Size 2026-02-17T12:05:02.322 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:05:02.322 INFO:teuthology.orchestra.run.trial198.stdout:Installing: 2026-02-17T12:05:02.322 INFO:teuthology.orchestra.run.trial198.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T12:05:02.323 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:02.323 INFO:teuthology.orchestra.run.trial198.stdout:Transaction Summary 2026-02-17T12:05:02.323 INFO:teuthology.orchestra.run.trial198.stdout:================================================================================ 2026-02-17T12:05:02.323 INFO:teuthology.orchestra.run.trial198.stdout:Install 1 Package 2026-02-17T12:05:02.323 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:02.323 INFO:teuthology.orchestra.run.trial198.stdout:Total download size: 171 k 2026-02-17T12:05:02.323 INFO:teuthology.orchestra.run.trial198.stdout:Installed size: 490 k 2026-02-17T12:05:02.323 INFO:teuthology.orchestra.run.trial198.stdout:Downloading Packages: 2026-02-17T12:05:02.324 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T12:05:02.407 INFO:teuthology.orchestra.run.trial198.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T12:05:02.408 INFO:teuthology.orchestra.run.trial198.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:02.408 INFO:teuthology.orchestra.run.trial198.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T12:05:02.408 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction check 2026-02-17T12:05:02.412 INFO:teuthology.orchestra.run.trial198.stdout:Transaction check succeeded. 2026-02-17T12:05:02.412 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction test 2026-02-17T12:05:02.445 INFO:teuthology.orchestra.run.trial198.stdout:Transaction test succeeded. 2026-02-17T12:05:02.445 INFO:teuthology.orchestra.run.trial198.stdout:Running transaction 2026-02-17T12:05:02.501 INFO:teuthology.orchestra.run.trial198.stdout: Preparing : 1/1 2026-02-17T12:05:02.517 INFO:teuthology.orchestra.run.trial198.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:02.595 INFO:teuthology.orchestra.run.trial198.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:02.632 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:02.652 INFO:teuthology.orchestra.run.trial198.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:02.652 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:02.652 INFO:teuthology.orchestra.run.trial198.stdout:Installed: 2026-02-17T12:05:02.652 INFO:teuthology.orchestra.run.trial198.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:05:02.652 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:02.652 INFO:teuthology.orchestra.run.trial198.stdout:Complete! 2026-02-17T12:05:02.681 DEBUG:teuthology.parallel:result is None 2026-02-17T12:05:02.696 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:05:02.713 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:02.713 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:02.714 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:02.734 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-rook 2026-02-17T12:05:03.041 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:03.106 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-rook-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:05:03.123 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:03.124 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:03.124 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:03.146 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T12:05:03.462 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:03.526 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-mgr-cephadm-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:05:03.544 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:03.545 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:03.545 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:03.566 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-fuse 2026-02-17T12:05:03.868 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:03.950 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:03.951 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:03.951 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-17T12:05:03.951 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:03.951 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:05:03.951 INFO:teuthology.orchestra.run.trial090.stdout: ceph-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 1.2 M 2026-02-17T12:05:03.951 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:03.951 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:05:03.951 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:03.952 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T12:05:03.952 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:03.952 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 1.2 M 2026-02-17T12:05:03.952 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 3.6 M 2026-02-17T12:05:03.952 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:05:04.069 INFO:teuthology.orchestra.run.trial090.stdout:ceph-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 9.8 MB/s | 1.2 MB 00:00 2026-02-17T12:05:04.069 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:04.069 INFO:teuthology.orchestra.run.trial090.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-17T12:05:04.070 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:05:04.073 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:05:04.073 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:05:04.107 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:05:04.108 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:05:04.209 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:05:04.226 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:04.443 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:04.500 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:04.500 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:04.500 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:05:04.501 INFO:teuthology.orchestra.run.trial090.stdout: ceph-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:05:04.501 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:04.501 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:04.529 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-volume 2026-02-17T12:05:04.851 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:04.916 INFO:teuthology.orchestra.run.trial090.stdout:Package ceph-volume-2:19.2.3-675.g3c96dfb3.el9.noarch is already installed. 2026-02-17T12:05:04.933 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:04.934 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:04.934 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:04.957 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install librados-devel 2026-02-17T12:05:05.265 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:05.347 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:05.348 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:05.348 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-17T12:05:05.348 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:05.348 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:05:05.348 INFO:teuthology.orchestra.run.trial090.stdout: librados-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 127 k 2026-02-17T12:05:05.348 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:05.348 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:05:05.348 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:05.348 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T12:05:05.348 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:05.349 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 127 k 2026-02-17T12:05:05.349 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 456 k 2026-02-17T12:05:05.349 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:05:05.574 INFO:teuthology.orchestra.run.trial090.stdout:librados-devel-19.2.3-675.g3c96dfb3.el9.x86_64. 561 kB/s | 127 kB 00:00 2026-02-17T12:05:05.575 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:05.575 INFO:teuthology.orchestra.run.trial090.stdout:Total 558 kB/s | 127 kB 00:00 2026-02-17T12:05:05.575 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:05:05.578 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:05:05.578 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:05:05.609 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:05:05.609 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:05:05.664 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:05:05.681 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:05.759 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:05.817 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:05.817 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:05.817 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:05:05.817 INFO:teuthology.orchestra.run.trial090.stdout: librados-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:05:05.817 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:05.817 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:05.844 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install libcephfs2 2026-02-17T12:05:06.165 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:06.231 INFO:teuthology.orchestra.run.trial090.stdout:Package libcephfs2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:05:06.249 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:06.250 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:06.250 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:06.272 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install libcephfs-devel 2026-02-17T12:05:06.581 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:06.662 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-devel x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 34 k 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 34 k 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 153 k 2026-02-17T12:05:06.663 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:05:06.726 INFO:teuthology.orchestra.run.trial090.stdout:libcephfs-devel-19.2.3-675.g3c96dfb3.el9.x86_64 533 kB/s | 34 kB 00:00 2026-02-17T12:05:06.727 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:06.727 INFO:teuthology.orchestra.run.trial090.stdout:Total 526 kB/s | 34 kB 00:00 2026-02-17T12:05:06.727 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:05:06.728 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:05:06.728 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:05:06.730 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:05:06.730 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:05:06.751 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:05:06.767 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:06.825 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:06.882 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:06.882 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:06.882 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:05:06.882 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-devel-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:05:06.882 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:06.882 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:06.910 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install librados2 2026-02-17T12:05:07.220 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:07.286 INFO:teuthology.orchestra.run.trial090.stdout:Package librados2-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:05:07.303 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:07.304 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:07.304 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:07.326 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install librbd1 2026-02-17T12:05:07.639 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:07.704 INFO:teuthology.orchestra.run.trial090.stdout:Package librbd1-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:05:07.722 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:07.722 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:07.723 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:07.744 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-rados 2026-02-17T12:05:08.055 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:08.120 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-rados-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:05:08.137 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:08.138 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:08.138 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:08.160 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-rgw 2026-02-17T12:05:08.487 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:08.554 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-rgw-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:05:08.571 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:08.572 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:08.572 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:08.595 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-cephfs 2026-02-17T12:05:08.904 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:08.968 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-cephfs-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:05:08.986 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:08.987 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:08.987 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:09.008 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install python3-rbd 2026-02-17T12:05:09.317 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:09.382 INFO:teuthology.orchestra.run.trial090.stdout:Package python3-rbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 is already installed. 2026-02-17T12:05:09.399 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:09.400 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-17T12:05:09.400 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:09.421 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install rbd-fuse 2026-02-17T12:05:09.734 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:09.818 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:09.819 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:09.819 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-17T12:05:09.819 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:09.819 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:05:09.819 INFO:teuthology.orchestra.run.trial090.stdout: rbd-fuse x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 85 k 2026-02-17T12:05:09.819 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:09.819 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:05:09.819 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:09.819 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T12:05:09.820 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:09.820 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 85 k 2026-02-17T12:05:09.820 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 227 k 2026-02-17T12:05:09.820 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:05:09.892 INFO:teuthology.orchestra.run.trial090.stdout:rbd-fuse-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T12:05:09.893 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:09.893 INFO:teuthology.orchestra.run.trial090.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T12:05:09.893 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:05:09.896 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:05:09.897 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:05:09.928 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:05:09.928 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:05:09.979 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:05:09.996 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:10.077 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:10.134 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:10.135 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:10.135 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:05:10.135 INFO:teuthology.orchestra.run.trial090.stdout: rbd-fuse-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:05:10.135 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:10.135 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:10.163 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install rbd-mirror 2026-02-17T12:05:10.475 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:10.562 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:10.562 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:10.562 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repo Size 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout: rbd-mirror x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 3.1 M 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 3.1 M 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 13 M 2026-02-17T12:05:10.563 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:05:10.714 INFO:teuthology.orchestra.run.trial090.stdout:rbd-mirror-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T12:05:10.714 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:10.714 INFO:teuthology.orchestra.run.trial090.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T12:05:10.714 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:05:10.718 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:05:10.718 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:05:10.759 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:05:10.759 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:05:10.957 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:05:10.959 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:10.982 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:10.983 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T12:05:10.983 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T12:05:10.983 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T12:05:10.983 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T12:05:10.983 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:11.286 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:11.286 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:11.286 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:05:11.286 INFO:teuthology.orchestra.run.trial090.stdout: rbd-mirror-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:05:11.286 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:11.286 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:11.315 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install rbd-nbd 2026-02-17T12:05:11.626 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 12:04:31 PM UTC. 2026-02-17T12:05:11.708 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-17T12:05:11.708 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:11.708 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-17T12:05:11.708 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:11.708 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-17T12:05:11.708 INFO:teuthology.orchestra.run.trial090.stdout: rbd-nbd x86_64 2:19.2.3-675.g3c96dfb3.el9 ceph 171 k 2026-02-17T12:05:11.708 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:11.709 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-17T12:05:11.709 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-17T12:05:11.709 INFO:teuthology.orchestra.run.trial090.stdout:Install 1 Package 2026-02-17T12:05:11.709 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:11.709 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 171 k 2026-02-17T12:05:11.709 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 490 k 2026-02-17T12:05:11.709 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-17T12:05:11.795 INFO:teuthology.orchestra.run.trial090.stdout:rbd-nbd-19.2.3-675.g3c96dfb3.el9.x86_64.rpm 1.9 MB/s | 171 kB 00:00 2026-02-17T12:05:11.795 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:11.796 INFO:teuthology.orchestra.run.trial090.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T12:05:11.796 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-17T12:05:11.799 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-17T12:05:11.799 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-17T12:05:11.831 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-17T12:05:11.831 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-17T12:05:11.890 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-17T12:05:11.907 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:11.986 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:12.044 INFO:teuthology.orchestra.run.trial090.stdout: Verifying : rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 1/1 2026-02-17T12:05:12.044 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:12.044 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-17T12:05:12.044 INFO:teuthology.orchestra.run.trial090.stdout: rbd-nbd-2:19.2.3-675.g3c96dfb3.el9.x86_64 2026-02-17T12:05:12.044 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:12.044 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-17T12:05:12.075 DEBUG:teuthology.parallel:result is None 2026-02-17T12:05:12.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:05:12.251 DEBUG:teuthology.orchestra.run.trial090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T12:05:12.273 INFO:teuthology.orchestra.run.trial090.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T12:05:12.273 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T12:05:12.273 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T12:05:12.275 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:05:12.393 DEBUG:teuthology.orchestra.run.trial198:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T12:05:12.414 INFO:teuthology.orchestra.run.trial198.stdout:19.2.3-675.g3c96dfb3.el9 2026-02-17T12:05:12.414 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-675.g3c96dfb3.el9 2026-02-17T12:05:12.414 INFO:teuthology.task.install:The correct ceph version 19.2.3-675.g3c96dfb3 is installed. 2026-02-17T12:05:12.416 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T12:05:12.416 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:12.416 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T12:05:12.443 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:05:12.443 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T12:05:12.478 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T12:05:12.478 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:12.479 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T12:05:12.506 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T12:05:12.569 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:05:12.570 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T12:05:12.596 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T12:05:12.661 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T12:05:12.662 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:12.662 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T12:05:12.687 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T12:05:12.751 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:05:12.751 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T12:05:12.777 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T12:05:12.840 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T12:05:12.841 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:12.841 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T12:05:12.866 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T12:05:12.929 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:05:12.929 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T12:05:12.954 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T12:05:13.017 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-17T12:05:13.137 INFO:tasks.cephadm:Config: {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'} 2026-02-17T12:05:13.137 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:05:13.141 INFO:tasks.cephadm:Cluster fsid is ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:13.141 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-17T12:05:13.141 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.90'} 2026-02-17T12:05:13.141 INFO:tasks.cephadm:First mon is mon.a on trial090 2026-02-17T12:05:13.141 INFO:tasks.cephadm:First mgr is a 2026-02-17T12:05:13.141 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-17T12:05:13.141 DEBUG:teuthology.orchestra.run.trial090:> sudo hostname $(hostname -s) 2026-02-17T12:05:13.166 DEBUG:teuthology.orchestra.run.trial198:> sudo hostname $(hostname -s) 2026-02-17T12:05:13.193 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-17T12:05:13.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:05:13.338 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/flavors/default/', 'ref': 'wip-bharath20-testing-2026-02-13-0906-squid', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-13 11:49:02.520668', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '19.2.3-675-g3c96dfb3', 'package_manager_version': '19.2.3-675.g3c96dfb3', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2967/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-17T12:05:13.477 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-bharath20-testing-2026-02-13-0906-squid, sha1 3c96dfb3f50b3d02598a82af7104764bfdcd3919 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:05:13.479 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/x86_64/flavors/default/cephadm 2026-02-17T12:05:13.479 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/x86_64/flavors/default/cephadm 2026-02-17T12:05:13.479 DEBUG:teuthology.orchestra.run.trial090:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-17T12:05:13.760 INFO:teuthology.orchestra.run.trial090.stdout:-rw-r--r--. 1 ubuntu ubuntu 788277 Feb 17 12:05 /home/ubuntu/cephtest/cephadm 2026-02-17T12:05:13.760 DEBUG:teuthology.orchestra.run.trial198:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-bharath20-testing-2026-02-13-0906-squid/3c96dfb3f50b3d02598a82af7104764bfdcd3919/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-17T12:05:14.038 INFO:teuthology.orchestra.run.trial198.stdout:-rw-r--r--. 1 ubuntu ubuntu 788277 Feb 17 12:05 /home/ubuntu/cephtest/cephadm 2026-02-17T12:05:14.039 DEBUG:teuthology.orchestra.run.trial090:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-17T12:05:14.057 DEBUG:teuthology.orchestra.run.trial198:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-17T12:05:14.083 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 on all hosts... 2026-02-17T12:05:14.083 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 pull 2026-02-17T12:05:14.099 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 pull 2026-02-17T12:05:14.245 INFO:teuthology.orchestra.run.trial090.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919... 2026-02-17T12:05:14.266 INFO:teuthology.orchestra.run.trial198.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919... 2026-02-17T12:05:22.819 INFO:teuthology.orchestra.run.trial198.stdout:{ 2026-02-17T12:05:22.819 INFO:teuthology.orchestra.run.trial198.stdout: "ceph_version": "ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable)", 2026-02-17T12:05:22.819 INFO:teuthology.orchestra.run.trial198.stdout: "image_id": "61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73", 2026-02-17T12:05:22.820 INFO:teuthology.orchestra.run.trial198.stdout: "repo_digests": [ 2026-02-17T12:05:22.820 INFO:teuthology.orchestra.run.trial198.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6" 2026-02-17T12:05:22.820 INFO:teuthology.orchestra.run.trial198.stdout: ] 2026-02-17T12:05:22.820 INFO:teuthology.orchestra.run.trial198.stdout:} 2026-02-17T12:05:22.855 INFO:teuthology.orchestra.run.trial090.stdout:{ 2026-02-17T12:05:22.855 INFO:teuthology.orchestra.run.trial090.stdout: "ceph_version": "ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable)", 2026-02-17T12:05:22.855 INFO:teuthology.orchestra.run.trial090.stdout: "image_id": "61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73", 2026-02-17T12:05:22.855 INFO:teuthology.orchestra.run.trial090.stdout: "repo_digests": [ 2026-02-17T12:05:22.856 INFO:teuthology.orchestra.run.trial090.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:d3ccdfcdf6527d3bb7f57dde3b4f01ba151a3fdfc4dae2c5063868cadb8263e6" 2026-02-17T12:05:22.856 INFO:teuthology.orchestra.run.trial090.stdout: ] 2026-02-17T12:05:22.856 INFO:teuthology.orchestra.run.trial090.stdout:} 2026-02-17T12:05:22.871 DEBUG:teuthology.orchestra.run.trial090:> sudo mkdir -p /etc/ceph 2026-02-17T12:05:22.936 DEBUG:teuthology.orchestra.run.trial198:> sudo mkdir -p /etc/ceph 2026-02-17T12:05:22.965 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod 777 /etc/ceph 2026-02-17T12:05:22.989 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod 777 /etc/ceph 2026-02-17T12:05:23.029 INFO:tasks.cephadm:Writing seed config... 2026-02-17T12:05:23.030 INFO:tasks.cephadm: override: [client] debug client = 20 2026-02-17T12:05:23.031 INFO:tasks.cephadm: override: [client] debug mgrc = 20 2026-02-17T12:05:23.031 INFO:tasks.cephadm: override: [client] debug ms = 1 2026-02-17T12:05:23.031 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2026-02-17T12:05:23.031 INFO:tasks.cephadm: override: [mds] debug mgrc = 20 2026-02-17T12:05:23.031 INFO:tasks.cephadm: override: [mgr] debug client = 20 2026-02-17T12:05:23.031 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-17T12:05:23.031 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-17T12:05:23.031 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-17T12:05:23.031 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] bluestore compression algorithm = lz4 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] debug mgrc = 20 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-17T12:05:23.032 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-17T12:05:23.033 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-17T12:05:23.033 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-17T12:05:23.033 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-17T12:05:23.034 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:23.034 DEBUG:teuthology.orchestra.run.trial090:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-17T12:05:23.051 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression algorithm = lz4 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug mgrc = 20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug client = 20 debug mgrc = 20 debug ms = 1 [mds] debug mgrc = 20 2026-02-17T12:05:23.051 DEBUG:teuthology.orchestra.run.trial090:mon.a> sudo journalctl -f -n 0 -u ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mon.a.service 2026-02-17T12:05:23.093 DEBUG:teuthology.orchestra.run.trial090:mgr.a> sudo journalctl -f -n 0 -u ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mgr.a.service 2026-02-17T12:05:23.136 INFO:tasks.cephadm:Bootstrapping... 2026-02-17T12:05:23.136 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 -v bootstrap --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.90 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-17T12:05:23.271 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-17T12:05:23.272 INFO:teuthology.orchestra.run.trial090.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919', '-v', 'bootstrap', '--fsid', 'ea07e39e-0bf8-11f1-bf0e-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'a', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.90', '--skip-admin-label'] 2026-02-17T12:05:23.272 INFO:teuthology.orchestra.run.trial090.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-17T12:05:23.272 INFO:teuthology.orchestra.run.trial090.stdout:Verifying podman|docker is present... 2026-02-17T12:05:23.289 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stdout 5.6.0 2026-02-17T12:05:23.289 INFO:teuthology.orchestra.run.trial090.stdout:Verifying lvm2 is present... 2026-02-17T12:05:23.289 INFO:teuthology.orchestra.run.trial090.stdout:Verifying time synchronization is in place... 2026-02-17T12:05:23.295 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T12:05:23.295 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T12:05:23.300 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T12:05:23.300 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-17T12:05:23.306 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout enabled 2026-02-17T12:05:23.311 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout active 2026-02-17T12:05:23.311 INFO:teuthology.orchestra.run.trial090.stdout:Unit chronyd.service is enabled and running 2026-02-17T12:05:23.311 INFO:teuthology.orchestra.run.trial090.stdout:Repeating the final host check... 2026-02-17T12:05:23.327 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stdout 5.6.0 2026-02-17T12:05:23.327 INFO:teuthology.orchestra.run.trial090.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-17T12:05:23.327 INFO:teuthology.orchestra.run.trial090.stdout:systemctl is present 2026-02-17T12:05:23.327 INFO:teuthology.orchestra.run.trial090.stdout:lvcreate is present 2026-02-17T12:05:23.332 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T12:05:23.332 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T12:05:23.338 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T12:05:23.338 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-17T12:05:23.343 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout enabled 2026-02-17T12:05:23.349 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout active 2026-02-17T12:05:23.349 INFO:teuthology.orchestra.run.trial090.stdout:Unit chronyd.service is enabled and running 2026-02-17T12:05:23.349 INFO:teuthology.orchestra.run.trial090.stdout:Host looks OK 2026-02-17T12:05:23.349 INFO:teuthology.orchestra.run.trial090.stdout:Cluster fsid: ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:23.350 INFO:teuthology.orchestra.run.trial090.stdout:Acquiring lock 139922078177792 on /run/cephadm/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460.lock 2026-02-17T12:05:23.350 INFO:teuthology.orchestra.run.trial090.stdout:Lock 139922078177792 acquired on /run/cephadm/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460.lock 2026-02-17T12:05:23.350 INFO:teuthology.orchestra.run.trial090.stdout:Verifying IP 10.20.193.90 port 3300 ... 2026-02-17T12:05:23.350 INFO:teuthology.orchestra.run.trial090.stdout:Verifying IP 10.20.193.90 port 6789 ... 2026-02-17T12:05:23.350 INFO:teuthology.orchestra.run.trial090.stdout:Base mon IP(s) is [10.20.193.90:3300, 10.20.193.90:6789], mon addrv is [v2:10.20.193.90:3300,v1:10.20.193.90:6789] 2026-02-17T12:05:23.352 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.90 metric 102 2026-02-17T12:05:23.352 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.90 metric 102 2026-02-17T12:05:23.352 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-17T12:05:23.355 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-17T12:05:23.355 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-17T12:05:23.355 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-17T12:05:23.358 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-17T12:05:23.358 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-17T12:05:23.358 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T12:05:23.358 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-17T12:05:23.358 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout inet6 fe80::1f3c:a4d1:c16b:3b15/64 scope link noprefixroute 2026-02-17T12:05:23.359 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T12:05:23.359 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-17T12:05:23.359 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:62c4/64 scope link 2026-02-17T12:05:23.359 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T12:05:23.359 INFO:teuthology.orchestra.run.trial090.stdout:Mon IP `10.20.193.90` is in CIDR network `10.20.192.0/20` 2026-02-17T12:05:23.359 INFO:teuthology.orchestra.run.trial090.stdout:Mon IP `10.20.193.90` is in CIDR network `10.20.192.0/20` 2026-02-17T12:05:23.359 INFO:teuthology.orchestra.run.trial090.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-17T12:05:23.359 INFO:teuthology.orchestra.run.trial090.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-17T12:05:23.360 INFO:teuthology.orchestra.run.trial090.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919... 2026-02-17T12:05:23.612 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stdout 61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73 2026-02-17T12:05:23.612 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919... 2026-02-17T12:05:23.612 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Getting image source signatures 2026-02-17T12:05:23.612 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Copying blob sha256:4530141b72ed2035566112fee61d7f6ef5d3adf36618f0dfd3cb86a1e0741855 2026-02-17T12:05:23.612 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Copying blob sha256:f288f3bfe1f1dd15cb8f17590a708af9d9397de617368b4f9c06e9bc583d4a6b 2026-02-17T12:05:23.612 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Copying config sha256:61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73 2026-02-17T12:05:23.612 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-17T12:05:23.719 INFO:teuthology.orchestra.run.trial090.stdout:ceph: stdout ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable) 2026-02-17T12:05:23.719 INFO:teuthology.orchestra.run.trial090.stdout:Ceph version: ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable) 2026-02-17T12:05:23.719 INFO:teuthology.orchestra.run.trial090.stdout:Extracting ceph user uid/gid from container image... 2026-02-17T12:05:23.860 INFO:teuthology.orchestra.run.trial090.stdout:stat: stdout 167 167 2026-02-17T12:05:23.860 INFO:teuthology.orchestra.run.trial090.stdout:Creating initial keys... 2026-02-17T12:05:23.999 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph-authtool: stdout AQCDWZRpsk4oORAA0kxPad9vc1z1Igb3p6A4+g== 2026-02-17T12:05:24.118 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph-authtool: stdout AQCEWZRpjA60BRAAIged41IJAHgx7bHL6dx25Q== 2026-02-17T12:05:24.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph-authtool: stdout AQCEWZRpmnl6DRAA+ahQmKv2aEmmHObO2ByYZQ== 2026-02-17T12:05:24.238 INFO:teuthology.orchestra.run.trial090.stdout:Creating initial monmap... 2026-02-17T12:05:24.377 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T12:05:24.377 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-17T12:05:24.377 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:24.377 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T12:05:24.378 INFO:teuthology.orchestra.run.trial090.stdout:monmaptool for a [v2:10.20.193.90:3300,v1:10.20.193.90:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T12:05:24.378 INFO:teuthology.orchestra.run.trial090.stdout:setting min_mon_release = quincy 2026-02-17T12:05:24.378 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: set fsid to ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:24.378 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T12:05:24.378 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:24.378 INFO:teuthology.orchestra.run.trial090.stdout:Creating mon... 2026-02-17T12:05:24.518 INFO:teuthology.orchestra.run.trial090.stdout:create mon.a on 2026-02-17T12:05:24.683 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-17T12:05:24.785 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-17T12:05:24.888 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460.target → /etc/systemd/system/ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460.target. 2026-02-17T12:05:24.889 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460.target → /etc/systemd/system/ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460.target. 2026-02-17T12:05:25.006 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mon.a 2026-02-17T12:05:25.006 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mon.a.service: Unit ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mon.a.service not loaded. 2026-02-17T12:05:25.127 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460.target.wants/ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@.service. 2026-02-17T12:05:25.265 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T12:05:25.265 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout disabled 2026-02-17T12:05:25.271 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T12:05:25.271 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-17T12:05:25.271 INFO:teuthology.orchestra.run.trial090.stdout:firewalld.service is not enabled 2026-02-17T12:05:25.271 INFO:teuthology.orchestra.run.trial090.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T12:05:25.271 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mon to start... 2026-02-17T12:05:25.271 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mon... 2026-02-17T12:05:25.279 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 systemd[1]: Started Ceph mon.a for ea07e39e-0bf8-11f1-bf0e-d404e6e7d460. 2026-02-17T12:05:25.429 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout cluster: 2026-02-17T12:05:25.429 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout id: ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:25.429 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-17T12:05:25.429 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:25.429 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout services: 2026-02-17T12:05:25.429 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.129909s) 2026-02-17T12:05:25.429 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-17T12:05:25.429 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout data: 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout pgs: 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.372+0000 7f047b568640 1 Processor -- start 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.372+0000 7f047b568640 1 -- start start 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.372+0000 7f047b568640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f047407dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.372+0000 7f047b568640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f047407e2c0 con 0x7f047407d8f0 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.373+0000 7f04792dd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f047407dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.373+0000 7f04792dd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f047407dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50098/0 (socket says 10.20.193.90:50098) 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.373+0000 7f04792dd640 1 -- 10.20.193.90:0/561775121 learned_addr learned my addr 10.20.193.90:0/561775121 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.373+0000 7f04792dd640 1 -- 10.20.193.90:0/561775121 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047407eb40 con 0x7f047407d8f0 2026-02-17T12:05:25.430 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f04792dd640 1 --2- 10.20.193.90:0/561775121 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f047407dcf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0464009920 tx=0x7f046402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79419cfd204ede67 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f0463fff640 1 -- 10.20.193.90:0/561775121 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f046403c070 con 0x7f047407d8f0 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f0463fff640 1 -- 10.20.193.90:0/561775121 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046402fae0 con 0x7f047407d8f0 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f0463fff640 1 -- 10.20.193.90:0/561775121 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f046402fde0 con 0x7f047407d8f0 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f047b568640 1 -- 10.20.193.90:0/561775121 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 msgr2=0x7f047407dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f047b568640 1 --2- 10.20.193.90:0/561775121 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f047407dcf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0464009920 tx=0x7f046402ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f047b568640 1 -- 10.20.193.90:0/561775121 shutdown_connections 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f047b568640 1 --2- 10.20.193.90:0/561775121 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f047407dcf0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f047b568640 1 -- 10.20.193.90:0/561775121 >> 10.20.193.90:0/561775121 conn(0x7f047407c4e0 msgr2=0x7f047407c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f047b568640 1 -- 10.20.193.90:0/561775121 shutdown_connections 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.374+0000 7f047b568640 1 -- 10.20.193.90:0/561775121 wait complete. 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f047b568640 1 Processor -- start 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f047b568640 1 -- start start 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f047b568640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f04741a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f047b568640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f047407f070 con 0x7f047407d8f0 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04792dd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f04741a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.431 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04792dd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f04741a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50112/0 (socket says 10.20.193.90:50112) 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04792dd640 1 -- 10.20.193.90:0/2083658179 learned_addr learned my addr 10.20.193.90:0/2083658179 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04792dd640 1 -- 10.20.193.90:0/2083658179 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04741a30c0 con 0x7f047407d8f0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04792dd640 1 --2- 10.20.193.90:0/2083658179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f04741a2b80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0464009920 tx=0x7f04640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04627fc640 1 -- 10.20.193.90:0/2083658179 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f046403c050 con 0x7f047407d8f0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04627fc640 1 -- 10.20.193.90:0/2083658179 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0464048070 con 0x7f047407d8f0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f047b568640 1 -- 10.20.193.90:0/2083658179 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04741a3350 con 0x7f047407d8f0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04627fc640 1 -- 10.20.193.90:0/2083658179 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04640436f0 con 0x7f047407d8f0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f047b568640 1 -- 10.20.193.90:0/2083658179 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04741a6040 con 0x7f047407d8f0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04627fc640 1 -- 10.20.193.90:0/2083658179 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0464043890 con 0x7f047407d8f0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04627fc640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04627fc640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04627fc640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04627fc640 4 mgrc reconnect No active mgr available yet 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.375+0000 7f04627fc640 1 -- 10.20.193.90:0/2083658179 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f046404dc30 con 0x7f047407d8f0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.376+0000 7f047b568640 1 -- 10.20.193.90:0/2083658179 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047407f750 con 0x7f047407d8f0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.377+0000 7f04627fc640 1 -- 10.20.193.90:0/2083658179 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f0464043cf0 con 0x7f047407d8f0 2026-02-17T12:05:25.432 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.405+0000 7f047b568640 1 -- 10.20.193.90:0/2083658179 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f04741a6390 con 0x7f047407d8f0 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.405+0000 7f04627fc640 1 -- 10.20.193.90:0/2083658179 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f046402fae0 con 0x7f047407d8f0 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.406+0000 7f047b568640 10 mgrc shutdown 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.406+0000 7f047b568640 1 -- 10.20.193.90:0/2083658179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 msgr2=0x7f04741a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.406+0000 7f047b568640 1 --2- 10.20.193.90:0/2083658179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f04741a2b80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0464009920 tx=0x7f04640047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.406+0000 7f047b568640 1 -- 10.20.193.90:0/2083658179 shutdown_connections 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.406+0000 7f047b568640 1 --2- 10.20.193.90:0/2083658179 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047407d8f0 0x7f04741a2b80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.406+0000 7f047b568640 1 -- 10.20.193.90:0/2083658179 >> 10.20.193.90:0/2083658179 conn(0x7f047407c4e0 msgr2=0x7f0474106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.406+0000 7f047b568640 1 -- 10.20.193.90:0/2083658179 shutdown_connections 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.406+0000 7f047b568640 1 -- 10.20.193.90:0/2083658179 wait complete. 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:mon is available 2026-02-17T12:05:25.433 INFO:teuthology.orchestra.run.trial090.stdout:Assimilating anything we can from ceph.conf... 2026-02-17T12:05:25.540 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 ceph-mon[38790]: mkfs ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:25.540 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 ceph-mon[38790]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-17T12:05:25.579 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:25.579 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T12:05:25.579 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout fsid = ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:25.579 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.90:3300,v1:10.20.193.90:6789] 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-17T12:05:25.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.517+0000 7fdcf7a90640 1 Processor -- start 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.517+0000 7fdcf7a90640 1 -- start start 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.517+0000 7fdcf7a90640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf0109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.517+0000 7fdcf7a90640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf01099d0 con 0x7fdcf0109000 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.518+0000 7fdcf5805640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf0109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.518+0000 7fdcf5805640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf0109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50118/0 (socket says 10.20.193.90:50118) 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.518+0000 7fdcf5805640 1 -- 10.20.193.90:0/1174474051 learned_addr learned my addr 10.20.193.90:0/1174474051 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.518+0000 7fdcf5805640 1 -- 10.20.193.90:0/1174474051 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf010a200 con 0x7fdcf0109000 2026-02-17T12:05:25.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.518+0000 7fdcf5805640 1 --2- 10.20.193.90:0/1174474051 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf0109400 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009920 tx=0x7fdce002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0e21a4234efe8f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.518+0000 7fdcf4803640 1 -- 10.20.193.90:0/1174474051 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce003c070 con 0x7fdcf0109000 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf4803640 1 -- 10.20.193.90:0/1174474051 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce002fae0 con 0x7fdcf0109000 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf4803640 1 -- 10.20.193.90:0/1174474051 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce002fde0 con 0x7fdcf0109000 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 -- 10.20.193.90:0/1174474051 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 msgr2=0x7fdcf0109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 --2- 10.20.193.90:0/1174474051 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf0109400 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009920 tx=0x7fdce002ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 -- 10.20.193.90:0/1174474051 shutdown_connections 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 --2- 10.20.193.90:0/1174474051 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf0109400 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 -- 10.20.193.90:0/1174474051 >> 10.20.193.90:0/1174474051 conn(0x7fdcf007c4e0 msgr2=0x7fdcf007c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 -- 10.20.193.90:0/1174474051 shutdown_connections 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 -- 10.20.193.90:0/1174474051 wait complete. 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 Processor -- start 2026-02-17T12:05:25.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 -- start start 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf019e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf7a90640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf010a730 con 0x7fdcf0109000 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf5805640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf019e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf5805640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf019e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50126/0 (socket says 10.20.193.90:50126) 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf5805640 1 -- 10.20.193.90:0/3657399880 learned_addr learned my addr 10.20.193.90:0/3657399880 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.519+0000 7fdcf5805640 1 -- 10.20.193.90:0/3657399880 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf019ec00 con 0x7fdcf0109000 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcf5805640 1 --2- 10.20.193.90:0/3657399880 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf019e6c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009a50 tx=0x7fdce00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcdeffd640 1 -- 10.20.193.90:0/3657399880 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce003c050 con 0x7fdcf0109000 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcdeffd640 1 -- 10.20.193.90:0/3657399880 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce0048070 con 0x7fdcf0109000 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcf7a90640 1 -- 10.20.193.90:0/3657399880 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf019ee90 con 0x7fdcf0109000 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcdeffd640 1 -- 10.20.193.90:0/3657399880 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce0043710 con 0x7fdcf0109000 2026-02-17T12:05:25.583 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcf7a90640 1 -- 10.20.193.90:0/3657399880 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf01a1b80 con 0x7fdcf0109000 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcdeffd640 1 -- 10.20.193.90:0/3657399880 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fdce00438b0 con 0x7fdcf0109000 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcdeffd640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcdeffd640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcdeffd640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcdeffd640 4 mgrc reconnect No active mgr available yet 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcdeffd640 1 -- 10.20.193.90:0/3657399880 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdce004dc60 con 0x7fdcf0109000 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.520+0000 7fdcf7a90640 1 -- 10.20.193.90:0/3657399880 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf010adf0 con 0x7fdcf0109000 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.521+0000 7fdcdeffd640 1 -- 10.20.193.90:0/3657399880 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fdce0043d60 con 0x7fdcf0109000 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.550+0000 7fdcf7a90640 1 -- 10.20.193.90:0/3657399880 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fdcf01a3050 con 0x7fdcf0109000 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.552+0000 7fdcdeffd640 1 -- 10.20.193.90:0/3657399880 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7fdce004d460 con 0x7fdcf0109000 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.552+0000 7fdcdeffd640 1 -- 10.20.193.90:0/3657399880 <== mon.0 v2:10.20.193.90:3300/0 8 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fdce003d040 con 0x7fdcf0109000 2026-02-17T12:05:25.584 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.553+0000 7fdcf7a90640 10 mgrc shutdown 2026-02-17T12:05:25.585 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.553+0000 7fdcf7a90640 1 -- 10.20.193.90:0/3657399880 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 msgr2=0x7fdcf019e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:25.585 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.553+0000 7fdcf7a90640 1 --2- 10.20.193.90:0/3657399880 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf019e6c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdce0009a50 tx=0x7fdce00047c0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.585 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.553+0000 7fdcf7a90640 1 -- 10.20.193.90:0/3657399880 shutdown_connections 2026-02-17T12:05:25.585 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.553+0000 7fdcf7a90640 1 --2- 10.20.193.90:0/3657399880 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcf0109000 0x7fdcf019e6c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.585 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.553+0000 7fdcf7a90640 1 -- 10.20.193.90:0/3657399880 >> 10.20.193.90:0/3657399880 conn(0x7fdcf007c4e0 msgr2=0x7fdcf01929d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:25.585 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.553+0000 7fdcf7a90640 1 -- 10.20.193.90:0/3657399880 shutdown_connections 2026-02-17T12:05:25.585 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.553+0000 7fdcf7a90640 1 -- 10.20.193.90:0/3657399880 wait complete. 2026-02-17T12:05:25.585 INFO:teuthology.orchestra.run.trial090.stdout:Generating new minimal ceph.conf... 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.665+0000 7f9d602d7640 1 Processor -- start 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.665+0000 7f9d602d7640 1 -- start start 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.665+0000 7f9d602d7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.665+0000 7f9d602d7640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5807b830 con 0x7f9d5807ce90 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.665+0000 7f9d5e04c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.665+0000 7f9d5e04c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5807b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50136/0 (socket says 10.20.193.90:50136) 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.665+0000 7f9d5e04c640 1 -- 10.20.193.90:0/1939070692 learned_addr learned my addr 10.20.193.90:0/1939070692 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.666+0000 7f9d5e04c640 1 -- 10.20.193.90:0/1939070692 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5807b9b0 con 0x7f9d5807ce90 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.666+0000 7f9d5e04c640 1 --2- 10.20.193.90:0/1939070692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5807b2f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009920 tx=0x7f9d4802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f68934a779b0b16 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.666+0000 7f9d5d04a640 1 -- 10.20.193.90:0/1939070692 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4803c070 con 0x7f9d5807ce90 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.666+0000 7f9d5d04a640 1 -- 10.20.193.90:0/1939070692 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f9d48037440 con 0x7f9d5807ce90 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.666+0000 7f9d5d04a640 1 -- 10.20.193.90:0/1939070692 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d48035340 con 0x7f9d5807ce90 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.666+0000 7f9d602d7640 1 -- 10.20.193.90:0/1939070692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 msgr2=0x7f9d5807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.666+0000 7f9d602d7640 1 --2- 10.20.193.90:0/1939070692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5807b2f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009920 tx=0x7f9d4802ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.666+0000 7f9d602d7640 1 -- 10.20.193.90:0/1939070692 shutdown_connections 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.666+0000 7f9d602d7640 1 --2- 10.20.193.90:0/1939070692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5807b2f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.666+0000 7f9d602d7640 1 -- 10.20.193.90:0/1939070692 >> 10.20.193.90:0/1939070692 conn(0x7f9d58102540 msgr2=0x7f9d58104960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d602d7640 1 -- 10.20.193.90:0/1939070692 shutdown_connections 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d602d7640 1 -- 10.20.193.90:0/1939070692 wait complete. 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d602d7640 1 Processor -- start 2026-02-17T12:05:25.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d602d7640 1 -- start start 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d602d7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d602d7640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5810d200 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d5e04c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d5e04c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5819ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50138/0 (socket says 10.20.193.90:50138) 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d5e04c640 1 -- 10.20.193.90:0/3170534982 learned_addr learned my addr 10.20.193.90:0/3170534982 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d5e04c640 1 -- 10.20.193.90:0/3170534982 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5819f350 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d5e04c640 1 --2- 10.20.193.90:0/3170534982 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5819ee10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9d48006fd0 tx=0x7f9d48035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d3f7fe640 1 -- 10.20.193.90:0/3170534982 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d48045070 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d3f7fe640 1 -- 10.20.193.90:0/3170534982 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f9d48040450 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d3f7fe640 1 -- 10.20.193.90:0/3170534982 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d4803c070 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.667+0000 7f9d602d7640 1 -- 10.20.193.90:0/3170534982 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5819f5e0 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.668+0000 7f9d602d7640 1 -- 10.20.193.90:0/3170534982 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d581a22d0 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.668+0000 7f9d3f7fe640 1 -- 10.20.193.90:0/3170534982 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f9d4804a440 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.668+0000 7f9d3f7fe640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.668+0000 7f9d3f7fe640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.668+0000 7f9d3f7fe640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.668+0000 7f9d3f7fe640 4 mgrc reconnect No active mgr available yet 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.668+0000 7f9d3f7fe640 1 -- 10.20.193.90:0/3170534982 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9d480499a0 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.668+0000 7f9d602d7640 1 -- 10.20.193.90:0/3170534982 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d5807b370 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.669+0000 7f9d3f7fe640 1 -- 10.20.193.90:0/3170534982 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f9d4804f030 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.698+0000 7f9d602d7640 1 -- 10.20.193.90:0/3170534982 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f9d581a2640 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.698+0000 7f9d3f7fe640 1 -- 10.20.193.90:0/3170534982 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f9d480408e0 con 0x7f9d5807ce90 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.699+0000 7f9d602d7640 10 mgrc shutdown 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.699+0000 7f9d602d7640 1 -- 10.20.193.90:0/3170534982 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 msgr2=0x7f9d5819ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.699+0000 7f9d602d7640 1 --2- 10.20.193.90:0/3170534982 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5819ee10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9d48006fd0 tx=0x7f9d48035f80 comp rx=0 tx=0).stop 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.699+0000 7f9d602d7640 1 -- 10.20.193.90:0/3170534982 shutdown_connections 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.699+0000 7f9d602d7640 1 --2- 10.20.193.90:0/3170534982 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9d5807ce90 0x7f9d5819ee10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.699+0000 7f9d602d7640 1 -- 10.20.193.90:0/3170534982 >> 10.20.193.90:0/3170534982 conn(0x7f9d58102540 msgr2=0x7f9d581030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.699+0000 7f9d602d7640 1 -- 10.20.193.90:0/3170534982 shutdown_connections 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:25.699+0000 7f9d602d7640 1 -- 10.20.193.90:0/3170534982 wait complete. 2026-02-17T12:05:25.734 INFO:teuthology.orchestra.run.trial090.stdout:Restarting the monitor... 2026-02-17T12:05:25.811 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 systemd[1]: Stopping Ceph mon.a for ea07e39e-0bf8-11f1-bf0e-d404e6e7d460... 2026-02-17T12:05:26.068 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mon-a[38786]: 2026-02-17T12:05:25.809+0000 7fd10586d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T12:05:26.069 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mon-a[38786]: 2026-02-17T12:05:25.809+0000 7fd10586d640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T12:05:26.069 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 podman[39071]: 2026-02-17 12:05:25.901647837 +0000 UTC m=+0.102108509 container died a8cbf5963bac71327f8a2e1d485adaccabc92b87d6b14795ead2a9486f3e8ccc (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20260209, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-17T12:05:26.069 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 podman[39071]: 2026-02-17 12:05:25.909827016 +0000 UTC m=+0.110287698 container remove a8cbf5963bac71327f8a2e1d485adaccabc92b87d6b14795ead2a9486f3e8ccc (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mon-a, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260209, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-17T12:05:26.069 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 bash[39071]: ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mon-a 2026-02-17T12:05:26.069 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 systemd[1]: ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-17T12:05:26.069 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 systemd[1]: Stopped Ceph mon.a for ea07e39e-0bf8-11f1-bf0e-d404e6e7d460. 2026-02-17T12:05:26.069 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:25 trial090 systemd[1]: Starting Ceph mon.a for ea07e39e-0bf8-11f1-bf0e-d404e6e7d460... 2026-02-17T12:05:26.069 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 podman[39200]: 2026-02-17 12:05:26.04244684 +0000 UTC m=+0.014755005 container create 1eed1cf610583376058ccf1e9e79c7d8fe9f79aa93cf31e5bacb7a2c1546ae51 (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mon-a, org.label-schema.build-date=20260209, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-17T12:05:26.077 INFO:teuthology.orchestra.run.trial090.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-17T12:05:26.235 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.174+0000 7f80d7350640 1 Processor -- start 2026-02-17T12:05:26.235 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.174+0000 7f80d7350640 1 -- start start 2026-02-17T12:05:26.235 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.174+0000 7f80d7350640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d0109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:26.235 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.174+0000 7f80d7350640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80d01099d0 con 0x7f80d0109000 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.175+0000 7f80d50c5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d0109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.175+0000 7f80d50c5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d0109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50146/0 (socket says 10.20.193.90:50146) 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.175+0000 7f80d50c5640 1 -- 10.20.193.90:0/3468118357 learned_addr learned my addr 10.20.193.90:0/3468118357 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.175+0000 7f80d50c5640 1 -- 10.20.193.90:0/3468118357 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d010a200 con 0x7f80d0109000 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.176+0000 7f80d50c5640 1 --2- 10.20.193.90:0/3468118357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d0109400 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009920 tx=0x7f80c002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a9ae5057404f1d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.176+0000 7f80bffff640 1 -- 10.20.193.90:0/3468118357 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80c003c070 con 0x7f80d0109000 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.176+0000 7f80bffff640 1 -- 10.20.193.90:0/3468118357 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f80c0037440 con 0x7f80d0109000 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.176+0000 7f80bffff640 1 -- 10.20.193.90:0/3468118357 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80c0035340 con 0x7f80d0109000 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 -- 10.20.193.90:0/3468118357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 msgr2=0x7f80d0109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 --2- 10.20.193.90:0/3468118357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d0109400 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f80c0009920 tx=0x7f80c002ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:26.236 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 -- 10.20.193.90:0/3468118357 shutdown_connections 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 --2- 10.20.193.90:0/3468118357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d0109400 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 -- 10.20.193.90:0/3468118357 >> 10.20.193.90:0/3468118357 conn(0x7f80d007c4e0 msgr2=0x7f80d007c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 -- 10.20.193.90:0/3468118357 shutdown_connections 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 -- 10.20.193.90:0/3468118357 wait complete. 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 Processor -- start 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 -- start start 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d7350640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80d010d430 con 0x7f80d0109000 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d50c5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d50c5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d019eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50150/0 (socket says 10.20.193.90:50150) 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d50c5640 1 -- 10.20.193.90:0/2331764998 learned_addr learned my addr 10.20.193.90:0/2331764998 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:26.237 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.177+0000 7f80d50c5640 1 -- 10.20.193.90:0/2331764998 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d019f3e0 con 0x7f80d0109000 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80d50c5640 1 --2- 10.20.193.90:0/2331764998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d019eea0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f80c002f4a0 tx=0x7f80c0035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80be7fc640 1 -- 10.20.193.90:0/2331764998 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80c0045070 con 0x7f80d0109000 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80be7fc640 1 -- 10.20.193.90:0/2331764998 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f80c0040450 con 0x7f80d0109000 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80d7350640 1 -- 10.20.193.90:0/2331764998 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d019f670 con 0x7f80d0109000 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80be7fc640 1 -- 10.20.193.90:0/2331764998 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80c003c070 con 0x7f80d0109000 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80d7350640 1 -- 10.20.193.90:0/2331764998 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d01a2360 con 0x7f80d0109000 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80be7fc640 1 -- 10.20.193.90:0/2331764998 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f80c004a440 con 0x7f80d0109000 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80be7fc640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80be7fc640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80be7fc640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80be7fc640 4 mgrc reconnect No active mgr available yet 2026-02-17T12:05:26.238 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80be7fc640 1 -- 10.20.193.90:0/2331764998 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f80c0049870 con 0x7f80d0109000 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.178+0000 7f80d7350640 1 -- 10.20.193.90:0/2331764998 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d0109480 con 0x7f80d0109000 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.179+0000 7f80be7fc640 1 -- 10.20.193.90:0/2331764998 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f80c0040600 con 0x7f80d0109000 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.209+0000 7f80d7350640 1 -- 10.20.193.90:0/2331764998 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f80d01a2740 con 0x7f80d0109000 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.210+0000 7f80be7fc640 1 -- 10.20.193.90:0/2331764998 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 125+0+0 (secure 0 0 0) 0x7f80c0040950 con 0x7f80d0109000 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.211+0000 7f80d7350640 10 mgrc shutdown 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.211+0000 7f80d7350640 1 -- 10.20.193.90:0/2331764998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 msgr2=0x7f80d019eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.211+0000 7f80d7350640 1 --2- 10.20.193.90:0/2331764998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d019eea0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f80c002f4a0 tx=0x7f80c0035f80 comp rx=0 tx=0).stop 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.211+0000 7f80d7350640 1 -- 10.20.193.90:0/2331764998 shutdown_connections 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.211+0000 7f80d7350640 1 --2- 10.20.193.90:0/2331764998 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80d0109000 0x7f80d019eea0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.211+0000 7f80d7350640 1 -- 10.20.193.90:0/2331764998 >> 10.20.193.90:0/2331764998 conn(0x7f80d007c4e0 msgr2=0x7f80d0106720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:26.239 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.211+0000 7f80d7350640 1 -- 10.20.193.90:0/2331764998 shutdown_connections 2026-02-17T12:05:26.240 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.211+0000 7f80d7350640 1 -- 10.20.193.90:0/2331764998 wait complete. 2026-02-17T12:05:26.240 INFO:teuthology.orchestra.run.trial090.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-17T12:05:26.240 INFO:teuthology.orchestra.run.trial090.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-17T12:05:26.240 INFO:teuthology.orchestra.run.trial090.stdout:Creating mgr... 2026-02-17T12:05:26.240 INFO:teuthology.orchestra.run.trial090.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-17T12:05:26.240 INFO:teuthology.orchestra.run.trial090.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-17T12:05:26.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 podman[39200]: 2026-02-17 12:05:26.069891753 +0000 UTC m=+0.042199929 container init 1eed1cf610583376058ccf1e9e79c7d8fe9f79aa93cf31e5bacb7a2c1546ae51 (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mon-a, CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, org.label-schema.build-date=20260209, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2026-02-17T12:05:26.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 podman[39200]: 2026-02-17 12:05:26.072302858 +0000 UTC m=+0.044611033 container start 1eed1cf610583376058ccf1e9e79c7d8fe9f79aa93cf31e5bacb7a2c1546ae51 (image=quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919, name=ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mon-a, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260209, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=3c96dfb3f50b3d02598a82af7104764bfdcd3919, io.buildah.version=1.41.3, CEPH_REF=wip-bharath20-testing-2026-02-13-0906-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, ceph=True, org.label-schema.license=GPLv2) 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 bash[39200]: 1eed1cf610583376058ccf1e9e79c7d8fe9f79aa93cf31e5bacb7a2c1546ae51 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 podman[39200]: 2026-02-17 12:05:26.036121 +0000 UTC m=+0.008429165 image pull 61a910d60eeb0b7ed352b72dda4ea639cf1a80cda0240ecf6d6cc937c1a81b73 quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 systemd[1]: Started Ceph mon.a for ea07e39e-0bf8-11f1-bf0e-d404e6e7d460. 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: set uid:gid to 167:167 (ceph:ceph) 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: ceph version 19.2.3-675-g3c96dfb3 (3c96dfb3f50b3d02598a82af7104764bfdcd3919) squid (stable), process ceph-mon, pid 2 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: pidfile_write: ignore empty --pid-file 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: load: jerasure load: lrc 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: RocksDB version: 7.9.2 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Git sha 0 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Compile date 2026-02-13 11:06:07 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: DB SUMMARY 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: DB Session ID: UJ2YBTUUVNZILFOYMKGM 2026-02-17T12:05:26.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: CURRENT file: CURRENT 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: IDENTITY file: IDENTITY 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 81827 ; 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.error_if_exists: 0 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.create_if_missing: 0 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.paranoid_checks: 1 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.env: 0x5569fcecadc0 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.fs: PosixFileSystem 2026-02-17T12:05:26.333 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.info_log: 0x5569fd739900 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_file_opening_threads: 16 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.statistics: (nil) 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.use_fsync: 0 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_log_file_size: 0 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.keep_log_file_num: 1000 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.recycle_log_file_num: 0 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.allow_fallocate: 1 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.allow_mmap_reads: 0 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.allow_mmap_writes: 0 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.use_direct_reads: 0 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.create_missing_column_families: 0 2026-02-17T12:05:26.334 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.db_log_dir: 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.wal_dir: 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.advise_random_on_open: 1 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.db_write_buffer_size: 0 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.write_buffer_manager: 0x5569fd73d900 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.rate_limiter: (nil) 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-17T12:05:26.335 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.wal_recovery_mode: 2 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.enable_thread_tracking: 0 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.enable_pipelined_write: 0 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.unordered_write: 0 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.row_cache: None 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.wal_filter: None 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-17T12:05:26.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.allow_ingest_behind: 0 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.two_write_queues: 0 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.manual_wal_flush: 0 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.wal_compression: 0 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.atomic_flush: 0 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.log_readahead_size: 0 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.best_efforts_recovery: 0 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-17T12:05:26.337 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.allow_data_in_errors: 0 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.db_host_id: __hostname__ 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_background_jobs: 2 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_background_compactions: -1 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_subcompactions: 1 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_total_wal_size: 0 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-17T12:05:26.338 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_open_files: -1 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bytes_per_sync: 0 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_readahead_size: 0 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_background_flushes: -1 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Compression algorithms supported: 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: kZSTD supported: 0 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: kXpressCompression supported: 0 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: kBZip2Compression supported: 0 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: kLZ4Compression supported: 1 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: kZlibCompression supported: 1 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: kLZ4HCCompression supported: 1 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: kSnappyCompression supported: 1 2026-02-17T12:05:26.339 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.merge_operator: 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_filter: None 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_filter_factory: None 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.sst_partitioner_factory: None 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5569fd7385c0) 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout: cache_index_and_filter_blocks: 1 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-17T12:05:26.340 INFO:journalctl@ceph.mon.a.trial090.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: pin_top_level_index_and_filter: 1 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: index_type: 0 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: data_block_index_type: 0 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: index_shortening: 1 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: checksum: 4 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: no_block_cache: 0 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: block_cache: 0x5569fd75d350 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: block_cache_name: BinnedLRUCache 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: block_cache_options: 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: capacity : 536870912 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: num_shard_bits : 4 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: strict_capacity_limit : 0 2026-02-17T12:05:26.341 INFO:journalctl@ceph.mon.a.trial090.stdout: high_pri_pool_ratio: 0.000 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: block_cache_compressed: (nil) 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: persistent_cache: (nil) 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: block_size: 4096 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: block_size_deviation: 10 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: block_restart_interval: 16 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: index_block_restart_interval: 1 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: metadata_block_size: 4096 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: partition_filters: 0 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: use_delta_encoding: 1 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: filter_policy: bloomfilter 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: whole_key_filtering: 1 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: verify_compression: 0 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: read_amp_bytes_per_bit: 0 2026-02-17T12:05:26.342 INFO:journalctl@ceph.mon.a.trial090.stdout: format_version: 5 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout: enable_index_compression: 1 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout: block_align: 0 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout: max_auto_readahead_size: 262144 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout: prepopulate_block_cache: 0 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout: initial_auto_readahead_size: 8192 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout: num_file_reads_for_auto_readahead: 2 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.write_buffer_size: 33554432 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_write_buffer_number: 2 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compression: NoCompression 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bottommost_compression: Disabled 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.prefix_extractor: nullptr 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.num_levels: 7 2026-02-17T12:05:26.343 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compression_opts.level: 32767 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compression_opts.strategy: 0 2026-02-17T12:05:26.344 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compression_opts.enabled: false 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.target_file_size_base: 67108864 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-17T12:05:26.345 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.arena_block_size: 1048576 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.disable_auto_compactions: 0 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-17T12:05:26.346 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-17T12:05:26.347 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-17T12:05:26.347 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-17T12:05:26.347 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-17T12:05:26.347 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-17T12:05:26.347 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-17T12:05:26.347 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-17T12:05:26.347 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-17T12:05:26.347 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-17T12:05:26.347 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-17T12:05:26.347 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.inplace_update_support: 0 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.bloom_locality: 0 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.max_successive_merges: 0 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.paranoid_file_checks: 0 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.force_consistency_checks: 1 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.report_bg_io_stats: 0 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.ttl: 2592000 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-17T12:05:26.348 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.enable_blob_files: false 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.min_blob_size: 0 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.blob_file_size: 268435456 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.blob_file_starting_level: 0 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c7fa93de-b9ea-47ea-b280-8657be93e312 2026-02-17T12:05:26.349 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771329926089074, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771329926089974, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 78236, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 253, "table_properties": {"data_size": 76406, "index_size": 215, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11233, "raw_average_key_size": 50, "raw_value_size": 70278, "raw_average_value_size": 313, "num_data_blocks": 9, "num_entries": 224, "num_filter_entries": 224, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771329926, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c7fa93de-b9ea-47ea-b280-8657be93e312", "db_session_id": "UJ2YBTUUVNZILFOYMKGM", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771329926090041, "job": 1, "event": "recovery_finished"} 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5569fd75ee00 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: DB pointer 0x5569fd86a000 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout: ** DB Stats ** 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T12:05:26.350 INFO:journalctl@ceph.mon.a.trial090.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: ** Compaction Stats [default] ** 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: L0 2/0 78.26 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 106.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: Sum 2/0 78.26 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 106.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 106.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T12:05:26.351 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: ** Compaction Stats [default] ** 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 106.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-17T12:05:26.352 INFO:journalctl@ceph.mon.a.trial090.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout: Cumulative compaction: 0.00 GB write, 27.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout: Interval compaction: 0.00 GB write, 27.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout: Block cache BinnedLRUCache@0x5569fd75d350#2 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: starting mon.a rank 0 at public addrs [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] at bind addrs [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: mon.a@-1(???) e1 preinit fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: mon.a@-1(???).mds e1 new map 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: mon.a@-1(???).mds e1 print_map 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout: e1 2026-02-17T12:05:26.353 INFO:journalctl@ceph.mon.a.trial090.stdout: btime 2026-02-17T12:05:25:277420+0000 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout: legacy client fscid: -1 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout: No filesystems configured 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: monmap epoch 1 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: last_changed 2026-02-17T12:05:24.347025+0000 2026-02-17T12:05:26.354 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: created 2026-02-17T12:05:24.347025+0000 2026-02-17T12:05:26.355 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: min_mon_release 19 (squid) 2026-02-17T12:05:26.355 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: election_strategy: 1 2026-02-17T12:05:26.355 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: 0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-17T12:05:26.355 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: fsmap 2026-02-17T12:05:26.355 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: osdmap e1: 0 total, 0 up, 0 in 2026-02-17T12:05:26.355 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:26 trial090 ceph-mon[39228]: mgrmap e1: no daemons active 2026-02-17T12:05:26.360 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mgr.a 2026-02-17T12:05:26.361 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mgr.a.service: Unit ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mgr.a.service not loaded. 2026-02-17T12:05:26.475 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460.target.wants/ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@mgr.a.service → /etc/systemd/system/ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@.service. 2026-02-17T12:05:26.616 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T12:05:26.616 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout disabled 2026-02-17T12:05:26.621 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T12:05:26.621 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-17T12:05:26.622 INFO:teuthology.orchestra.run.trial090.stdout:firewalld.service is not enabled 2026-02-17T12:05:26.622 INFO:teuthology.orchestra.run.trial090.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T12:05:26.628 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T12:05:26.628 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout disabled 2026-02-17T12:05:26.634 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T12:05:26.634 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-17T12:05:26.634 INFO:teuthology.orchestra.run.trial090.stdout:firewalld.service is not enabled 2026-02-17T12:05:26.634 INFO:teuthology.orchestra.run.trial090.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-17T12:05:26.634 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mgr to start... 2026-02-17T12:05:26.634 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mgr... 2026-02-17T12:05:26.661 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:26 trial090 systemd[1]: Started Ceph mgr.a for ea07e39e-0bf8-11f1-bf0e-d404e6e7d460. 2026-02-17T12:05:26.806 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:26.806 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:05:26.806 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "fsid": "ea07e39e-0bf8-11f1-bf0e-d404e6e7d460", 2026-02-17T12:05:26.806 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T12:05:26.806 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 0 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-17T12:05:26.807 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T12:05:26.808 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:26.809 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T12:05:26.809 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T12:05:26.809 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T12:05:26.809 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T12:05:26.809 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T12:05:26.809 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T12:05:26.809 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T12:05:26.809 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T12:05:26.809 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T12:05:26.809 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T12:05:25:277420+0000", 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T12:05:26.810 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T12:05:25.277886+0000", 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.739+0000 7f586b03b640 1 Processor -- start 2026-02-17T12:05:26.811 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.739+0000 7f586b03b640 1 -- start start 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.739+0000 7f586b03b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f5864107190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.739+0000 7f586b03b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5864107760 con 0x7f5864106d90 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.740+0000 7f5868db0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f5864107190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.740+0000 7f5868db0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f5864107190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50174/0 (socket says 10.20.193.90:50174) 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.740+0000 7f5868db0640 1 -- 10.20.193.90:0/2159450091 learned_addr learned my addr 10.20.193.90:0/2159450091 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.740+0000 7f5868db0640 1 -- 10.20.193.90:0/2159450091 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5864107f90 con 0x7f5864106d90 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.740+0000 7f5868db0640 1 --2- 10.20.193.90:0/2159450091 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f5864107190 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5854009920 tx=0x7f585402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabe0e8ffc67567d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f585b7fe640 1 -- 10.20.193.90:0/2159450091 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585403c070 con 0x7f5864106d90 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f585b7fe640 1 -- 10.20.193.90:0/2159450091 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f5854037440 con 0x7f5864106d90 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f585b7fe640 1 -- 10.20.193.90:0/2159450091 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5854035340 con 0x7f5864106d90 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f586b03b640 1 -- 10.20.193.90:0/2159450091 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 msgr2=0x7f5864107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f586b03b640 1 --2- 10.20.193.90:0/2159450091 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f5864107190 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5854009920 tx=0x7f585402ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f586b03b640 1 -- 10.20.193.90:0/2159450091 shutdown_connections 2026-02-17T12:05:26.812 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f586b03b640 1 --2- 10.20.193.90:0/2159450091 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f5864107190 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f586b03b640 1 -- 10.20.193.90:0/2159450091 >> 10.20.193.90:0/2159450091 conn(0x7f5864102540 msgr2=0x7f5864104960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f586b03b640 1 -- 10.20.193.90:0/2159450091 shutdown_connections 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f586b03b640 1 -- 10.20.193.90:0/2159450091 wait complete. 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f586b03b640 1 Processor -- start 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f586b03b640 1 -- start start 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.741+0000 7f586b03b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f586419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f586b03b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f586410b1c0 con 0x7f5864106d90 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5868db0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f586419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5868db0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f586419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50178/0 (socket says 10.20.193.90:50178) 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5868db0640 1 -- 10.20.193.90:0/3092524609 learned_addr learned my addr 10.20.193.90:0/3092524609 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5868db0640 1 -- 10.20.193.90:0/3092524609 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586419d130 con 0x7f5864106d90 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5868db0640 1 --2- 10.20.193.90:0/3092524609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f586419cbf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5854006fd0 tx=0x7f5854035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5859ffb640 1 -- 10.20.193.90:0/3092524609 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5854045070 con 0x7f5864106d90 2026-02-17T12:05:26.813 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5859ffb640 1 -- 10.20.193.90:0/3092524609 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f5854040450 con 0x7f5864106d90 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f586b03b640 1 -- 10.20.193.90:0/3092524609 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586419d3c0 con 0x7f5864106d90 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5859ffb640 1 -- 10.20.193.90:0/3092524609 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f585403c070 con 0x7f5864106d90 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f586b03b640 1 -- 10.20.193.90:0/3092524609 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58641a00b0 con 0x7f5864106d90 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5859ffb640 1 -- 10.20.193.90:0/3092524609 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f585404a440 con 0x7f5864106d90 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5859ffb640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5859ffb640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5859ffb640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5859ffb640 4 mgrc reconnect No active mgr available yet 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f5859ffb640 1 -- 10.20.193.90:0/3092524609 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f58540498b0 con 0x7f5864106d90 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.742+0000 7f586b03b640 1 -- 10.20.193.90:0/3092524609 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5864107210 con 0x7f5864106d90 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.744+0000 7f5859ffb640 1 -- 10.20.193.90:0/3092524609 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f5854049ab0 con 0x7f5864106d90 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.772+0000 7f586b03b640 1 -- 10.20.193.90:0/3092524609 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f58641a0490 con 0x7f5864106d90 2026-02-17T12:05:26.814 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.772+0000 7f5859ffb640 1 -- 10.20.193.90:0/3092524609 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f5854049c90 con 0x7f5864106d90 2026-02-17T12:05:26.815 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.772+0000 7f586b03b640 10 mgrc shutdown 2026-02-17T12:05:26.815 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.772+0000 7f586b03b640 1 -- 10.20.193.90:0/3092524609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 msgr2=0x7f586419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:26.815 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.772+0000 7f586b03b640 1 --2- 10.20.193.90:0/3092524609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f586419cbf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5854006fd0 tx=0x7f5854035570 comp rx=0 tx=0).stop 2026-02-17T12:05:26.815 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.772+0000 7f586b03b640 1 -- 10.20.193.90:0/3092524609 shutdown_connections 2026-02-17T12:05:26.815 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.772+0000 7f586b03b640 1 --2- 10.20.193.90:0/3092524609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5864106d90 0x7f586419cbf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:26.815 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.772+0000 7f586b03b640 1 -- 10.20.193.90:0/3092524609 >> 10.20.193.90:0/3092524609 conn(0x7f5864102540 msgr2=0x7f5864103090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:26.815 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.772+0000 7f586b03b640 1 -- 10.20.193.90:0/3092524609 shutdown_connections 2026-02-17T12:05:26.815 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:26.772+0000 7f586b03b640 1 -- 10.20.193.90:0/3092524609 wait complete. 2026-02-17T12:05:26.815 INFO:teuthology.orchestra.run.trial090.stdout:mgr not available, waiting (1/15)... 2026-02-17T12:05:27.284 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/2331764998' entity='client.admin' 2026-02-17T12:05:27.284 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3092524609' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T12:05:27.284 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:26.998+0000 7f2b1d30f140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T12:05:27.284 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.142+0000 7f2b1d30f140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T12:05:27.284 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.176+0000 7f2b1d30f140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T12:05:27.285 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.217+0000 7f2b1d30f140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T12:05:27.285 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.248+0000 7f2b1d30f140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T12:05:27.285 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.282+0000 7f2b1d30f140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T12:05:27.551 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.348+0000 7f2b1d30f140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T12:05:27.552 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T12:05:27.552 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T12:05:27.552 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: from numpy import show_config as show_numpy_config 2026-02-17T12:05:27.552 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.421+0000 7f2b1d30f140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T12:05:27.552 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.455+0000 7f2b1d30f140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T12:05:27.552 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.550+0000 7f2b1d30f140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T12:05:27.829 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.609+0000 7f2b1d30f140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T12:05:27.830 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.643+0000 7f2b1d30f140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T12:05:27.830 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.675+0000 7f2b1d30f140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T12:05:27.830 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.710+0000 7f2b1d30f140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T12:05:27.830 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.739+0000 7f2b1d30f140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T12:05:28.234 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:27.979+0000 7f2b1d30f140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T12:05:28.234 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:28 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:28.078+0000 7f2b1d30f140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T12:05:28.234 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:28 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:28.109+0000 7f2b1d30f140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T12:05:28.234 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:28 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:28.140+0000 7f2b1d30f140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T12:05:28.235 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:28 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:28.233+0000 7f2b1d30f140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:05:28.579 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:28 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:28.262+0000 7f2b1d30f140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T12:05:28.580 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:28 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:28.354+0000 7f2b1d30f140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:05:28.963 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:28.963 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:05:28.963 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "fsid": "ea07e39e-0bf8-11f1-bf0e-d404e6e7d460", 2026-02-17T12:05:28.963 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T12:05:28.963 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T12:05:28.963 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T12:05:28.963 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T12:05:28.963 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:28.963 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 0 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T12:05:28.964 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T12:05:28.965 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T12:05:25:277420+0000", 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T12:05:28.966 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T12:05:28.967 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T12:05:25.277886+0000", 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.900+0000 7fc34d3e6640 1 Processor -- start 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.900+0000 7fc34d3e6640 1 -- start start 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.900+0000 7fc34d3e6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc348109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.900+0000 7fc34d3e6640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc34807ae00 con 0x7fc3481078e0 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.900+0000 7fc346ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc348109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:28.968 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.900+0000 7fc346ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc348109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50180/0 (socket says 10.20.193.90:50180) 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.900+0000 7fc346ffd640 1 -- 10.20.193.90:0/2614484407 learned_addr learned my addr 10.20.193.90:0/2614484407 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.901+0000 7fc346ffd640 1 -- 10.20.193.90:0/2614484407 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34810a210 con 0x7fc3481078e0 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.901+0000 7fc346ffd640 1 --2- 10.20.193.90:0/2614484407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc348109cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009920 tx=0x7fc33c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf39f86ff110001 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.901+0000 7fc345ffb640 1 -- 10.20.193.90:0/2614484407 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c03c070 con 0x7fc3481078e0 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.901+0000 7fc345ffb640 1 -- 10.20.193.90:0/2614484407 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fc33c037440 con 0x7fc3481078e0 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.901+0000 7fc345ffb640 1 -- 10.20.193.90:0/2614484407 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c035340 con 0x7fc3481078e0 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 -- 10.20.193.90:0/2614484407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 msgr2=0x7fc348109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 --2- 10.20.193.90:0/2614484407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc348109cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009920 tx=0x7fc33c02ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 -- 10.20.193.90:0/2614484407 shutdown_connections 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 --2- 10.20.193.90:0/2614484407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc348109cd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 -- 10.20.193.90:0/2614484407 >> 10.20.193.90:0/2614484407 conn(0x7fc348101400 msgr2=0x7fc348103840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:28.969 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 -- 10.20.193.90:0/2614484407 shutdown_connections 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 -- 10.20.193.90:0/2614484407 wait complete. 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 Processor -- start 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 -- start start 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc34819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc34d3e6640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc34810af80 con 0x7fc3481078e0 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc346ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc34819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc346ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc34819ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50192/0 (socket says 10.20.193.90:50192) 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc346ffd640 1 -- 10.20.193.90:0/936062645 learned_addr learned my addr 10.20.193.90:0/936062645 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc346ffd640 1 -- 10.20.193.90:0/936062645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34819f3a0 con 0x7fc3481078e0 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.902+0000 7fc346ffd640 1 --2- 10.20.193.90:0/936062645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc34819ee60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc33c006fd0 tx=0x7fc33c035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc327fff640 1 -- 10.20.193.90:0/936062645 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c045070 con 0x7fc3481078e0 2026-02-17T12:05:28.970 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc327fff640 1 -- 10.20.193.90:0/936062645 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fc33c040450 con 0x7fc3481078e0 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc327fff640 1 -- 10.20.193.90:0/936062645 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c03c070 con 0x7fc3481078e0 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc34d3e6640 1 -- 10.20.193.90:0/936062645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34819f630 con 0x7fc3481078e0 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc34d3e6640 1 -- 10.20.193.90:0/936062645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3481a2320 con 0x7fc3481078e0 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc327fff640 1 -- 10.20.193.90:0/936062645 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc33c04a440 con 0x7fc3481078e0 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc327fff640 20 mgrc handle_mgr_map mgrmap(e 1) 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc327fff640 4 mgrc handle_mgr_map Got map version 1 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc327fff640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc327fff640 4 mgrc reconnect No active mgr available yet 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc327fff640 1 -- 10.20.193.90:0/936062645 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc33c0498b0 con 0x7fc3481078e0 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.903+0000 7fc34d3e6640 1 -- 10.20.193.90:0/936062645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc348107d40 con 0x7fc3481078e0 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.904+0000 7fc327fff640 1 -- 10.20.193.90:0/936062645 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fc33c0408e0 con 0x7fc3481078e0 2026-02-17T12:05:28.971 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.934+0000 7fc34d3e6640 1 -- 10.20.193.90:0/936062645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc3481a26c0 con 0x7fc3481078e0 2026-02-17T12:05:28.972 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.934+0000 7fc327fff640 1 -- 10.20.193.90:0/936062645 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fc33c02fae0 con 0x7fc3481078e0 2026-02-17T12:05:28.972 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.934+0000 7fc34d3e6640 10 mgrc shutdown 2026-02-17T12:05:28.972 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.934+0000 7fc34d3e6640 1 -- 10.20.193.90:0/936062645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 msgr2=0x7fc34819ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:28.972 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.934+0000 7fc34d3e6640 1 --2- 10.20.193.90:0/936062645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc34819ee60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc33c006fd0 tx=0x7fc33c035f80 comp rx=0 tx=0).stop 2026-02-17T12:05:28.972 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.934+0000 7fc34d3e6640 1 -- 10.20.193.90:0/936062645 shutdown_connections 2026-02-17T12:05:28.972 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.934+0000 7fc34d3e6640 1 --2- 10.20.193.90:0/936062645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc3481078e0 0x7fc34819ee60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:28.972 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.934+0000 7fc34d3e6640 1 -- 10.20.193.90:0/936062645 >> 10.20.193.90:0/936062645 conn(0x7fc348101400 msgr2=0x7fc348101fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:28.972 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.934+0000 7fc34d3e6640 1 -- 10.20.193.90:0/936062645 shutdown_connections 2026-02-17T12:05:28.972 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:28.934+0000 7fc34d3e6640 1 -- 10.20.193.90:0/936062645 wait complete. 2026-02-17T12:05:28.972 INFO:teuthology.orchestra.run.trial090.stdout:mgr not available, waiting (2/15)... 2026-02-17T12:05:29.079 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:28 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/936062645' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T12:05:29.080 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:28 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:28.811+0000 7f2b1d30f140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T12:05:29.080 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:28 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:28.843+0000 7f2b1d30f140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T12:05:29.579 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:29.244+0000 7f2b1d30f140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T12:05:30.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: Activating manager daemon a 2026-02-17T12:05:30.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: mgrmap e2: a(active, starting, since 0.00203095s) 2026-02-17T12:05:30.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: from='mgr.14100 10.20.193.90:0/114071' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T12:05:30.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: from='mgr.14100 10.20.193.90:0/114071' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T12:05:30.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: from='mgr.14100 10.20.193.90:0/114071' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T12:05:30.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: from='mgr.14100 10.20.193.90:0/114071' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T12:05:30.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: from='mgr.14100 10.20.193.90:0/114071' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T12:05:30.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: Manager daemon a is now available 2026-02-17T12:05:30.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: from='mgr.14100 10.20.193.90:0/114071' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T12:05:30.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: from='mgr.14100 10.20.193.90:0/114071' entity='mgr.a' 2026-02-17T12:05:30.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: from='mgr.14100 10.20.193.90:0/114071' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T12:05:30.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: from='mgr.14100 10.20.193.90:0/114071' entity='mgr.a' 2026-02-17T12:05:30.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:29 trial090 ceph-mon[39228]: from='mgr.14100 10.20.193.90:0/114071' entity='mgr.a' 2026-02-17T12:05:31.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:31.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:05:31.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "fsid": "ea07e39e-0bf8-11f1-bf0e-d404e6e7d460", 2026-02-17T12:05:31.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T12:05:31.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T12:05:31.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T12:05:31.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T12:05:31.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 0 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "a" 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T12:05:31.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T12:05:31.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T12:05:25:277420+0000", 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T12:05:31.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T12:05:31.208 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T12:05:25.277886+0000", 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.053+0000 7f97cee70640 1 Processor -- start 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.053+0000 7f97cee70640 1 -- start start 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.053+0000 7f97cee70640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c8109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.053+0000 7f97cee70640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97c81099d0 con 0x7f97c8109000 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.053+0000 7f97ccbe5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c8109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.053+0000 7f97ccbe5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c8109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50258/0 (socket says 10.20.193.90:50258) 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.053+0000 7f97ccbe5640 1 -- 10.20.193.90:0/2317610959 learned_addr learned my addr 10.20.193.90:0/2317610959 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:31.209 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.053+0000 7f97ccbe5640 1 -- 10.20.193.90:0/2317610959 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c810a200 con 0x7f97c8109000 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.053+0000 7f97ccbe5640 1 --2- 10.20.193.90:0/2317610959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c8109400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009920 tx=0x7f97b802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcce28ef528dd6b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97bf7fe640 1 -- 10.20.193.90:0/2317610959 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b803c070 con 0x7f97c8109000 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97bf7fe640 1 -- 10.20.193.90:0/2317610959 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f97b8037440 con 0x7f97c8109000 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97bf7fe640 1 -- 10.20.193.90:0/2317610959 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b8035340 con 0x7f97c8109000 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 -- 10.20.193.90:0/2317610959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 msgr2=0x7f97c8109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 --2- 10.20.193.90:0/2317610959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c8109400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009920 tx=0x7f97b802ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 -- 10.20.193.90:0/2317610959 shutdown_connections 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 --2- 10.20.193.90:0/2317610959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c8109400 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 -- 10.20.193.90:0/2317610959 >> 10.20.193.90:0/2317610959 conn(0x7f97c807c4e0 msgr2=0x7f97c807c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 -- 10.20.193.90:0/2317610959 shutdown_connections 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 -- 10.20.193.90:0/2317610959 wait complete. 2026-02-17T12:05:31.210 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 Processor -- start 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 -- start start 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97cee70640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97c810d430 con 0x7f97c8109000 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97ccbe5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97ccbe5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c819eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50260/0 (socket says 10.20.193.90:50260) 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.054+0000 7f97ccbe5640 1 -- 10.20.193.90:0/911169749 learned_addr learned my addr 10.20.193.90:0/911169749 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.055+0000 7f97ccbe5640 1 -- 10.20.193.90:0/911169749 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c819f3e0 con 0x7f97c8109000 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.055+0000 7f97ccbe5640 1 --2- 10.20.193.90:0/911169749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c819eea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f97b8006fd0 tx=0x7f97b8035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.055+0000 7f97bdffb640 1 -- 10.20.193.90:0/911169749 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b8045070 con 0x7f97c8109000 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.055+0000 7f97bdffb640 1 -- 10.20.193.90:0/911169749 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f97b8040450 con 0x7f97c8109000 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.055+0000 7f97cee70640 1 -- 10.20.193.90:0/911169749 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c819f670 con 0x7f97c8109000 2026-02-17T12:05:31.211 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.055+0000 7f97bdffb640 1 -- 10.20.193.90:0/911169749 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b803c070 con 0x7f97c8109000 2026-02-17T12:05:31.212 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.055+0000 7f97cee70640 1 -- 10.20.193.90:0/911169749 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c81a2360 con 0x7f97c8109000 2026-02-17T12:05:31.212 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.055+0000 7f97cee70640 1 -- 10.20.193.90:0/911169749 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c819fb50 con 0x7f97c8109000 2026-02-17T12:05:31.212 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.055+0000 7f97bdffb640 1 -- 10.20.193.90:0/911169749 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 3) ==== 50130+0+0 (secure 0 0 0) 0x7f97b80493b0 con 0x7f97c8109000 2026-02-17T12:05:31.212 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.055+0000 7f97bdffb640 20 mgrc handle_mgr_map mgrmap(e 3) 2026-02-17T12:05:31.212 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.056+0000 7f97bdffb640 4 mgrc handle_mgr_map Got map version 3 2026-02-17T12:05:31.212 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.056+0000 7f97bdffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:31.212 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.056+0000 7f97bdffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:31.212 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.056+0000 7f97bdffb640 1 --2- 10.20.193.90:0/911169749 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f97a403da80 0x7f97a403ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:31.212 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.056+0000 7f97bdffb640 1 -- 10.20.193.90:0/911169749 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f97b8076500 con 0x7f97c8109000 2026-02-17T12:05:31.212 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.056+0000 7f97bffff640 1 --2- 10.20.193.90:0/911169749 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f97a403da80 0x7f97a403ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:31.213 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.056+0000 7f97bffff640 1 --2- 10.20.193.90:0/911169749 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f97a403da80 0x7f97a403ff40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f97b00099c0 tx=0x7f97b0006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:31.213 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.059+0000 7f97bdffb640 1 -- 10.20.193.90:0/911169749 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f97c819fb50 con 0x7f97c8109000 2026-02-17T12:05:31.213 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.173+0000 7f97cee70640 1 -- 10.20.193.90:0/911169749 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f97c81a2800 con 0x7f97c8109000 2026-02-17T12:05:31.213 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.173+0000 7f97bdffb640 1 -- 10.20.193.90:0/911169749 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f97b8047d40 con 0x7f97c8109000 2026-02-17T12:05:31.213 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 10 mgrc shutdown 2026-02-17T12:05:31.213 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 1 -- 10.20.193.90:0/911169749 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f97a403da80 msgr2=0x7f97a403ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:31.213 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 1 --2- 10.20.193.90:0/911169749 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f97a403da80 0x7f97a403ff40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f97b00099c0 tx=0x7f97b0006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:31.213 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 1 -- 10.20.193.90:0/911169749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 msgr2=0x7f97c819eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:31.213 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 1 --2- 10.20.193.90:0/911169749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c819eea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f97b8006fd0 tx=0x7f97b8035570 comp rx=0 tx=0).stop 2026-02-17T12:05:31.213 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 1 -- 10.20.193.90:0/911169749 shutdown_connections 2026-02-17T12:05:31.214 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 1 --2- 10.20.193.90:0/911169749 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f97a403da80 0x7f97a403ff40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:31.214 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 1 --2- 10.20.193.90:0/911169749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f97c8109000 0x7f97c819eea0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:31.214 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 1 -- 10.20.193.90:0/911169749 >> 10.20.193.90:0/911169749 conn(0x7f97c807c4e0 msgr2=0x7f97c8106720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:31.214 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 1 -- 10.20.193.90:0/911169749 shutdown_connections 2026-02-17T12:05:31.214 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.174+0000 7f97cee70640 1 -- 10.20.193.90:0/911169749 wait complete. 2026-02-17T12:05:31.214 INFO:teuthology.orchestra.run.trial090.stdout:mgr is available 2026-02-17T12:05:31.402 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:31.402 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T12:05:31.402 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout fsid = ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:31.402 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T12:05:31.402 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.90:3300,v1:10.20.193.90:6789] 2026-02-17T12:05:31.403 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T12:05:31.403 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T12:05:31.403 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T12:05:31.403 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T12:05:31.403 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:31.403 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T12:05:31.403 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T12:05:31.403 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-17T12:05:31.403 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T12:05:31.403 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-17T12:05:31.404 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-17T12:05:31.404 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-17T12:05:31.404 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T12:05:31.404 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T12:05:31.404 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.287+0000 7fa1d353a640 1 Processor -- start 2026-02-17T12:05:31.404 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.287+0000 7fa1d353a640 1 -- start start 2026-02-17T12:05:31.404 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.287+0000 7fa1d353a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:31.404 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.287+0000 7fa1d353a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc109a00 con 0x7fa1cc109030 2026-02-17T12:05:31.404 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.287+0000 7fa1d12af640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:31.404 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.287+0000 7fa1d12af640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50266/0 (socket says 10.20.193.90:50266) 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.287+0000 7fa1d12af640 1 -- 10.20.193.90:0/172796726 learned_addr learned my addr 10.20.193.90:0/172796726 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.287+0000 7fa1d12af640 1 -- 10.20.193.90:0/172796726 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1cc10a1e0 con 0x7fa1cc109030 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1d12af640 1 --2- 10.20.193.90:0/172796726 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc109430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009920 tx=0x7fa1bc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75342c7993d8c816 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1bbfff640 1 -- 10.20.193.90:0/172796726 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1bc03c070 con 0x7fa1cc109030 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1bbfff640 1 -- 10.20.193.90:0/172796726 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa1bc037440 con 0x7fa1cc109030 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1bbfff640 1 -- 10.20.193.90:0/172796726 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1bc035340 con 0x7fa1cc109030 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1d353a640 1 -- 10.20.193.90:0/172796726 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 msgr2=0x7fa1cc109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1d353a640 1 --2- 10.20.193.90:0/172796726 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc109430 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009920 tx=0x7fa1bc02ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1d353a640 1 -- 10.20.193.90:0/172796726 shutdown_connections 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1d353a640 1 --2- 10.20.193.90:0/172796726 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc109430 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:31.405 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1d353a640 1 -- 10.20.193.90:0/172796726 >> 10.20.193.90:0/172796726 conn(0x7fa1cc07c520 msgr2=0x7fa1cc07c930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1d353a640 1 -- 10.20.193.90:0/172796726 shutdown_connections 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1d353a640 1 -- 10.20.193.90:0/172796726 wait complete. 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1d353a640 1 Processor -- start 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.288+0000 7fa1d353a640 1 -- start start 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1d353a640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc19ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1d353a640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc10d410 con 0x7fa1cc109030 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1d12af640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc19ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1d12af640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc19ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50282/0 (socket says 10.20.193.90:50282) 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1d12af640 1 -- 10.20.193.90:0/1181078261 learned_addr learned my addr 10.20.193.90:0/1181078261 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1d12af640 1 -- 10.20.193.90:0/1181078261 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1cc19f340 con 0x7fa1cc109030 2026-02-17T12:05:31.406 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1d12af640 1 --2- 10.20.193.90:0/1181078261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc19ee00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc02f4a0 tx=0x7fa1bc035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:31.407 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1ba7fc640 1 -- 10.20.193.90:0/1181078261 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1bc045070 con 0x7fa1cc109030 2026-02-17T12:05:31.407 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1ba7fc640 1 -- 10.20.193.90:0/1181078261 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa1bc040450 con 0x7fa1cc109030 2026-02-17T12:05:31.407 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1d353a640 1 -- 10.20.193.90:0/1181078261 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1cc19f5d0 con 0x7fa1cc109030 2026-02-17T12:05:31.407 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1ba7fc640 1 -- 10.20.193.90:0/1181078261 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1bc03c070 con 0x7fa1cc109030 2026-02-17T12:05:31.407 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1d353a640 1 -- 10.20.193.90:0/1181078261 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1cc1a22c0 con 0x7fa1cc109030 2026-02-17T12:05:31.407 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1d353a640 1 -- 10.20.193.90:0/1181078261 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1cc1094b0 con 0x7fa1cc109030 2026-02-17T12:05:31.407 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1ba7fc640 1 -- 10.20.193.90:0/1181078261 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 4) ==== 50236+0+0 (secure 0 0 0) 0x7fa1bc0493b0 con 0x7fa1cc109030 2026-02-17T12:05:31.407 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.289+0000 7fa1ba7fc640 20 mgrc handle_mgr_map mgrmap(e 4) 2026-02-17T12:05:31.407 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.290+0000 7fa1ba7fc640 4 mgrc handle_mgr_map Got map version 4 2026-02-17T12:05:31.407 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.290+0000 7fa1ba7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:31.408 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.290+0000 7fa1ba7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:31.408 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.290+0000 7fa1ba7fc640 1 --2- 10.20.193.90:0/1181078261 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7fa1a803dba0 0x7fa1a8040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:31.408 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.290+0000 7fa1ba7fc640 1 -- 10.20.193.90:0/1181078261 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa1bc076640 con 0x7fa1cc109030 2026-02-17T12:05:31.408 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.290+0000 7fa1d0aae640 1 --2- 10.20.193.90:0/1181078261 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7fa1a803dba0 0x7fa1a8040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:31.408 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.290+0000 7fa1d0aae640 1 --2- 10.20.193.90:0/1181078261 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7fa1a803dba0 0x7fa1a8040060 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00099c0 tx=0x7fa1c0006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:31.408 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.292+0000 7fa1ba7fc640 1 -- 10.20.193.90:0/1181078261 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa1bc03c210 con 0x7fa1cc109030 2026-02-17T12:05:31.408 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.374+0000 7fa1d353a640 1 -- 10.20.193.90:0/1181078261 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa1cc1a38a0 con 0x7fa1cc109030 2026-02-17T12:05:31.408 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.374+0000 7fa1ba7fc640 1 -- 10.20.193.90:0/1181078261 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+465 (secure 0 0 0) 0x7fa1bc076060 con 0x7fa1cc109030 2026-02-17T12:05:31.408 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 10 mgrc shutdown 2026-02-17T12:05:31.408 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 1 -- 10.20.193.90:0/1181078261 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7fa1a803dba0 msgr2=0x7fa1a8040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:31.409 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 1 --2- 10.20.193.90:0/1181078261 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7fa1a803dba0 0x7fa1a8040060 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00099c0 tx=0x7fa1c0006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:31.409 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 1 -- 10.20.193.90:0/1181078261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 msgr2=0x7fa1cc19ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:31.409 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 1 --2- 10.20.193.90:0/1181078261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc19ee00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc02f4a0 tx=0x7fa1bc035f80 comp rx=0 tx=0).stop 2026-02-17T12:05:31.409 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 1 -- 10.20.193.90:0/1181078261 shutdown_connections 2026-02-17T12:05:31.409 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 1 --2- 10.20.193.90:0/1181078261 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7fa1a803dba0 0x7fa1a8040060 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:31.409 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 1 --2- 10.20.193.90:0/1181078261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1cc109030 0x7fa1cc19ee00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:31.409 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 1 -- 10.20.193.90:0/1181078261 >> 10.20.193.90:0/1181078261 conn(0x7fa1cc07c520 msgr2=0x7fa1cc106720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:31.409 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 1 -- 10.20.193.90:0/1181078261 shutdown_connections 2026-02-17T12:05:31.409 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.375+0000 7fa1d353a640 1 -- 10.20.193.90:0/1181078261 wait complete. 2026-02-17T12:05:31.409 INFO:teuthology.orchestra.run.trial090.stdout:Enabling cephadm module... 2026-02-17T12:05:31.489 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:31 trial090 ceph-mon[39228]: mgrmap e3: a(active, since 1.00525s) 2026-02-17T12:05:31.489 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:31 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/911169749' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T12:05:32.284 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.488+0000 7f9a24c0b640 1 Processor -- start 2026-02-17T12:05:32.284 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.488+0000 7f9a24c0b640 1 -- start start 2026-02-17T12:05:32.284 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.488+0000 7f9a24c0b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a20109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.284 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.488+0000 7f9a24c0b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20109a00 con 0x7f9a20109030 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.488+0000 7f9a1e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a20109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.488+0000 7f9a1e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a20109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50294/0 (socket says 10.20.193.90:50294) 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.488+0000 7f9a1e575640 1 -- 10.20.193.90:0/3502882067 learned_addr learned my addr 10.20.193.90:0/3502882067 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.488+0000 7f9a1e575640 1 -- 10.20.193.90:0/3502882067 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2010a230 con 0x7f9a20109030 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a1e575640 1 --2- 10.20.193.90:0/3502882067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a20109430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009920 tx=0x7f9a1402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38522667d1670f22 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a1d573640 1 -- 10.20.193.90:0/3502882067 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a1403c070 con 0x7f9a20109030 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a1d573640 1 -- 10.20.193.90:0/3502882067 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f9a14037440 con 0x7f9a20109030 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a1d573640 1 -- 10.20.193.90:0/3502882067 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a14035340 con 0x7f9a20109030 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a24c0b640 1 -- 10.20.193.90:0/3502882067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 msgr2=0x7f9a20109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a24c0b640 1 --2- 10.20.193.90:0/3502882067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a20109430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009920 tx=0x7f9a1402ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a24c0b640 1 -- 10.20.193.90:0/3502882067 shutdown_connections 2026-02-17T12:05:32.285 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a24c0b640 1 --2- 10.20.193.90:0/3502882067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a20109430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.286 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a24c0b640 1 -- 10.20.193.90:0/3502882067 >> 10.20.193.90:0/3502882067 conn(0x7f9a2007c4e0 msgr2=0x7f9a2007c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:32.286 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a24c0b640 1 -- 10.20.193.90:0/3502882067 shutdown_connections 2026-02-17T12:05:32.286 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.489+0000 7f9a24c0b640 1 -- 10.20.193.90:0/3502882067 wait complete. 2026-02-17T12:05:32.286 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a24c0b640 1 Processor -- start 2026-02-17T12:05:32.286 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a24c0b640 1 -- start start 2026-02-17T12:05:32.286 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a24c0b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a2019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.286 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a24c0b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2010d460 con 0x7f9a20109030 2026-02-17T12:05:32.286 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a1e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a2019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.286 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a1e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a2019ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50302/0 (socket says 10.20.193.90:50302) 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a1e575640 1 -- 10.20.193.90:0/1149076463 learned_addr learned my addr 10.20.193.90:0/1149076463 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a1e575640 1 -- 10.20.193.90:0/1149076463 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2019f3d0 con 0x7f9a20109030 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a1e575640 1 --2- 10.20.193.90:0/1149076463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a2019ee90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9a14006fd0 tx=0x7f9a14035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a077fe640 1 -- 10.20.193.90:0/1149076463 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a14045070 con 0x7f9a20109030 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a077fe640 1 -- 10.20.193.90:0/1149076463 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f9a14040450 con 0x7f9a20109030 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a24c0b640 1 -- 10.20.193.90:0/1149076463 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a2019f660 con 0x7f9a20109030 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a077fe640 1 -- 10.20.193.90:0/1149076463 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a1403c070 con 0x7f9a20109030 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.490+0000 7f9a24c0b640 1 -- 10.20.193.90:0/1149076463 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a201a2350 con 0x7f9a20109030 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.491+0000 7f9a077fe640 1 -- 10.20.193.90:0/1149076463 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 4) ==== 50236+0+0 (secure 0 0 0) 0x7f9a140493b0 con 0x7f9a20109030 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.491+0000 7f9a077fe640 20 mgrc handle_mgr_map mgrmap(e 4) 2026-02-17T12:05:32.287 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.491+0000 7f9a24c0b640 1 -- 10.20.193.90:0/1149076463 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a201094b0 con 0x7f9a20109030 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.491+0000 7f9a077fe640 4 mgrc handle_mgr_map Got map version 4 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.491+0000 7f9a077fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.491+0000 7f9a077fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.491+0000 7f9a077fe640 1 --2- 10.20.193.90:0/1149076463 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f99f803dba0 0x7f99f8040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.491+0000 7f9a077fe640 1 -- 10.20.193.90:0/1149076463 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9a140765f0 con 0x7f9a20109030 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.491+0000 7f9a1dd74640 1 --2- 10.20.193.90:0/1149076463 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f99f803dba0 0x7f99f8040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.491+0000 7f9a1dd74640 1 --2- 10.20.193.90:0/1149076463 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f99f803dba0 0x7f99f8040060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a080099c0 tx=0x7f9a08006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.494+0000 7f9a077fe640 1 -- 10.20.193.90:0/1149076463 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9a14076010 con 0x7f9a20109030 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:31.603+0000 7f9a24c0b640 1 -- 10.20.193.90:0/1149076463 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f9a201a27b0 con 0x7f9a20109030 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.255+0000 7f9a077fe640 1 -- 10.20.193.90:0/1149076463 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f9a14033200 con 0x7f9a20109030 2026-02-17T12:05:32.288 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.256+0000 7f9a077fe640 1 -- 10.20.193.90:0/1149076463 <== mon.0 v2:10.20.193.90:3300/0 8 ==== mgrmap(e 5) ==== 50247+0+0 (secure 0 0 0) 0x7f9a14048b80 con 0x7f9a20109030 2026-02-17T12:05:32.289 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.256+0000 7f9a077fe640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-17T12:05:32.289 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.257+0000 7f9a077fe640 4 mgrc handle_mgr_map Got map version 5 2026-02-17T12:05:32.289 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.257+0000 7f9a077fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:32.289 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 10 mgrc shutdown 2026-02-17T12:05:32.289 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 1 -- 10.20.193.90:0/1149076463 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f99f803dba0 msgr2=0x7f99f8040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:32.289 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 1 --2- 10.20.193.90:0/1149076463 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f99f803dba0 0x7f99f8040060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a080099c0 tx=0x7f9a08006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.289 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 1 -- 10.20.193.90:0/1149076463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 msgr2=0x7f9a2019ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:32.289 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 1 --2- 10.20.193.90:0/1149076463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a2019ee90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9a14006fd0 tx=0x7f9a14035570 comp rx=0 tx=0).stop 2026-02-17T12:05:32.289 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 1 -- 10.20.193.90:0/1149076463 shutdown_connections 2026-02-17T12:05:32.289 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 1 --2- 10.20.193.90:0/1149076463 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f99f803dba0 0x7f99f8040060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.290 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 1 --2- 10.20.193.90:0/1149076463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a20109030 0x7f9a2019ee90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.290 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 1 -- 10.20.193.90:0/1149076463 >> 10.20.193.90:0/1149076463 conn(0x7f9a2007c4e0 msgr2=0x7f9a20106720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:32.290 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 1 -- 10.20.193.90:0/1149076463 shutdown_connections 2026-02-17T12:05:32.290 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.258+0000 7f9a24c0b640 1 -- 10.20.193.90:0/1149076463 wait complete. 2026-02-17T12:05:32.505 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-mon[39228]: mgrmap e4: a(active, since 2s) 2026-02-17T12:05:32.505 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/1181078261' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-17T12:05:32.505 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/1149076463' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-17T12:05:32.506 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: ignoring --setuser ceph since I am not root 2026-02-17T12:05:32.506 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: ignoring --setgroup ceph since I am not root 2026-02-17T12:05:32.516 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:05:32.516 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-17T12:05:32.516 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T12:05:32.516 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-17T12:05:32.517 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T12:05:32.517 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:05:32.517 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.378+0000 7f0b55346640 1 Processor -- start 2026-02-17T12:05:32.517 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.378+0000 7f0b55346640 1 -- start start 2026-02-17T12:05:32.517 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.378+0000 7f0b55346640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b50109cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.517 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.378+0000 7f0b55346640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5007ae00 con 0x7f0b501078e0 2026-02-17T12:05:32.517 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.379+0000 7f0b4effd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b50109cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.517 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.379+0000 7f0b4effd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b50109cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50324/0 (socket says 10.20.193.90:50324) 2026-02-17T12:05:32.517 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.379+0000 7f0b4effd640 1 -- 10.20.193.90:0/1454178866 learned_addr learned my addr 10.20.193.90:0/1454178866 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:32.517 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.379+0000 7f0b4effd640 1 -- 10.20.193.90:0/1454178866 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5010a210 con 0x7f0b501078e0 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.379+0000 7f0b4effd640 1 --2- 10.20.193.90:0/1454178866 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b50109cd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009920 tx=0x7f0b4402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f94713d57131b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.379+0000 7f0b4dffb640 1 -- 10.20.193.90:0/1454178866 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4403c070 con 0x7f0b501078e0 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.379+0000 7f0b4dffb640 1 -- 10.20.193.90:0/1454178866 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f0b44037440 con 0x7f0b501078e0 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.379+0000 7f0b4dffb640 1 -- 10.20.193.90:0/1454178866 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b44035340 con 0x7f0b501078e0 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 -- 10.20.193.90:0/1454178866 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 msgr2=0x7f0b50109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 --2- 10.20.193.90:0/1454178866 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b50109cd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009920 tx=0x7f0b4402ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 -- 10.20.193.90:0/1454178866 shutdown_connections 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 --2- 10.20.193.90:0/1454178866 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b50109cd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 -- 10.20.193.90:0/1454178866 >> 10.20.193.90:0/1454178866 conn(0x7f0b50101400 msgr2=0x7f0b50103840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 -- 10.20.193.90:0/1454178866 shutdown_connections 2026-02-17T12:05:32.518 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 -- 10.20.193.90:0/1454178866 wait complete. 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 Processor -- start 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 -- start start 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b501070e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5010af80 con 0x7f0b501078e0 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b4effd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b501070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b4effd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b501070e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50338/0 (socket says 10.20.193.90:50338) 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b4effd640 1 -- 10.20.193.90:0/657821665 learned_addr learned my addr 10.20.193.90:0/657821665 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b4effd640 1 -- 10.20.193.90:0/657821665 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b50107620 con 0x7f0b501078e0 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b4effd640 1 --2- 10.20.193.90:0/657821665 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b501070e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0b44006fd0 tx=0x7f0b44035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b2ffff640 1 -- 10.20.193.90:0/657821665 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b44045070 con 0x7f0b501078e0 2026-02-17T12:05:32.519 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b2ffff640 1 -- 10.20.193.90:0/657821665 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f0b44040450 con 0x7f0b501078e0 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b55346640 1 -- 10.20.193.90:0/657821665 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b50105810 con 0x7f0b501078e0 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.380+0000 7f0b2ffff640 1 -- 10.20.193.90:0/657821665 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0b4403c070 con 0x7f0b501078e0 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b55346640 1 -- 10.20.193.90:0/657821665 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b50105cf0 con 0x7f0b501078e0 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b55346640 1 -- 10.20.193.90:0/657821665 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b50107d40 con 0x7f0b501078e0 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b2ffff640 1 -- 10.20.193.90:0/657821665 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 5) ==== 50247+0+0 (secure 0 0 0) 0x7f0b4402fae0 con 0x7f0b501078e0 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b2ffff640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b2ffff640 4 mgrc handle_mgr_map Got map version 5 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b2ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b2ffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b2ffff640 1 --2- 10.20.193.90:0/657821665 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f0b2003dba0 0x7f0b20040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b2ffff640 1 -- 10.20.193.90:0/657821665 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0b440766f0 con 0x7f0b501078e0 2026-02-17T12:05:32.520 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b4e7fc640 1 -- 10.20.193.90:0/657821665 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f0b2003dba0 msgr2=0x7f0b20040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.90:6800/4114489928 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.381+0000 7f0b4e7fc640 1 --2- 10.20.193.90:0/657821665 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f0b2003dba0 0x7f0b20040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.384+0000 7f0b2ffff640 1 -- 10.20.193.90:0/657821665 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0b44076110 con 0x7f0b501078e0 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.489+0000 7f0b55346640 1 -- 10.20.193.90:0/657821665 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0b501062e0 con 0x7f0b501078e0 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.489+0000 7f0b2ffff640 1 -- 10.20.193.90:0/657821665 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f0b440408e0 con 0x7f0b501078e0 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 10 mgrc shutdown 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 1 -- 10.20.193.90:0/657821665 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f0b2003dba0 msgr2=0x7f0b20040060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 1 --2- 10.20.193.90:0/657821665 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f0b2003dba0 0x7f0b20040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 1 -- 10.20.193.90:0/657821665 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 msgr2=0x7f0b501070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 1 --2- 10.20.193.90:0/657821665 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b501070e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0b44006fd0 tx=0x7f0b44035f80 comp rx=0 tx=0).stop 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 1 -- 10.20.193.90:0/657821665 shutdown_connections 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 1 --2- 10.20.193.90:0/657821665 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f0b2003dba0 0x7f0b20040060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.521 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 1 --2- 10.20.193.90:0/657821665 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b501078e0 0x7f0b501070e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:32.522 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 1 -- 10.20.193.90:0/657821665 >> 10.20.193.90:0/657821665 conn(0x7f0b50101400 msgr2=0x7f0b50101fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:32.522 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 1 -- 10.20.193.90:0/657821665 shutdown_connections 2026-02-17T12:05:32.522 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.490+0000 7f0b55346640 1 -- 10.20.193.90:0/657821665 wait complete. 2026-02-17T12:05:32.522 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for the mgr to restart... 2026-02-17T12:05:32.522 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mgr epoch 5... 2026-02-17T12:05:32.809 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:32.663+0000 7fd218da6140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T12:05:32.809 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:32.806+0000 7fd218da6140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T12:05:33.079 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:32.840+0000 7fd218da6140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T12:05:33.080 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:32.882+0000 7fd218da6140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T12:05:33.080 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:32.913+0000 7fd218da6140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T12:05:33.080 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:32 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:32.947+0000 7fd218da6140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T12:05:33.080 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.012+0000 7fd218da6140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T12:05:33.341 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/1149076463' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-17T12:05:33.341 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-mon[39228]: mgrmap e5: a(active, since 3s) 2026-02-17T12:05:33.341 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/657821665' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T12:05:33.342 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T12:05:33.342 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T12:05:33.342 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: from numpy import show_config as show_numpy_config 2026-02-17T12:05:33.342 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.083+0000 7fd218da6140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T12:05:33.342 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.117+0000 7fd218da6140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T12:05:33.342 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.213+0000 7fd218da6140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T12:05:33.342 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.273+0000 7fd218da6140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T12:05:33.342 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.307+0000 7fd218da6140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T12:05:33.342 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.340+0000 7fd218da6140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T12:05:33.641 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.374+0000 7fd218da6140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T12:05:33.641 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.405+0000 7fd218da6140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T12:05:33.641 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.640+0000 7fd218da6140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T12:05:33.895 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.739+0000 7fd218da6140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T12:05:33.896 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.770+0000 7fd218da6140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T12:05:33.896 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.801+0000 7fd218da6140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T12:05:33.896 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.894+0000 7fd218da6140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:05:34.329 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:33 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:33.923+0000 7fd218da6140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T12:05:34.329 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:34.015+0000 7fd218da6140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:05:34.829 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:34.476+0000 7fd218da6140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T12:05:34.830 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:34.506+0000 7fd218da6140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T12:05:35.329 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:34.904+0000 7fd218da6140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T12:05:35.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: Active manager daemon a restarted 2026-02-17T12:05:35.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: Activating manager daemon a 2026-02-17T12:05:35.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: osdmap e2: 0 total, 0 up, 0 in 2026-02-17T12:05:35.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: mgrmap e6: a(active, starting, since 0.00251266s) 2026-02-17T12:05:35.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T12:05:35.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T12:05:35.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T12:05:35.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T12:05:35.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T12:05:35.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: Manager daemon a is now available 2026-02-17T12:05:35.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:35.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:35.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:35.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:35.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T12:05:35.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:34 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T12:05:35.944 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:05:35.944 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-17T12:05:35.944 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T12:05:35.944 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:05:35.945 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.618+0000 7f4b9f445640 1 Processor -- start 2026-02-17T12:05:35.945 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.618+0000 7f4b9f445640 1 -- start start 2026-02-17T12:05:35.945 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.618+0000 7f4b9f445640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b98109410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:35.945 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.618+0000 7f4b9f445640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4b981099e0 con 0x7f4b98109010 2026-02-17T12:05:35.945 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.618+0000 7f4b9d1ba640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b98109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:35.945 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.618+0000 7f4b9d1ba640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b98109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50342/0 (socket says 10.20.193.90:50342) 2026-02-17T12:05:35.945 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.618+0000 7f4b9d1ba640 1 -- 10.20.193.90:0/2528935670 learned_addr learned my addr 10.20.193.90:0/2528935670 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:35.946 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b9d1ba640 1 -- 10.20.193.90:0/2528935670 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9810a210 con 0x7f4b98109010 2026-02-17T12:05:35.946 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b9d1ba640 1 --2- 10.20.193.90:0/2528935670 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b98109410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009920 tx=0x7f4b8802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96d77911dd7d68c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:35.946 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b87fff640 1 -- 10.20.193.90:0/2528935670 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b8803c070 con 0x7f4b98109010 2026-02-17T12:05:35.946 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b87fff640 1 -- 10.20.193.90:0/2528935670 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f4b88037440 con 0x7f4b98109010 2026-02-17T12:05:35.946 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b87fff640 1 -- 10.20.193.90:0/2528935670 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b88035340 con 0x7f4b98109010 2026-02-17T12:05:35.946 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b9f445640 1 -- 10.20.193.90:0/2528935670 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 msgr2=0x7f4b98109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:35.947 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b9f445640 1 --2- 10.20.193.90:0/2528935670 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b98109410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009920 tx=0x7f4b8802ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:35.947 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b9f445640 1 -- 10.20.193.90:0/2528935670 shutdown_connections 2026-02-17T12:05:35.947 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b9f445640 1 --2- 10.20.193.90:0/2528935670 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b98109410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.947 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b9f445640 1 -- 10.20.193.90:0/2528935670 >> 10.20.193.90:0/2528935670 conn(0x7f4b9807c4f0 msgr2=0x7f4b9807c900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:35.947 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b9f445640 1 -- 10.20.193.90:0/2528935670 shutdown_connections 2026-02-17T12:05:35.947 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.619+0000 7f4b9f445640 1 -- 10.20.193.90:0/2528935670 wait complete. 2026-02-17T12:05:35.947 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b9f445640 1 Processor -- start 2026-02-17T12:05:35.948 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b9f445640 1 -- start start 2026-02-17T12:05:35.948 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b9f445640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b9819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:35.948 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b9f445640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9810d440 con 0x7f4b98109010 2026-02-17T12:05:35.948 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b9d1ba640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b9819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:35.948 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b9d1ba640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b9819ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50350/0 (socket says 10.20.193.90:50350) 2026-02-17T12:05:35.948 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b9d1ba640 1 -- 10.20.193.90:0/3021042198 learned_addr learned my addr 10.20.193.90:0/3021042198 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:35.949 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b9d1ba640 1 -- 10.20.193.90:0/3021042198 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9819f3a0 con 0x7f4b98109010 2026-02-17T12:05:35.949 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b9d1ba640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b9819ee60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b8802f4a0 tx=0x7f4b88035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:35.949 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b88045070 con 0x7f4b98109010 2026-02-17T12:05:35.949 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f4b88040450 con 0x7f4b98109010 2026-02-17T12:05:35.949 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b9f445640 1 -- 10.20.193.90:0/3021042198 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9819f630 con 0x7f4b98109010 2026-02-17T12:05:35.949 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.620+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b8803c070 con 0x7f4b98109010 2026-02-17T12:05:35.950 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b9f445640 1 -- 10.20.193.90:0/3021042198 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b981a2320 con 0x7f4b98109010 2026-02-17T12:05:35.950 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b9f445640 20 mgrc start_tell_command target: cmd: [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:35.950 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b9f445640 5 mgrc start_tell_command no mgr session (no running mgr daemon?), or not active mgr, waiting 2026-02-17T12:05:35.950 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 5) ==== 50247+0+0 (secure 0 0 0) 0x7f4b8802fae0 con 0x7f4b98109010 2026-02-17T12:05:35.950 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b867fc640 20 mgrc handle_mgr_map mgrmap(e 5) 2026-02-17T12:05:35.950 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b867fc640 4 mgrc handle_mgr_map Got map version 5 2026-02-17T12:05:35.951 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b867fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:35.951 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b867fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] 2026-02-17T12:05:35.951 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b867fc640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 0x7f4b74040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:35.951 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b867fc640 10 mgrc reconnect resending 0 (tell) 2026-02-17T12:05:35.951 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.621+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 --> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4b74040770 con 0x7f4b7403dba0 2026-02-17T12:05:35.951 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.622+0000 7f4b9c9b9640 1 -- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 msgr2=0x7f4b74040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.90:6800/4114489928 2026-02-17T12:05:35.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.622+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4b880766c0 con 0x7f4b98109010 2026-02-17T12:05:35.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.622+0000 7f4b9c9b9640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 0x7f4b74040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:35.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.823+0000 7f4b9c9b9640 1 -- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 msgr2=0x7f4b74040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.90:6800/4114489928 2026-02-17T12:05:35.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:32.823+0000 7f4b9c9b9640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 0x7f4b74040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:05:35.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:33.224+0000 7f4b9c9b9640 1 -- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 msgr2=0x7f4b74040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.90:6800/4114489928 2026-02-17T12:05:35.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:33.224+0000 7f4b9c9b9640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 0x7f4b74040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:05:35.953 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:34.025+0000 7f4b9c9b9640 1 -- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 msgr2=0x7f4b74040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.90:6800/4114489928 2026-02-17T12:05:35.953 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:34.025+0000 7f4b9c9b9640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 0x7f4b74040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:05:35.953 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:34.906+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mgrmap(e 6) ==== 50014+0+0 (secure 0 0 0) 0x7f4b88075180 con 0x7f4b98109010 2026-02-17T12:05:35.953 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:34.906+0000 7f4b867fc640 20 mgrc handle_mgr_map mgrmap(e 6) 2026-02-17T12:05:35.953 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:34.907+0000 7f4b867fc640 4 mgrc handle_mgr_map Got map version 6 2026-02-17T12:05:35.953 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:34.907+0000 7f4b867fc640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T12:05:35.953 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:34.907+0000 7f4b867fc640 4 mgrc reconnect Terminating session with v2:10.20.193.90:6800/4114489928 2026-02-17T12:05:35.954 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:34.907+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 msgr2=0x7f4b74040060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:35.954 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:34.907+0000 7f4b867fc640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 0x7f4b74040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.954 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:34.907+0000 7f4b867fc640 4 mgrc reconnect No active mgr available yet 2026-02-17T12:05:35.954 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.908+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7f4b88075880 con 0x7f4b98109010 2026-02-17T12:05:35.954 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.908+0000 7f4b867fc640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T12:05:35.954 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.908+0000 7f4b867fc640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T12:05:35.955 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.908+0000 7f4b867fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:35.955 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.908+0000 7f4b867fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:35.955 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.908+0000 7f4b867fc640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f4b740414f0 0x7f4b740438e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:35.955 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.908+0000 7f4b867fc640 10 mgrc reconnect resending 0 (tell) 2026-02-17T12:05:35.955 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.908+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 --> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4b74040770 con 0x7f4b740414f0 2026-02-17T12:05:35.955 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.908+0000 7f4b9c9b9640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f4b740414f0 0x7f4b740438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:35.956 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.909+0000 7f4b9c9b9640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f4b740414f0 0x7f4b740438e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c003a80 tx=0x7f4b8c009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:35.956 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.909+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 <== mgr.14118 v2:10.20.193.90:6800/978560331 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f4b74040770 con 0x7f4b740414f0 2026-02-17T12:05:35.956 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.909+0000 7f4b867fc640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:35.956 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 20 mgrc start_tell_command target: cmd: [{"prefix": "mgr_status"}] 2026-02-17T12:05:35.956 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 -- 10.20.193.90:0/3021042198 --> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4b98109490 con 0x7f4b740414f0 2026-02-17T12:05:35.956 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b867fc640 1 -- 10.20.193.90:0/3021042198 <== mgr.14118 v2:10.20.193.90:6800/978560331 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f4b98109490 con 0x7f4b740414f0 2026-02-17T12:05:35.957 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b867fc640 20 mgrc handle_command_reply tid 1 r 0 2026-02-17T12:05:35.957 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 10 mgrc shutdown 2026-02-17T12:05:35.957 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 -- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f4b740414f0 msgr2=0x7f4b740438e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:35.957 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f4b740414f0 0x7f4b740438e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c003a80 tx=0x7f4b8c009290 comp rx=0 tx=0).stop 2026-02-17T12:05:35.957 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 -- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 msgr2=0x7f4b9819ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:35.957 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b9819ee60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b8802f4a0 tx=0x7f4b88035f80 comp rx=0 tx=0).stop 2026-02-17T12:05:35.958 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 -- 10.20.193.90:0/3021042198 shutdown_connections 2026-02-17T12:05:35.958 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/4114489928,v1:10.20.193.90:6801/4114489928] conn(0x7f4b7403dba0 0x7f4b74040060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.958 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f4b740414f0 0x7f4b740438e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.958 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 --2- 10.20.193.90:0/3021042198 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4b98109010 0x7f4b9819ee60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:35.958 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 -- 10.20.193.90:0/3021042198 >> 10.20.193.90:0/3021042198 conn(0x7f4b9807c4f0 msgr2=0x7f4b98106700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:35.958 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 -- 10.20.193.90:0/3021042198 shutdown_connections 2026-02-17T12:05:35.958 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:35.913+0000 7f4b9f445640 1 -- 10.20.193.90:0/3021042198 wait complete. 2026-02-17T12:05:35.959 INFO:teuthology.orchestra.run.trial090.stdout:mgr epoch 5 is available 2026-02-17T12:05:35.959 INFO:teuthology.orchestra.run.trial090.stdout:Setting orchestrator backend to cephadm... 2026-02-17T12:05:36.155 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.031+0000 7fa80da1e640 1 Processor -- start 2026-02-17T12:05:36.156 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.032+0000 7fa80da1e640 1 -- start start 2026-02-17T12:05:36.156 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.032+0000 7fa80da1e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa808109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.156 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.032+0000 7fa80da1e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8081099d0 con 0x7fa808109000 2026-02-17T12:05:36.156 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.032+0000 7fa806ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa808109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.156 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.032+0000 7fa806ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa808109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52058/0 (socket says 10.20.193.90:52058) 2026-02-17T12:05:36.156 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.032+0000 7fa806ffd640 1 -- 10.20.193.90:0/2577828544 learned_addr learned my addr 10.20.193.90:0/2577828544 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:36.156 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.032+0000 7fa806ffd640 1 -- 10.20.193.90:0/2577828544 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80810a200 con 0x7fa808109000 2026-02-17T12:05:36.156 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa806ffd640 1 --2- 10.20.193.90:0/2577828544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa808109400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009920 tx=0x7fa7fc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd04de04a10c6ae server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.156 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa805ffb640 1 -- 10.20.193.90:0/2577828544 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7fc03c070 con 0x7fa808109000 2026-02-17T12:05:36.156 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa805ffb640 1 -- 10.20.193.90:0/2577828544 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa7fc037440 con 0x7fa808109000 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa805ffb640 1 -- 10.20.193.90:0/2577828544 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7fc035340 con 0x7fa808109000 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa80da1e640 1 -- 10.20.193.90:0/2577828544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 msgr2=0x7fa808109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa80da1e640 1 --2- 10.20.193.90:0/2577828544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa808109400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009920 tx=0x7fa7fc02ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa80da1e640 1 -- 10.20.193.90:0/2577828544 shutdown_connections 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa80da1e640 1 --2- 10.20.193.90:0/2577828544 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa808109400 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa80da1e640 1 -- 10.20.193.90:0/2577828544 >> 10.20.193.90:0/2577828544 conn(0x7fa80807c4e0 msgr2=0x7fa80807c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa80da1e640 1 -- 10.20.193.90:0/2577828544 shutdown_connections 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa80da1e640 1 -- 10.20.193.90:0/2577828544 wait complete. 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa80da1e640 1 Processor -- start 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.033+0000 7fa80da1e640 1 -- start start 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa80da1e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa80819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.157 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa80da1e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa80810d430 con 0x7fa808109000 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa806ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa80819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa806ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa80819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52074/0 (socket says 10.20.193.90:52074) 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa806ffd640 1 -- 10.20.193.90:0/1970543783 learned_addr learned my addr 10.20.193.90:0/1970543783 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa806ffd640 1 -- 10.20.193.90:0/1970543783 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80819f400 con 0x7fa808109000 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa806ffd640 1 --2- 10.20.193.90:0/1970543783 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa80819eec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc02f4a0 tx=0x7fa7fc035f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa80ca1c640 1 -- 10.20.193.90:0/1970543783 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7fc045070 con 0x7fa808109000 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa80ca1c640 1 -- 10.20.193.90:0/1970543783 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fa7fc040450 con 0x7fa808109000 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa80ca1c640 1 -- 10.20.193.90:0/1970543783 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7fc03c070 con 0x7fa808109000 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa80da1e640 1 -- 10.20.193.90:0/1970543783 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80819f690 con 0x7fa808109000 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.034+0000 7fa80da1e640 1 -- 10.20.193.90:0/1970543783 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8081a2380 con 0x7fa808109000 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.035+0000 7fa80ca1c640 1 -- 10.20.193.90:0/1970543783 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7fa7fc0493b0 con 0x7fa808109000 2026-02-17T12:05:36.158 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.035+0000 7fa80ca1c640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.035+0000 7fa80da1e640 1 -- 10.20.193.90:0/1970543783 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa808109480 con 0x7fa808109000 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.035+0000 7fa80ca1c640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.035+0000 7fa80ca1c640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.035+0000 7fa80ca1c640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.035+0000 7fa80ca1c640 1 --2- 10.20.193.90:0/1970543783 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fa7dc03da80 0x7fa7dc03ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.035+0000 7fa80ca1c640 1 -- 10.20.193.90:0/1970543783 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa7fc076550 con 0x7fa808109000 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.035+0000 7fa8067fc640 1 --2- 10.20.193.90:0/1970543783 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fa7dc03da80 0x7fa7dc03ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.035+0000 7fa8067fc640 1 --2- 10.20.193.90:0/1970543783 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fa7dc03da80 0x7fa7dc03ff40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00099c0 tx=0x7fa7f0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.038+0000 7fa80ca1c640 1 -- 10.20.193.90:0/1970543783 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa7fc033200 con 0x7fa808109000 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.127+0000 7fa80da1e640 20 mgrc start_command cmd: [{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.127+0000 7fa80da1e640 1 -- 10.20.193.90:0/1970543783 --> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fa808106e50 con 0x7fa7dc03da80 2026-02-17T12:05:36.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.130+0000 7fa80ca1c640 1 -- 10.20.193.90:0/1970543783 <== mgr.14118 v2:10.20.193.90:6800/978560331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa808106e50 con 0x7fa7dc03da80 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.130+0000 7fa80ca1c640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 10 mgrc shutdown 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 1 -- 10.20.193.90:0/1970543783 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fa7dc03da80 msgr2=0x7fa7dc03ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 1 --2- 10.20.193.90:0/1970543783 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fa7dc03da80 0x7fa7dc03ff40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00099c0 tx=0x7fa7f0006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 1 -- 10.20.193.90:0/1970543783 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 msgr2=0x7fa80819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 1 --2- 10.20.193.90:0/1970543783 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa80819eec0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc02f4a0 tx=0x7fa7fc035f80 comp rx=0 tx=0).stop 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 1 -- 10.20.193.90:0/1970543783 shutdown_connections 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 1 --2- 10.20.193.90:0/1970543783 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fa7dc03da80 0x7fa7dc03ff40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 1 --2- 10.20.193.90:0/1970543783 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa808109000 0x7fa80819eec0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 1 -- 10.20.193.90:0/1970543783 >> 10.20.193.90:0/1970543783 conn(0x7fa80807c4e0 msgr2=0x7fa808106740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 1 -- 10.20.193.90:0/1970543783 shutdown_connections 2026-02-17T12:05:36.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.131+0000 7fa80da1e640 1 -- 10.20.193.90:0/1970543783 wait complete. 2026-02-17T12:05:36.364 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-17T12:05:36.364 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.247+0000 7f16addbc640 1 Processor -- start 2026-02-17T12:05:36.364 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.247+0000 7f16addbc640 1 -- start start 2026-02-17T12:05:36.364 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.247+0000 7f16addbc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a8109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.364 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.247+0000 7f16addbc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16a8109a00 con 0x7f16a8109030 2026-02-17T12:05:36.365 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.248+0000 7f16a77fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a8109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.365 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.248+0000 7f16a77fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a8109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52090/0 (socket says 10.20.193.90:52090) 2026-02-17T12:05:36.365 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.248+0000 7f16a77fe640 1 -- 10.20.193.90:0/714392233 learned_addr learned my addr 10.20.193.90:0/714392233 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:36.365 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.248+0000 7f16a77fe640 1 -- 10.20.193.90:0/714392233 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a810a1e0 con 0x7f16a8109030 2026-02-17T12:05:36.365 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.248+0000 7f16a77fe640 1 --2- 10.20.193.90:0/714392233 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a8109430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1694009920 tx=0x7f169402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9deb31448034b8d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.365 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.248+0000 7f16a67fc640 1 -- 10.20.193.90:0/714392233 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f169403c070 con 0x7f16a8109030 2026-02-17T12:05:36.365 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.248+0000 7f16a67fc640 1 -- 10.20.193.90:0/714392233 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f1694037440 con 0x7f16a8109030 2026-02-17T12:05:36.365 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.248+0000 7f16a67fc640 1 -- 10.20.193.90:0/714392233 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1694035340 con 0x7f16a8109030 2026-02-17T12:05:36.365 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 -- 10.20.193.90:0/714392233 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 msgr2=0x7f16a8109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.365 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 --2- 10.20.193.90:0/714392233 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a8109430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1694009920 tx=0x7f169402ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:36.366 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 -- 10.20.193.90:0/714392233 shutdown_connections 2026-02-17T12:05:36.366 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 --2- 10.20.193.90:0/714392233 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a8109430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.366 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 -- 10.20.193.90:0/714392233 >> 10.20.193.90:0/714392233 conn(0x7f16a807c520 msgr2=0x7f16a807c930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:36.366 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 -- 10.20.193.90:0/714392233 shutdown_connections 2026-02-17T12:05:36.366 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 -- 10.20.193.90:0/714392233 wait complete. 2026-02-17T12:05:36.366 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 Processor -- start 2026-02-17T12:05:36.366 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 -- start start 2026-02-17T12:05:36.366 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.366 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16addbc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f16a810d410 con 0x7f16a8109030 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16a77fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16a77fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a819ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52100/0 (socket says 10.20.193.90:52100) 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16a77fe640 1 -- 10.20.193.90:0/1361480861 learned_addr learned my addr 10.20.193.90:0/1361480861 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16a77fe640 1 -- 10.20.193.90:0/1361480861 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a819f350 con 0x7f16a8109030 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.249+0000 7f16a77fe640 1 --2- 10.20.193.90:0/1361480861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a819ee10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1694006fd0 tx=0x7f1694037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a4ff9640 1 -- 10.20.193.90:0/1361480861 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1694045070 con 0x7f16a8109030 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a4ff9640 1 -- 10.20.193.90:0/1361480861 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f1694040450 con 0x7f16a8109030 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16addbc640 1 -- 10.20.193.90:0/1361480861 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a819f5e0 con 0x7f16a8109030 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a4ff9640 1 -- 10.20.193.90:0/1361480861 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f169403c070 con 0x7f16a8109030 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16addbc640 1 -- 10.20.193.90:0/1361480861 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a81a22d0 con 0x7f16a8109030 2026-02-17T12:05:36.367 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16addbc640 1 -- 10.20.193.90:0/1361480861 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a81094b0 con 0x7f16a8109030 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a4ff9640 1 -- 10.20.193.90:0/1361480861 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7f16940493b0 con 0x7f16a8109030 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a4ff9640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a4ff9640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a4ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a4ff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a4ff9640 1 --2- 10.20.193.90:0/1361480861 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f167c03da80 0x7f167c03ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a4ff9640 1 -- 10.20.193.90:0/1361480861 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1694076550 con 0x7f16a8109030 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.250+0000 7f16a6ffd640 1 --2- 10.20.193.90:0/1361480861 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f167c03da80 0x7f167c03ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.251+0000 7f16a6ffd640 1 --2- 10.20.193.90:0/1361480861 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f167c03da80 0x7f167c03ff40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f16980099c0 tx=0x7f1698006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.253+0000 7f16a4ff9640 1 -- 10.20.193.90:0/1361480861 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f169403c210 con 0x7f16a8109030 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.335+0000 7f16addbc640 20 mgrc start_command cmd: [{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:36.368 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.335+0000 7f16addbc640 1 -- 10.20.193.90:0/1361480861 --> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f16a8106e40 con 0x7f167c03da80 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.335+0000 7f16a4ff9640 1 -- 10.20.193.90:0/1361480861 <== mgr.14118 v2:10.20.193.90:6800/978560331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f16a8106e40 con 0x7f167c03da80 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.335+0000 7f16a4ff9640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 10 mgrc shutdown 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 1 -- 10.20.193.90:0/1361480861 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f167c03da80 msgr2=0x7f167c03ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 1 --2- 10.20.193.90:0/1361480861 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f167c03da80 0x7f167c03ff40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f16980099c0 tx=0x7f1698006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 1 -- 10.20.193.90:0/1361480861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 msgr2=0x7f16a819ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 1 --2- 10.20.193.90:0/1361480861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a819ee10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1694006fd0 tx=0x7f1694037b70 comp rx=0 tx=0).stop 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 1 -- 10.20.193.90:0/1361480861 shutdown_connections 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 1 --2- 10.20.193.90:0/1361480861 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f167c03da80 0x7f167c03ff40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 1 --2- 10.20.193.90:0/1361480861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f16a8109030 0x7f16a819ee10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 1 -- 10.20.193.90:0/1361480861 >> 10.20.193.90:0/1361480861 conn(0x7f16a807c520 msgr2=0x7f16a8106730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 1 -- 10.20.193.90:0/1361480861 shutdown_connections 2026-02-17T12:05:36.369 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.336+0000 7f16addbc640 1 -- 10.20.193.90:0/1361480861 wait complete. 2026-02-17T12:05:36.370 INFO:teuthology.orchestra.run.trial090.stdout:Generating ssh key... 2026-02-17T12:05:36.449 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-mon[39228]: Found migration_current of "None". Setting to last migration. 2026-02-17T12:05:36.449 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:36.450 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:36.450 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-mon[39228]: mgrmap e7: a(active, since 1.00368s) 2026-02-17T12:05:36.450 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:36.450 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:36.450 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.448+0000 7f2caec49640 1 Processor -- start 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.448+0000 7f2caec49640 1 -- start start 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.448+0000 7f2caec49640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca8109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.448+0000 7f2caec49640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8109a00 con 0x7f2ca8109030 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.448+0000 7f2cac9be640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca8109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.448+0000 7f2cac9be640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca8109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52104/0 (socket says 10.20.193.90:52104) 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.448+0000 7f2cac9be640 1 -- 10.20.193.90:0/3165152519 learned_addr learned my addr 10.20.193.90:0/3165152519 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2cac9be640 1 -- 10.20.193.90:0/3165152519 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca810a230 con 0x7f2ca8109030 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2cac9be640 1 --2- 10.20.193.90:0/3165152519 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca8109430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2c98009920 tx=0x7f2c9802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48006dce8851b9a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2c9f7fe640 1 -- 10.20.193.90:0/3165152519 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c9803c070 con 0x7f2ca8109030 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2c9f7fe640 1 -- 10.20.193.90:0/3165152519 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f2c98037440 con 0x7f2ca8109030 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2c9f7fe640 1 -- 10.20.193.90:0/3165152519 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c98035340 con 0x7f2ca8109030 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2caec49640 1 -- 10.20.193.90:0/3165152519 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 msgr2=0x7f2ca8109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2caec49640 1 --2- 10.20.193.90:0/3165152519 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca8109430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2c98009920 tx=0x7f2c9802ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2caec49640 1 -- 10.20.193.90:0/3165152519 shutdown_connections 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2caec49640 1 --2- 10.20.193.90:0/3165152519 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca8109430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2caec49640 1 -- 10.20.193.90:0/3165152519 >> 10.20.193.90:0/3165152519 conn(0x7f2ca807c4e0 msgr2=0x7f2ca807c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2caec49640 1 -- 10.20.193.90:0/3165152519 shutdown_connections 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.449+0000 7f2caec49640 1 -- 10.20.193.90:0/3165152519 wait complete. 2026-02-17T12:05:36.580 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2caec49640 1 Processor -- start 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2caec49640 1 -- start start 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2caec49640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2caec49640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca810d460 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2cac9be640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2cac9be640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca819ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52112/0 (socket says 10.20.193.90:52112) 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2cac9be640 1 -- 10.20.193.90:0/3920727202 learned_addr learned my addr 10.20.193.90:0/3920727202 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2cac9be640 1 -- 10.20.193.90:0/3920727202 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca819f3c0 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2cac9be640 1 --2- 10.20.193.90:0/3920727202 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca819ee80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c98006fd0 tx=0x7f2c98035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2c9dffb640 1 -- 10.20.193.90:0/3920727202 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c98045070 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2c9dffb640 1 -- 10.20.193.90:0/3920727202 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7f2c98040450 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2caec49640 1 -- 10.20.193.90:0/3920727202 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca819f650 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2c9dffb640 1 -- 10.20.193.90:0/3920727202 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c9803c070 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.450+0000 7f2caec49640 1 -- 10.20.193.90:0/3920727202 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca81a2340 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.451+0000 7f2caec49640 1 -- 10.20.193.90:0/3920727202 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca81094b0 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.451+0000 7f2c9dffb640 1 -- 10.20.193.90:0/3920727202 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7f2c980493b0 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.451+0000 7f2c9dffb640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.451+0000 7f2c9dffb640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.451+0000 7f2c9dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.451+0000 7f2c9dffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.451+0000 7f2c9dffb640 1 --2- 10.20.193.90:0/3920727202 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f2c8403dad0 0x7f2c8403ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.451+0000 7f2c9dffb640 1 -- 10.20.193.90:0/3920727202 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2c980764b0 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.451+0000 7f2c9ffff640 1 --2- 10.20.193.90:0/3920727202 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f2c8403dad0 0x7f2c8403ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.451+0000 7f2c9ffff640 1 --2- 10.20.193.90:0/3920727202 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f2c8403dad0 0x7f2c8403ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c900099c0 tx=0x7f2c90006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.454+0000 7f2c9dffb640 1 -- 10.20.193.90:0/3920727202 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2c9803c210 con 0x7f2ca8109030 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.537+0000 7f2caec49640 20 mgrc start_command cmd: [{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.537+0000 7f2caec49640 1 -- 10.20.193.90:0/3920727202 --> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f2ca8106e20 con 0x7f2c8403dad0 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.558+0000 7f2c9dffb640 1 -- 10.20.193.90:0/3920727202 <== mgr.14118 v2:10.20.193.90:6800/978560331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2ca8106e20 con 0x7f2c8403dad0 2026-02-17T12:05:36.581 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.558+0000 7f2c9dffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 10 mgrc shutdown 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 1 -- 10.20.193.90:0/3920727202 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f2c8403dad0 msgr2=0x7f2c8403ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 1 --2- 10.20.193.90:0/3920727202 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f2c8403dad0 0x7f2c8403ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c900099c0 tx=0x7f2c90006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 1 -- 10.20.193.90:0/3920727202 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 msgr2=0x7f2ca819ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 1 --2- 10.20.193.90:0/3920727202 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca819ee80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c98006fd0 tx=0x7f2c98035570 comp rx=0 tx=0).stop 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 1 -- 10.20.193.90:0/3920727202 shutdown_connections 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 1 --2- 10.20.193.90:0/3920727202 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f2c8403dad0 0x7f2c8403ff90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 1 --2- 10.20.193.90:0/3920727202 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ca8109030 0x7f2ca819ee80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 1 -- 10.20.193.90:0/3920727202 >> 10.20.193.90:0/3920727202 conn(0x7f2ca807c4e0 msgr2=0x7f2ca8106710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 1 -- 10.20.193.90:0/3920727202 shutdown_connections 2026-02-17T12:05:36.582 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.559+0000 7f2caec49640 1 -- 10.20.193.90:0/3920727202 wait complete. 2026-02-17T12:05:36.761 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: Generating public/private ed25519 key pair. 2026-02-17T12:05:36.761 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: Your identification has been saved in /tmp/tmppowbho7q/key 2026-02-17T12:05:36.761 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: Your public key has been saved in /tmp/tmppowbho7q/key.pub 2026-02-17T12:05:36.761 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: The key fingerprint is: 2026-02-17T12:05:36.761 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: SHA256:u9wSomW/oTxrca+VQ+O2aZwI8Ewpyds7eJbRuQTQZ8c ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: The key's randomart image is: 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: +--[ED25519 256]--+ 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: | . . | 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: | . . o E | 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: | . o + . | 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: | = + | 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: | O oS.o | 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: | . @ *+ o | 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: | = @o**. | 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: | o.Oo=*=+ | 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: | +++==+ | 2026-02-17T12:05:36.762 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:36 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: +----[SHA256]-----+ 2026-02-17T12:05:36.786 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEeD8U8wrhi0+/VFeY02MAiQlk6k7A947pn1Utip1eqD ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:36.786 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.671+0000 7fcb6e404640 1 Processor -- start 2026-02-17T12:05:36.786 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.671+0000 7fcb6e404640 1 -- start start 2026-02-17T12:05:36.786 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.671+0000 7fcb6e404640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb68109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.786 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.671+0000 7fcb6e404640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb68109a00 con 0x7fcb68109030 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.671+0000 7fcb67fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb68109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.671+0000 7fcb67fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb68109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52122/0 (socket says 10.20.193.90:52122) 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.671+0000 7fcb67fff640 1 -- 10.20.193.90:0/4163093261 learned_addr learned my addr 10.20.193.90:0/4163093261 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb67fff640 1 -- 10.20.193.90:0/4163093261 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6810a230 con 0x7fcb68109030 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb67fff640 1 --2- 10.20.193.90:0/4163093261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb68109430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009920 tx=0x7fcb5402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2836e915bac434 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb66ffd640 1 -- 10.20.193.90:0/4163093261 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb5403c070 con 0x7fcb68109030 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb66ffd640 1 -- 10.20.193.90:0/4163093261 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fcb54037440 con 0x7fcb68109030 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb66ffd640 1 -- 10.20.193.90:0/4163093261 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb54035340 con 0x7fcb68109030 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb6e404640 1 -- 10.20.193.90:0/4163093261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 msgr2=0x7fcb68109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb6e404640 1 --2- 10.20.193.90:0/4163093261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb68109430 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009920 tx=0x7fcb5402ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:36.787 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb6e404640 1 -- 10.20.193.90:0/4163093261 shutdown_connections 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb6e404640 1 --2- 10.20.193.90:0/4163093261 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb68109430 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb6e404640 1 -- 10.20.193.90:0/4163093261 >> 10.20.193.90:0/4163093261 conn(0x7fcb6807c4e0 msgr2=0x7fcb6807c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb6e404640 1 -- 10.20.193.90:0/4163093261 shutdown_connections 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.672+0000 7fcb6e404640 1 -- 10.20.193.90:0/4163093261 wait complete. 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb6e404640 1 Processor -- start 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb6e404640 1 -- start start 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb6e404640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb6819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb6e404640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6810d460 con 0x7fcb68109030 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb67fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb6819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb67fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb6819ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52132/0 (socket says 10.20.193.90:52132) 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb67fff640 1 -- 10.20.193.90:0/3256958107 learned_addr learned my addr 10.20.193.90:0/3256958107 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:36.788 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb67fff640 1 -- 10.20.193.90:0/3256958107 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6819f3c0 con 0x7fcb68109030 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb67fff640 1 --2- 10.20.193.90:0/3256958107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb6819ee80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcb54006fd0 tx=0x7fcb54035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb657fa640 1 -- 10.20.193.90:0/3256958107 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb54045070 con 0x7fcb68109030 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb6e404640 1 -- 10.20.193.90:0/3256958107 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6819f650 con 0x7fcb68109030 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb657fa640 1 -- 10.20.193.90:0/3256958107 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fcb54040450 con 0x7fcb68109030 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb657fa640 1 -- 10.20.193.90:0/3256958107 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb5403c070 con 0x7fcb68109030 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.673+0000 7fcb6e404640 1 -- 10.20.193.90:0/3256958107 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb681a2340 con 0x7fcb68109030 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.674+0000 7fcb6e404640 1 -- 10.20.193.90:0/3256958107 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb681094b0 con 0x7fcb68109030 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.674+0000 7fcb657fa640 1 -- 10.20.193.90:0/3256958107 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7fcb540493b0 con 0x7fcb68109030 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.674+0000 7fcb657fa640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.674+0000 7fcb657fa640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.674+0000 7fcb657fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:36.789 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.674+0000 7fcb657fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:36.790 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.674+0000 7fcb657fa640 1 --2- 10.20.193.90:0/3256958107 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fcb3c03dad0 0x7fcb3c03ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:36.790 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.674+0000 7fcb657fa640 1 -- 10.20.193.90:0/3256958107 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcb540765b0 con 0x7fcb68109030 2026-02-17T12:05:36.790 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.674+0000 7fcb677fe640 1 --2- 10.20.193.90:0/3256958107 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fcb3c03dad0 0x7fcb3c03ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:36.790 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.674+0000 7fcb677fe640 1 --2- 10.20.193.90:0/3256958107 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fcb3c03dad0 0x7fcb3c03ff90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb580099c0 tx=0x7fcb58006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:36.790 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.677+0000 7fcb657fa640 1 -- 10.20.193.90:0/3256958107 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcb540496d0 con 0x7fcb68109030 2026-02-17T12:05:36.790 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.759+0000 7fcb6e404640 20 mgrc start_command cmd: [{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:36.790 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.759+0000 7fcb6e404640 1 -- 10.20.193.90:0/3256958107 --> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fcb68106e20 con 0x7fcb3c03dad0 2026-02-17T12:05:36.790 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.760+0000 7fcb657fa640 1 -- 10.20.193.90:0/3256958107 <== mgr.14118 v2:10.20.193.90:6800/978560331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+123 (secure 0 0 0) 0x7fcb68106e20 con 0x7fcb3c03dad0 2026-02-17T12:05:36.790 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.760+0000 7fcb657fa640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 10 mgrc shutdown 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 1 -- 10.20.193.90:0/3256958107 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fcb3c03dad0 msgr2=0x7fcb3c03ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 1 --2- 10.20.193.90:0/3256958107 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fcb3c03dad0 0x7fcb3c03ff90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb580099c0 tx=0x7fcb58006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 1 -- 10.20.193.90:0/3256958107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 msgr2=0x7fcb6819ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 1 --2- 10.20.193.90:0/3256958107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb6819ee80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcb54006fd0 tx=0x7fcb54035570 comp rx=0 tx=0).stop 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 1 -- 10.20.193.90:0/3256958107 shutdown_connections 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 1 --2- 10.20.193.90:0/3256958107 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fcb3c03dad0 0x7fcb3c03ff90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 1 --2- 10.20.193.90:0/3256958107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcb68109030 0x7fcb6819ee80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 1 -- 10.20.193.90:0/3256958107 >> 10.20.193.90:0/3256958107 conn(0x7fcb6807c4e0 msgr2=0x7fcb68106710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 1 -- 10.20.193.90:0/3256958107 shutdown_connections 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.761+0000 7fcb6e404640 1 -- 10.20.193.90:0/3256958107 wait complete. 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-17T12:05:36.791 INFO:teuthology.orchestra.run.trial090.stdout:Adding key to root@localhost authorized_keys... 2026-02-17T12:05:36.792 INFO:teuthology.orchestra.run.trial090.stdout:Adding host trial090... 2026-02-17T12:05:37.270 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:37 trial090 ceph-mon[39228]: [17/Feb/2026:12:05:35] ENGINE Bus STARTING 2026-02-17T12:05:37.270 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:37 trial090 ceph-mon[39228]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T12:05:37.270 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:37 trial090 ceph-mon[39228]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T12:05:37.270 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:37 trial090 ceph-mon[39228]: [17/Feb/2026:12:05:35] ENGINE Serving on http://10.20.193.90:8765 2026-02-17T12:05:37.270 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:37 trial090 ceph-mon[39228]: [17/Feb/2026:12:05:36] ENGINE Serving on https://10.20.193.90:7150 2026-02-17T12:05:37.270 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:37 trial090 ceph-mon[39228]: [17/Feb/2026:12:05:36] ENGINE Bus STARTED 2026-02-17T12:05:37.270 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:37 trial090 ceph-mon[39228]: [17/Feb/2026:12:05:36] ENGINE Client ('10.20.193.90', 57616) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T12:05:37.270 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:37 trial090 ceph-mon[39228]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:37.271 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:37 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:37.271 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:37 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:38.430 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:38 trial090 ceph-mon[39228]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:38.430 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:38 trial090 ceph-mon[39228]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:38.430 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:38 trial090 ceph-mon[39228]: Generating ssh key... 2026-02-17T12:05:38.430 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:38 trial090 ceph-mon[39228]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:38.430 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:38 trial090 ceph-mon[39228]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial090", "addr": "10.20.193.90", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:38.430 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:38 trial090 ceph-mon[39228]: mgrmap e8: a(active, since 2s) 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout Added host 'trial090' with addr '10.20.193.90' 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.872+0000 7efdf624e640 1 Processor -- start 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.872+0000 7efdf624e640 1 -- start start 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.872+0000 7efdf624e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf01093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.872+0000 7efdf624e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7efdf01099b0 con 0x7efdf0108fe0 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.872+0000 7efdef7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf01093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.872+0000 7efdef7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf01093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52144/0 (socket says 10.20.193.90:52144) 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.872+0000 7efdef7fe640 1 -- 10.20.193.90:0/4224395181 learned_addr learned my addr 10.20.193.90:0/4224395181 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.872+0000 7efdef7fe640 1 -- 10.20.193.90:0/4224395181 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf010a1e0 con 0x7efdf0108fe0 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdef7fe640 1 --2- 10.20.193.90:0/4224395181 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf01093e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efddc009920 tx=0x7efddc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9657b4fe5a599d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdee7fc640 1 -- 10.20.193.90:0/4224395181 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efddc03c070 con 0x7efdf0108fe0 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdee7fc640 1 -- 10.20.193.90:0/4224395181 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7efddc037440 con 0x7efdf0108fe0 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdee7fc640 1 -- 10.20.193.90:0/4224395181 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efddc035340 con 0x7efdf0108fe0 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdf624e640 1 -- 10.20.193.90:0/4224395181 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 msgr2=0x7efdf01093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdf624e640 1 --2- 10.20.193.90:0/4224395181 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf01093e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efddc009920 tx=0x7efddc02ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdf624e640 1 -- 10.20.193.90:0/4224395181 shutdown_connections 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdf624e640 1 --2- 10.20.193.90:0/4224395181 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf01093e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdf624e640 1 -- 10.20.193.90:0/4224395181 >> 10.20.193.90:0/4224395181 conn(0x7efdf007c4e0 msgr2=0x7efdf007c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdf624e640 1 -- 10.20.193.90:0/4224395181 shutdown_connections 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.873+0000 7efdf624e640 1 -- 10.20.193.90:0/4224395181 wait complete. 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdf624e640 1 Processor -- start 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdf624e640 1 -- start start 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdf624e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf019ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.480 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdf624e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7efdf010d410 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdef7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf019ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdef7fe640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf019ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52156/0 (socket says 10.20.193.90:52156) 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdef7fe640 1 -- 10.20.193.90:0/121360042 learned_addr learned my addr 10.20.193.90:0/121360042 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdef7fe640 1 -- 10.20.193.90:0/121360042 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf019f340 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdef7fe640 1 --2- 10.20.193.90:0/121360042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf019ee00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efddc006fd0 tx=0x7efddc037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdecff9640 1 -- 10.20.193.90:0/121360042 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efddc045070 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdf624e640 1 -- 10.20.193.90:0/121360042 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf019f5d0 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdecff9640 1 -- 10.20.193.90:0/121360042 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7efddc040450 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdecff9640 1 -- 10.20.193.90:0/121360042 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efddc03c070 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.874+0000 7efdf624e640 1 -- 10.20.193.90:0/121360042 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf01a22c0 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.875+0000 7efdf624e640 1 -- 10.20.193.90:0/121360042 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf0109460 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.875+0000 7efdecff9640 1 -- 10.20.193.90:0/121360042 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 7) ==== 50141+0+0 (secure 0 0 0) 0x7efddc0493b0 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.875+0000 7efdecff9640 20 mgrc handle_mgr_map mgrmap(e 7) 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.875+0000 7efdecff9640 4 mgrc handle_mgr_map Got map version 7 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.875+0000 7efdecff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.875+0000 7efdecff9640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.875+0000 7efdecff9640 1 --2- 10.20.193.90:0/121360042 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7efdc403da30 0x7efdc403fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.875+0000 7efdecff9640 1 -- 10.20.193.90:0/121360042 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efddc0765a0 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.875+0000 7efdeeffd640 1 --2- 10.20.193.90:0/121360042 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7efdc403da30 0x7efdc403fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.875+0000 7efdeeffd640 1 --2- 10.20.193.90:0/121360042 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7efdc403da30 0x7efdc403fef0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efde00099c0 tx=0x7efde0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.877+0000 7efdecff9640 1 -- 10.20.193.90:0/121360042 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efddc03c210 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.962+0000 7efdf624e640 20 mgrc start_command cmd: [{"prefix": "orch host add", "hostname": "trial090", "addr": "10.20.193.90", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:36.962+0000 7efdf624e640 1 -- 10.20.193.90:0/121360042 --> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial090", "addr": "10.20.193.90", "target": ["mon-mgr", ""]}) -- 0x7efdf0106d60 con 0x7efdc403da30 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:37.559+0000 7efdecff9640 1 -- 10.20.193.90:0/121360042 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7efddc033200 con 0x7efdf0108fe0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:37.559+0000 7efdecff9640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:37.559+0000 7efdecff9640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:37.559+0000 7efdecff9640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.429+0000 7efdecff9640 1 -- 10.20.193.90:0/121360042 <== mgr.14118 v2:10.20.193.90:6800/978560331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7efdf0106d60 con 0x7efdc403da30 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.429+0000 7efdecff9640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 10 mgrc shutdown 2026-02-17T12:05:38.481 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 1 -- 10.20.193.90:0/121360042 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7efdc403da30 msgr2=0x7efdc403fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.482 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 1 --2- 10.20.193.90:0/121360042 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7efdc403da30 0x7efdc403fef0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efde00099c0 tx=0x7efde0006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.482 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 1 -- 10.20.193.90:0/121360042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 msgr2=0x7efdf019ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.482 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 1 --2- 10.20.193.90:0/121360042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf019ee00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efddc006fd0 tx=0x7efddc037b70 comp rx=0 tx=0).stop 2026-02-17T12:05:38.482 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 1 -- 10.20.193.90:0/121360042 shutdown_connections 2026-02-17T12:05:38.482 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 1 --2- 10.20.193.90:0/121360042 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7efdc403da30 0x7efdc403fef0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.482 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 1 --2- 10.20.193.90:0/121360042 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efdf0108fe0 0x7efdf019ee00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.482 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 1 -- 10.20.193.90:0/121360042 >> 10.20.193.90:0/121360042 conn(0x7efdf007c4e0 msgr2=0x7efdf0106650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:38.482 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 1 -- 10.20.193.90:0/121360042 shutdown_connections 2026-02-17T12:05:38.482 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.431+0000 7efdf624e640 1 -- 10.20.193.90:0/121360042 wait complete. 2026-02-17T12:05:38.482 INFO:teuthology.orchestra.run.trial090.stdout:Deploying unmanaged mon service... 2026-02-17T12:05:38.708 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-17T12:05:38.710 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.589+0000 7ffaf0d96640 1 Processor -- start 2026-02-17T12:05:38.710 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.589+0000 7ffaf0d96640 1 -- start start 2026-02-17T12:05:38.710 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.589+0000 7ffaf0d96640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.710 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.589+0000 7ffaf0d96640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec109a00 con 0x7ffaec109030 2026-02-17T12:05:38.710 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.589+0000 7ffaea575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.710 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.589+0000 7ffaea575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52162/0 (socket says 10.20.193.90:52162) 2026-02-17T12:05:38.710 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.589+0000 7ffaea575640 1 -- 10.20.193.90:0/3656426630 learned_addr learned my addr 10.20.193.90:0/3656426630 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:38.710 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.590+0000 7ffaea575640 1 -- 10.20.193.90:0/3656426630 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaec10a1e0 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.590+0000 7ffaea575640 1 --2- 10.20.193.90:0/3656426630 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec109430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009920 tx=0x7ffae002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887322215bc1180b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.590+0000 7ffae9573640 1 -- 10.20.193.90:0/3656426630 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae003c070 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.590+0000 7ffae9573640 1 -- 10.20.193.90:0/3656426630 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7ffae0037440 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.590+0000 7ffae9573640 1 -- 10.20.193.90:0/3656426630 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae0035340 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.590+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3656426630 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 msgr2=0x7ffaec109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.590+0000 7ffaf0d96640 1 --2- 10.20.193.90:0/3656426630 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec109430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009920 tx=0x7ffae002ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3656426630 shutdown_connections 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaf0d96640 1 --2- 10.20.193.90:0/3656426630 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec109430 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3656426630 >> 10.20.193.90:0/3656426630 conn(0x7ffaec07c520 msgr2=0x7ffaec07c930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3656426630 shutdown_connections 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3656426630 wait complete. 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaf0d96640 1 Processor -- start 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaf0d96640 1 -- start start 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaf0d96640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaf0d96640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec10d410 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaea575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaea575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec19ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52174/0 (socket says 10.20.193.90:52174) 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaea575640 1 -- 10.20.193.90:0/3241776276 learned_addr learned my addr 10.20.193.90:0/3241776276 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaea575640 1 -- 10.20.193.90:0/3241776276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaec19f320 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffaea575640 1 --2- 10.20.193.90:0/3241776276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec19ede0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffae0006fd0 tx=0x7ffae0037b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.591+0000 7ffad37fe640 1 -- 10.20.193.90:0/3241776276 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae0045070 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffad37fe640 1 -- 10.20.193.90:0/3241776276 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7ffae0040450 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3241776276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaec19f5b0 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffad37fe640 1 -- 10.20.193.90:0/3241776276 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae003c070 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3241776276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaec1a22a0 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3241776276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaec1094b0 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffad37fe640 1 -- 10.20.193.90:0/3241776276 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7ffae00493b0 con 0x7ffaec109030 2026-02-17T12:05:38.711 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffad37fe640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffad37fe640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffad37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffad37fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffad37fe640 1 --2- 10.20.193.90:0/3241776276 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7ffac403dba0 0x7ffac4040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffad37fe640 1 -- 10.20.193.90:0/3241776276 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffae0076720 con 0x7ffaec109030 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.592+0000 7ffae9d74640 1 --2- 10.20.193.90:0/3241776276 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7ffac403dba0 0x7ffac4040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.593+0000 7ffae9d74640 1 --2- 10.20.193.90:0/3241776276 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7ffac403dba0 0x7ffac4040060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffad40099c0 tx=0x7ffad4006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.595+0000 7ffad37fe640 1 -- 10.20.193.90:0/3241776276 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ffae003c210 con 0x7ffaec109030 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.683+0000 7ffaf0d96640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}] 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.683+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3241776276 --> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ffaec106e10 con 0x7ffac403dba0 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.687+0000 7ffad37fe640 1 -- 10.20.193.90:0/3241776276 <== mgr.14118 v2:10.20.193.90:6800/978560331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ffaec106e10 con 0x7ffac403dba0 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.687+0000 7ffad37fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 10 mgrc shutdown 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3241776276 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7ffac403dba0 msgr2=0x7ffac4040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 1 --2- 10.20.193.90:0/3241776276 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7ffac403dba0 0x7ffac4040060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffad40099c0 tx=0x7ffad4006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3241776276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 msgr2=0x7ffaec19ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 1 --2- 10.20.193.90:0/3241776276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec19ede0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffae0006fd0 tx=0x7ffae0037b70 comp rx=0 tx=0).stop 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3241776276 shutdown_connections 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 1 --2- 10.20.193.90:0/3241776276 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7ffac403dba0 0x7ffac4040060 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 1 --2- 10.20.193.90:0/3241776276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffaec109030 0x7ffaec19ede0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3241776276 >> 10.20.193.90:0/3241776276 conn(0x7ffaec07c520 msgr2=0x7ffaec106700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3241776276 shutdown_connections 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.688+0000 7ffaf0d96640 1 -- 10.20.193.90:0/3241776276 wait complete. 2026-02-17T12:05:38.712 INFO:teuthology.orchestra.run.trial090.stdout:Deploying unmanaged mgr service... 2026-02-17T12:05:38.931 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.804+0000 7fe1cbce0640 1 Processor -- start 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.804+0000 7fe1cbce0640 1 -- start start 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.804+0000 7fe1cbce0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c410bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.804+0000 7fe1cbce0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c410c2a0 con 0x7fe1c407ab30 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.805+0000 7fe1c9a55640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c410bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.805+0000 7fe1c9a55640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c410bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52176/0 (socket says 10.20.193.90:52176) 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.805+0000 7fe1c9a55640 1 -- 10.20.193.90:0/3104042782 learned_addr learned my addr 10.20.193.90:0/3104042782 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.805+0000 7fe1c9a55640 1 -- 10.20.193.90:0/3104042782 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c410c420 con 0x7fe1c407ab30 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.805+0000 7fe1c9a55640 1 --2- 10.20.193.90:0/3104042782 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c410bd60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009920 tx=0x7fe1b402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5aa78047eb46a75 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.805+0000 7fe1c8a53640 1 -- 10.20.193.90:0/3104042782 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b403c070 con 0x7fe1c407ab30 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.805+0000 7fe1c8a53640 1 -- 10.20.193.90:0/3104042782 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fe1b4037440 con 0x7fe1c407ab30 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.805+0000 7fe1c8a53640 1 -- 10.20.193.90:0/3104042782 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b4035340 con 0x7fe1c407ab30 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 -- 10.20.193.90:0/3104042782 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 msgr2=0x7fe1c410bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 --2- 10.20.193.90:0/3104042782 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c410bd60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009920 tx=0x7fe1b402ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 -- 10.20.193.90:0/3104042782 shutdown_connections 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 --2- 10.20.193.90:0/3104042782 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c410bd60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 -- 10.20.193.90:0/3104042782 >> 10.20.193.90:0/3104042782 conn(0x7fe1c41013d0 msgr2=0x7fe1c4103830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 -- 10.20.193.90:0/3104042782 shutdown_connections 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 -- 10.20.193.90:0/3104042782 wait complete. 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 Processor -- start 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 -- start start 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1cbce0640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c410d230 con 0x7fe1c407ab30 2026-02-17T12:05:38.932 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1c9a55640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1c9a55640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c419ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52178/0 (socket says 10.20.193.90:52178) 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.806+0000 7fe1c9a55640 1 -- 10.20.193.90:0/763290223 learned_addr learned my addr 10.20.193.90:0/763290223 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.807+0000 7fe1c9a55640 1 -- 10.20.193.90:0/763290223 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c419f380 con 0x7fe1c407ab30 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.807+0000 7fe1c9a55640 1 --2- 10.20.193.90:0/763290223 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c419ee40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4006fd0 tx=0x7fe1b4035570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.807+0000 7fe1b2ffd640 1 -- 10.20.193.90:0/763290223 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b4045070 con 0x7fe1c407ab30 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.807+0000 7fe1cbce0640 1 -- 10.20.193.90:0/763290223 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c419f610 con 0x7fe1c407ab30 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.807+0000 7fe1b2ffd640 1 -- 10.20.193.90:0/763290223 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 975+0+0 (secure 0 0 0) 0x7fe1b4040450 con 0x7fe1c407ab30 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.807+0000 7fe1b2ffd640 1 -- 10.20.193.90:0/763290223 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1b403c070 con 0x7fe1c407ab30 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.807+0000 7fe1cbce0640 1 -- 10.20.193.90:0/763290223 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c41a2300 con 0x7fe1c407ab30 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.807+0000 7fe1b2ffd640 1 -- 10.20.193.90:0/763290223 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7fe1b40493b0 con 0x7fe1c407ab30 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.807+0000 7fe1cbce0640 1 -- 10.20.193.90:0/763290223 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1c410bde0 con 0x7fe1c407ab30 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.807+0000 7fe1b2ffd640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.808+0000 7fe1b2ffd640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.808+0000 7fe1b2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.808+0000 7fe1b2ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.808+0000 7fe1b2ffd640 1 --2- 10.20.193.90:0/763290223 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe1a003db90 0x7fe1a0040050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.808+0000 7fe1b2ffd640 1 -- 10.20.193.90:0/763290223 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe1b40766d0 con 0x7fe1c407ab30 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.808+0000 7fe1c9254640 1 --2- 10.20.193.90:0/763290223 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe1a003db90 0x7fe1a0040050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.808+0000 7fe1c9254640 1 --2- 10.20.193.90:0/763290223 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe1a003db90 0x7fe1a0040050 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80099c0 tx=0x7fe1b8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.810+0000 7fe1b2ffd640 1 -- 10.20.193.90:0/763290223 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe1b403c210 con 0x7fe1c407ab30 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.902+0000 7fe1cbce0640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}] 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.902+0000 7fe1cbce0640 1 -- 10.20.193.90:0/763290223 --> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe1c4102680 con 0x7fe1a003db90 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.905+0000 7fe1b2ffd640 1 -- 10.20.193.90:0/763290223 <== mgr.14118 v2:10.20.193.90:6800/978560331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe1c4102680 con 0x7fe1a003db90 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.905+0000 7fe1b2ffd640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.906+0000 7fe1cbce0640 10 mgrc shutdown 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.906+0000 7fe1cbce0640 1 -- 10.20.193.90:0/763290223 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe1a003db90 msgr2=0x7fe1a0040050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.906+0000 7fe1cbce0640 1 --2- 10.20.193.90:0/763290223 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe1a003db90 0x7fe1a0040050 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80099c0 tx=0x7fe1b8006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.906+0000 7fe1cbce0640 1 -- 10.20.193.90:0/763290223 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 msgr2=0x7fe1c419ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.906+0000 7fe1cbce0640 1 --2- 10.20.193.90:0/763290223 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c419ee40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4006fd0 tx=0x7fe1b4035570 comp rx=0 tx=0).stop 2026-02-17T12:05:38.933 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.907+0000 7fe1cbce0640 1 -- 10.20.193.90:0/763290223 shutdown_connections 2026-02-17T12:05:38.934 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.907+0000 7fe1cbce0640 1 --2- 10.20.193.90:0/763290223 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe1a003db90 0x7fe1a0040050 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.934 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.907+0000 7fe1cbce0640 1 --2- 10.20.193.90:0/763290223 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1c407ab30 0x7fe1c419ee40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:38.934 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.907+0000 7fe1cbce0640 1 -- 10.20.193.90:0/763290223 >> 10.20.193.90:0/763290223 conn(0x7fe1c41013d0 msgr2=0x7fe1c4101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:38.934 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.907+0000 7fe1cbce0640 1 -- 10.20.193.90:0/763290223 shutdown_connections 2026-02-17T12:05:38.934 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:38.907+0000 7fe1cbce0640 1 -- 10.20.193.90:0/763290223 wait complete. 2026-02-17T12:05:39.159 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.045+0000 7fe0bfac1640 1 Processor -- start 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.045+0000 7fe0bfac1640 1 -- start start 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.045+0000 7fe0bfac1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b807b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.045+0000 7fe0bfac1640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b807b830 con 0x7fe0b807cdf0 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.045+0000 7fe0bd836640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b807b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.045+0000 7fe0bd836640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b807b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52194/0 (socket says 10.20.193.90:52194) 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.045+0000 7fe0bd836640 1 -- 10.20.193.90:0/935331375 learned_addr learned my addr 10.20.193.90:0/935331375 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.045+0000 7fe0bd836640 1 -- 10.20.193.90:0/935331375 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b807b9b0 con 0x7fe0b807cdf0 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bd836640 1 --2- 10.20.193.90:0/935331375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b807b2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009920 tx=0x7fe0a802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e5a33784ea4d5e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bc834640 1 -- 10.20.193.90:0/935331375 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a803c070 con 0x7fe0b807cdf0 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bc834640 1 -- 10.20.193.90:0/935331375 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe0a8037440 con 0x7fe0b807cdf0 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bc834640 1 -- 10.20.193.90:0/935331375 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a80354d0 con 0x7fe0b807cdf0 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bfac1640 1 -- 10.20.193.90:0/935331375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 msgr2=0x7fe0b807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bfac1640 1 --2- 10.20.193.90:0/935331375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b807b2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009920 tx=0x7fe0a802ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bfac1640 1 -- 10.20.193.90:0/935331375 shutdown_connections 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bfac1640 1 --2- 10.20.193.90:0/935331375 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b807b2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bfac1640 1 -- 10.20.193.90:0/935331375 >> 10.20.193.90:0/935331375 conn(0x7fe0b81025b0 msgr2=0x7fe0b81049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bfac1640 1 -- 10.20.193.90:0/935331375 shutdown_connections 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.046+0000 7fe0bfac1640 1 -- 10.20.193.90:0/935331375 wait complete. 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bfac1640 1 Processor -- start 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bfac1640 1 -- start start 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bfac1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bfac1640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b810d2e0 con 0x7fe0b807cdf0 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bd836640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.160 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bd836640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b819ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52210/0 (socket says 10.20.193.90:52210) 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bd836640 1 -- 10.20.193.90:0/2979684965 learned_addr learned my addr 10.20.193.90:0/2979684965 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bd836640 1 -- 10.20.193.90:0/2979684965 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b819f370 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bd836640 1 --2- 10.20.193.90:0/2979684965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b819ee30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe0a802fcd0 tx=0x7fe0a802fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0a6ffd640 1 -- 10.20.193.90:0/2979684965 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a8047070 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0a6ffd640 1 -- 10.20.193.90:0/2979684965 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe0a8042440 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bfac1640 1 -- 10.20.193.90:0/2979684965 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b819f600 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0a6ffd640 1 -- 10.20.193.90:0/2979684965 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a803c070 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bfac1640 1 -- 10.20.193.90:0/2979684965 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b81a22f0 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.047+0000 7fe0bfac1640 1 -- 10.20.193.90:0/2979684965 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b807b370 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.048+0000 7fe0a6ffd640 1 -- 10.20.193.90:0/2979684965 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7fe0a80413e0 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.048+0000 7fe0a6ffd640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.048+0000 7fe0a6ffd640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.048+0000 7fe0a6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.048+0000 7fe0a6ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.048+0000 7fe0a6ffd640 1 --2- 10.20.193.90:0/2979684965 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe09403dbf0 0x7fe0940400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.048+0000 7fe0a6ffd640 1 -- 10.20.193.90:0/2979684965 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe0a8076910 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.048+0000 7fe0bd035640 1 --2- 10.20.193.90:0/2979684965 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe09403dbf0 0x7fe0940400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.048+0000 7fe0bd035640 1 --2- 10.20.193.90:0/2979684965 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe09403dbf0 0x7fe0940400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0099c0 tx=0x7fe0ac006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.051+0000 7fe0a6ffd640 1 -- 10.20.193.90:0/2979684965 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe0a8037440 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.135+0000 7fe0bfac1640 1 -- 10.20.193.90:0/2979684965 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fe0b81a27c0 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.136+0000 7fe0a6ffd640 1 -- 10.20.193.90:0/2979684965 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fe0a8076670 con 0x7fe0b807cdf0 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 10 mgrc shutdown 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 1 -- 10.20.193.90:0/2979684965 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe09403dbf0 msgr2=0x7fe0940400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 1 --2- 10.20.193.90:0/2979684965 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe09403dbf0 0x7fe0940400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0099c0 tx=0x7fe0ac006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 1 -- 10.20.193.90:0/2979684965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 msgr2=0x7fe0b819ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 1 --2- 10.20.193.90:0/2979684965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b819ee30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe0a802fcd0 tx=0x7fe0a802fd00 comp rx=0 tx=0).stop 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 1 -- 10.20.193.90:0/2979684965 shutdown_connections 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 1 --2- 10.20.193.90:0/2979684965 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe09403dbf0 0x7fe0940400b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.161 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 1 --2- 10.20.193.90:0/2979684965 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe0b807cdf0 0x7fe0b819ee30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.162 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 1 -- 10.20.193.90:0/2979684965 >> 10.20.193.90:0/2979684965 conn(0x7fe0b81025b0 msgr2=0x7fe0b8103170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.162 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 1 -- 10.20.193.90:0/2979684965 shutdown_connections 2026-02-17T12:05:39.162 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.138+0000 7fe0bfac1640 1 -- 10.20.193.90:0/2979684965 wait complete. 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.263+0000 7f7900d95640 1 Processor -- start 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.263+0000 7f7900d95640 1 -- start start 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.263+0000 7f7900d95640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.263+0000 7f7900d95640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc1099d0 con 0x7f78fc109000 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.263+0000 7f78fa575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.263+0000 7f78fa575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52224/0 (socket says 10.20.193.90:52224) 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.263+0000 7f78fa575640 1 -- 10.20.193.90:0/1322768843 learned_addr learned my addr 10.20.193.90:0/1322768843 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.263+0000 7f78fa575640 1 -- 10.20.193.90:0/1322768843 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78fc10a200 con 0x7f78fc109000 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f78fa575640 1 --2- 10.20.193.90:0/1322768843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc109400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009920 tx=0x7f78f002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4362aaccf7ed91fa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.382 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f78f9573640 1 -- 10.20.193.90:0/1322768843 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f003c070 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f78f9573640 1 -- 10.20.193.90:0/1322768843 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f78f0037440 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f78f9573640 1 -- 10.20.193.90:0/1322768843 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f00354d0 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f7900d95640 1 -- 10.20.193.90:0/1322768843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 msgr2=0x7f78fc109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f7900d95640 1 --2- 10.20.193.90:0/1322768843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc109400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009920 tx=0x7f78f002ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f7900d95640 1 -- 10.20.193.90:0/1322768843 shutdown_connections 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f7900d95640 1 --2- 10.20.193.90:0/1322768843 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc109400 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f7900d95640 1 -- 10.20.193.90:0/1322768843 >> 10.20.193.90:0/1322768843 conn(0x7f78fc07c490 msgr2=0x7f78fc07c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f7900d95640 1 -- 10.20.193.90:0/1322768843 shutdown_connections 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.264+0000 7f7900d95640 1 -- 10.20.193.90:0/1322768843 wait complete. 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f7900d95640 1 Processor -- start 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f7900d95640 1 -- start start 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f7900d95640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f7900d95640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78fc10d430 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f78fa575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f78fa575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc19ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52228/0 (socket says 10.20.193.90:52228) 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f78fa575640 1 -- 10.20.193.90:0/3302293758 learned_addr learned my addr 10.20.193.90:0/3302293758 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f78fa575640 1 -- 10.20.193.90:0/3302293758 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78fc19f3b0 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f78fa575640 1 --2- 10.20.193.90:0/3302293758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc19ee70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78f0002410 tx=0x7f78f002fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f78e37fe640 1 -- 10.20.193.90:0/3302293758 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f0047070 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f78e37fe640 1 -- 10.20.193.90:0/3302293758 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f78f0042440 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f7900d95640 1 -- 10.20.193.90:0/3302293758 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78fc19f640 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f78e37fe640 1 -- 10.20.193.90:0/3302293758 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78f003c070 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.265+0000 7f7900d95640 1 -- 10.20.193.90:0/3302293758 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78fc1a2330 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.266+0000 7f7900d95640 1 -- 10.20.193.90:0/3302293758 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78fc109480 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.266+0000 7f78e37fe640 1 -- 10.20.193.90:0/3302293758 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7f78f0035b10 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.266+0000 7f78e37fe640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.266+0000 7f78e37fe640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.266+0000 7f78e37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.266+0000 7f78e37fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.266+0000 7f78e37fe640 1 --2- 10.20.193.90:0/3302293758 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f78d403dbf0 0x7f78d40400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.266+0000 7f78e37fe640 1 -- 10.20.193.90:0/3302293758 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f78f00768d0 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.266+0000 7f78f9d74640 1 --2- 10.20.193.90:0/3302293758 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f78d403dbf0 0x7f78d40400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.266+0000 7f78f9d74640 1 --2- 10.20.193.90:0/3302293758 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f78d403dbf0 0x7f78d40400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f78e40099c0 tx=0x7f78e4006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.269+0000 7f78e37fe640 1 -- 10.20.193.90:0/3302293758 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f78f004a360 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.355+0000 7f7900d95640 1 -- 10.20.193.90:0/3302293758 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f78fc1a2800 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.357+0000 7f78e37fe640 1 -- 10.20.193.90:0/3302293758 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f78f004f120 con 0x7f78fc109000 2026-02-17T12:05:39.383 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 10 mgrc shutdown 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 1 -- 10.20.193.90:0/3302293758 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f78d403dbf0 msgr2=0x7f78d40400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 1 --2- 10.20.193.90:0/3302293758 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f78d403dbf0 0x7f78d40400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f78e40099c0 tx=0x7f78e4006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 1 -- 10.20.193.90:0/3302293758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 msgr2=0x7f78fc19ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 1 --2- 10.20.193.90:0/3302293758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc19ee70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78f0002410 tx=0x7f78f002fcb0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 1 -- 10.20.193.90:0/3302293758 shutdown_connections 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 1 --2- 10.20.193.90:0/3302293758 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f78d403dbf0 0x7f78d40400b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 1 --2- 10.20.193.90:0/3302293758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f78fc109000 0x7f78fc19ee70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 1 -- 10.20.193.90:0/3302293758 >> 10.20.193.90:0/3302293758 conn(0x7f78fc07c490 msgr2=0x7f78fc1066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 1 -- 10.20.193.90:0/3302293758 shutdown_connections 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.359+0000 7f7900d95640 1 -- 10.20.193.90:0/3302293758 wait complete. 2026-02-17T12:05:39.384 INFO:teuthology.orchestra.run.trial090.stdout:Enabling the dashboard module... 2026-02-17T12:05:39.470 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:39 trial090 ceph-mon[39228]: Deploying cephadm binary to trial090 2026-02-17T12:05:39.471 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:39 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:39.471 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:39 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:39.471 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:39 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:39.471 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:39 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:39.471 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:39 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:39.471 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:39 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:39.471 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:39 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/2979684965' entity='client.admin' 2026-02-17T12:05:40.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-mon[39228]: Added host trial090 2026-02-17T12:05:40.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-mon[39228]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:40.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-mon[39228]: Saving service mon spec with placement count:5 2026-02-17T12:05:40.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-mon[39228]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:40.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-mon[39228]: Saving service mgr spec with placement count:2 2026-02-17T12:05:40.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3302293758' entity='client.admin' 2026-02-17T12:05:40.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:40.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/4069083093' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-17T12:05:40.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-mon[39228]: from='mgr.14118 10.20.193.90:0/1594226909' entity='mgr.a' 2026-02-17T12:05:40.495 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.480+0000 7fe994cd9640 1 Processor -- start 2026-02-17T12:05:40.495 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.480+0000 7fe994cd9640 1 -- start start 2026-02-17T12:05:40.495 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.480+0000 7fe994cd9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe990109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.495 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.480+0000 7fe994cd9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe990109a00 con 0x7fe990109030 2026-02-17T12:05:40.495 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.480+0000 7fe98e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe990109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.480+0000 7fe98e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe990109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52240/0 (socket says 10.20.193.90:52240) 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.480+0000 7fe98e575640 1 -- 10.20.193.90:0/2384847607 learned_addr learned my addr 10.20.193.90:0/2384847607 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.480+0000 7fe98e575640 1 -- 10.20.193.90:0/2384847607 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99010a230 con 0x7fe990109030 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe98e575640 1 --2- 10.20.193.90:0/2384847607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe990109430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe984009920 tx=0x7fe98402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07ab8882fe9a11d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe98d573640 1 -- 10.20.193.90:0/2384847607 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98403c070 con 0x7fe990109030 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe98d573640 1 -- 10.20.193.90:0/2384847607 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe984037440 con 0x7fe990109030 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe98d573640 1 -- 10.20.193.90:0/2384847607 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9840354d0 con 0x7fe990109030 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 -- 10.20.193.90:0/2384847607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 msgr2=0x7fe990109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 --2- 10.20.193.90:0/2384847607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe990109430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe984009920 tx=0x7fe98402ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 -- 10.20.193.90:0/2384847607 shutdown_connections 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 --2- 10.20.193.90:0/2384847607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe990109430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 -- 10.20.193.90:0/2384847607 >> 10.20.193.90:0/2384847607 conn(0x7fe99007c4e0 msgr2=0x7fe99007c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 -- 10.20.193.90:0/2384847607 shutdown_connections 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 -- 10.20.193.90:0/2384847607 wait complete. 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 Processor -- start 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 -- start start 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe99019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.481+0000 7fe994cd9640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe99010d460 con 0x7fe990109030 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe98e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe99019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe98e575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe99019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52250/0 (socket says 10.20.193.90:52250) 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe98e575640 1 -- 10.20.193.90:0/4069083093 learned_addr learned my addr 10.20.193.90:0/4069083093 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe98e575640 1 -- 10.20.193.90:0/4069083093 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99019f3a0 con 0x7fe990109030 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe98e575640 1 --2- 10.20.193.90:0/4069083093 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe99019ee60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe984037d90 tx=0x7fe98402fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe9777fe640 1 -- 10.20.193.90:0/4069083093 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe984047070 con 0x7fe990109030 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe9777fe640 1 -- 10.20.193.90:0/4069083093 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe984042440 con 0x7fe990109030 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe994cd9640 1 -- 10.20.193.90:0/4069083093 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99019f630 con 0x7fe990109030 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe9777fe640 1 -- 10.20.193.90:0/4069083093 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98403c070 con 0x7fe990109030 2026-02-17T12:05:40.496 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe994cd9640 1 -- 10.20.193.90:0/4069083093 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9901a2320 con 0x7fe990109030 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.482+0000 7fe994cd9640 1 -- 10.20.193.90:0/4069083093 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9901094b0 con 0x7fe990109030 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.483+0000 7fe9777fe640 1 -- 10.20.193.90:0/4069083093 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 8) ==== 50247+0+0 (secure 0 0 0) 0x7fe9840425f0 con 0x7fe990109030 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.483+0000 7fe9777fe640 20 mgrc handle_mgr_map mgrmap(e 8) 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.483+0000 7fe9777fe640 4 mgrc handle_mgr_map Got map version 8 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.483+0000 7fe9777fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.483+0000 7fe9777fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.483+0000 7fe9777fe640 1 --2- 10.20.193.90:0/4069083093 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe96803dbf0 0x7fe9680400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.483+0000 7fe9777fe640 1 -- 10.20.193.90:0/4069083093 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe9840769e0 con 0x7fe990109030 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.483+0000 7fe98dd74640 1 --2- 10.20.193.90:0/4069083093 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe96803dbf0 0x7fe9680400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.483+0000 7fe98dd74640 1 --2- 10.20.193.90:0/4069083093 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe96803dbf0 0x7fe9680400b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9780099c0 tx=0x7fe978006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.485+0000 7fe9777fe640 1 -- 10.20.193.90:0/4069083093 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe984076740 con 0x7fe990109030 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:39.589+0000 7fe994cd9640 1 -- 10.20.193.90:0/4069083093 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fe9901a2780 con 0x7fe990109030 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.465+0000 7fe9777fe640 1 -- 10.20.193.90:0/4069083093 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fe984047da0 con 0x7fe990109030 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.467+0000 7fe9777fe640 1 -- 10.20.193.90:0/4069083093 <== mon.0 v2:10.20.193.90:3300/0 8 ==== mgrmap(e 9) ==== 50260+0+0 (secure 0 0 0) 0x7fe984035b60 con 0x7fe990109030 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.467+0000 7fe9777fe640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.468+0000 7fe9777fe640 4 mgrc handle_mgr_map Got map version 9 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.468+0000 7fe9777fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 10 mgrc shutdown 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 1 -- 10.20.193.90:0/4069083093 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe96803dbf0 msgr2=0x7fe9680400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 1 --2- 10.20.193.90:0/4069083093 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe96803dbf0 0x7fe9680400b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe9780099c0 tx=0x7fe978006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 1 -- 10.20.193.90:0/4069083093 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 msgr2=0x7fe99019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 1 --2- 10.20.193.90:0/4069083093 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe99019ee60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe984037d90 tx=0x7fe98402fcd0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 1 -- 10.20.193.90:0/4069083093 shutdown_connections 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 1 --2- 10.20.193.90:0/4069083093 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fe96803dbf0 0x7fe9680400b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 1 --2- 10.20.193.90:0/4069083093 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe990109030 0x7fe99019ee60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 1 -- 10.20.193.90:0/4069083093 >> 10.20.193.90:0/4069083093 conn(0x7fe99007c4e0 msgr2=0x7fe990106720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 1 -- 10.20.193.90:0/4069083093 shutdown_connections 2026-02-17T12:05:40.497 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.470+0000 7fe994cd9640 1 -- 10.20.193.90:0/4069083093 wait complete. 2026-02-17T12:05:40.722 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: ignoring --setuser ceph since I am not root 2026-02-17T12:05:40.722 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: ignoring --setgroup ceph since I am not root 2026-02-17T12:05:40.761 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:05:40.761 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-17T12:05:40.761 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "active_name": "a", 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.607+0000 7f8c78856640 1 Processor -- start 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.607+0000 7f8c78856640 1 -- start start 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.607+0000 7f8c78856640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c70109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.607+0000 7f8c78856640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c70109a00 con 0x7f8c70109030 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.607+0000 7f8c765cb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c70109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.607+0000 7f8c765cb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c70109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52292/0 (socket says 10.20.193.90:52292) 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.607+0000 7f8c765cb640 1 -- 10.20.193.90:0/3973981044 learned_addr learned my addr 10.20.193.90:0/3973981044 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.607+0000 7f8c765cb640 1 -- 10.20.193.90:0/3973981044 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7010a230 con 0x7f8c70109030 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c765cb640 1 --2- 10.20.193.90:0/3973981044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c70109430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009920 tx=0x7f8c6802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56048da831cf8b0a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c755c9640 1 -- 10.20.193.90:0/3973981044 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6803c070 con 0x7f8c70109030 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c755c9640 1 -- 10.20.193.90:0/3973981044 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8c68037440 con 0x7f8c70109030 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c755c9640 1 -- 10.20.193.90:0/3973981044 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c680354d0 con 0x7f8c70109030 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c78856640 1 -- 10.20.193.90:0/3973981044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 msgr2=0x7f8c70109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c78856640 1 --2- 10.20.193.90:0/3973981044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c70109430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009920 tx=0x7f8c6802ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c78856640 1 -- 10.20.193.90:0/3973981044 shutdown_connections 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c78856640 1 --2- 10.20.193.90:0/3973981044 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c70109430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c78856640 1 -- 10.20.193.90:0/3973981044 >> 10.20.193.90:0/3973981044 conn(0x7f8c7007c4e0 msgr2=0x7f8c7007c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c78856640 1 -- 10.20.193.90:0/3973981044 shutdown_connections 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.608+0000 7f8c78856640 1 -- 10.20.193.90:0/3973981044 wait complete. 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c78856640 1 Processor -- start 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c78856640 1 -- start start 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c78856640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c7019ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c78856640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7010d460 con 0x7f8c70109030 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c765cb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c7019ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:40.762 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c765cb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c7019ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52298/0 (socket says 10.20.193.90:52298) 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c765cb640 1 -- 10.20.193.90:0/1749114022 learned_addr learned my addr 10.20.193.90:0/1749114022 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c765cb640 1 -- 10.20.193.90:0/1749114022 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7019f360 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c765cb640 1 --2- 10.20.193.90:0/1749114022 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c7019ee20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c68037d90 tx=0x7f8c6802fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c5b7fe640 1 -- 10.20.193.90:0/1749114022 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c68047070 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c5b7fe640 1 -- 10.20.193.90:0/1749114022 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8c68042440 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c78856640 1 -- 10.20.193.90:0/1749114022 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7019f5f0 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c5b7fe640 1 -- 10.20.193.90:0/1749114022 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c6803c070 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.609+0000 7f8c78856640 1 -- 10.20.193.90:0/1749114022 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c701a22e0 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.610+0000 7f8c78856640 1 -- 10.20.193.90:0/1749114022 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c701094b0 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.610+0000 7f8c5b7fe640 1 -- 10.20.193.90:0/1749114022 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 9) ==== 50260+0+0 (secure 0 0 0) 0x7f8c68035b60 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.610+0000 7f8c5b7fe640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.610+0000 7f8c5b7fe640 4 mgrc handle_mgr_map Got map version 9 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.610+0000 7f8c5b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.610+0000 7f8c5b7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.610+0000 7f8c5b7fe640 1 --2- 10.20.193.90:0/1749114022 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f8c4c03dbf0 0x7f8c4c0400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.610+0000 7f8c75dca640 1 -- 10.20.193.90:0/1749114022 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f8c4c03dbf0 msgr2=0x7f8c4c0400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.90:6800/978560331 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.610+0000 7f8c5b7fe640 1 -- 10.20.193.90:0/1749114022 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8c680769e0 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.610+0000 7f8c75dca640 1 --2- 10.20.193.90:0/1749114022 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f8c4c03dbf0 0x7f8c4c0400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.613+0000 7f8c5b7fe640 1 -- 10.20.193.90:0/1749114022 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8c6804be80 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.720+0000 7f8c78856640 1 -- 10.20.193.90:0/1749114022 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f8c701a2740 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.721+0000 7f8c5b7fe640 1 -- 10.20.193.90:0/1749114022 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f8c68045120 con 0x7f8c70109030 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 10 mgrc shutdown 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 1 -- 10.20.193.90:0/1749114022 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f8c4c03dbf0 msgr2=0x7f8c4c0400b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 1 --2- 10.20.193.90:0/1749114022 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f8c4c03dbf0 0x7f8c4c0400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 1 -- 10.20.193.90:0/1749114022 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 msgr2=0x7f8c7019ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 1 --2- 10.20.193.90:0/1749114022 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c7019ee20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c68037d90 tx=0x7f8c6802fcd0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 1 -- 10.20.193.90:0/1749114022 shutdown_connections 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 1 --2- 10.20.193.90:0/1749114022 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7f8c4c03dbf0 0x7f8c4c0400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 1 --2- 10.20.193.90:0/1749114022 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8c70109030 0x7f8c7019ee20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 1 -- 10.20.193.90:0/1749114022 >> 10.20.193.90:0/1749114022 conn(0x7f8c7007c4e0 msgr2=0x7f8c70106750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:40.763 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 1 -- 10.20.193.90:0/1749114022 shutdown_connections 2026-02-17T12:05:40.764 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.722+0000 7f8c78856640 1 -- 10.20.193.90:0/1749114022 wait complete. 2026-02-17T12:05:40.764 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for the mgr to restart... 2026-02-17T12:05:40.764 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mgr epoch 9... 2026-02-17T12:05:41.045 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:40 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:40.899+0000 7f610f0fd140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T12:05:41.045 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.044+0000 7f610f0fd140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T12:05:41.324 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.079+0000 7f610f0fd140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T12:05:41.324 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.121+0000 7f610f0fd140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T12:05:41.324 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.153+0000 7f610f0fd140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T12:05:41.324 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.187+0000 7f610f0fd140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T12:05:41.324 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.253+0000 7f610f0fd140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T12:05:41.324 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T12:05:41.324 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T12:05:41.324 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: from numpy import show_config as show_numpy_config 2026-02-17T12:05:41.579 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/4069083093' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-17T12:05:41.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-mon[39228]: mgrmap e9: a(active, since 5s) 2026-02-17T12:05:41.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/1749114022' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T12:05:41.580 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.327+0000 7f610f0fd140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T12:05:41.580 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.361+0000 7f610f0fd140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T12:05:41.580 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.458+0000 7f610f0fd140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T12:05:41.580 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.519+0000 7f610f0fd140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T12:05:41.581 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.553+0000 7f610f0fd140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T12:05:41.888 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.587+0000 7f610f0fd140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T12:05:41.888 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.622+0000 7f610f0fd140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T12:05:41.888 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.652+0000 7f610f0fd140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T12:05:41.888 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.887+0000 7f610f0fd140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T12:05:42.142 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:41 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:41.987+0000 7f610f0fd140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T12:05:42.142 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:42 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:42.017+0000 7f610f0fd140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T12:05:42.143 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:42 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:42.048+0000 7f610f0fd140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T12:05:42.143 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:42 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:42.141+0000 7f610f0fd140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:05:42.579 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:42 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:42.170+0000 7f610f0fd140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T12:05:42.580 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:42 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:42.262+0000 7f610f0fd140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T12:05:43.080 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:42 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:42.730+0000 7f610f0fd140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T12:05:43.080 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:42 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:42.760+0000 7f610f0fd140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T12:05:43.514 INFO:journalctl@ceph.mgr.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-mgr-a[39482]: 2026-02-17T12:05:43.158+0000 7f610f0fd140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T12:05:43.514 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: Active manager daemon a restarted 2026-02-17T12:05:43.515 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: Activating manager daemon a 2026-02-17T12:05:43.515 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: osdmap e3: 0 total, 0 up, 0 in 2026-02-17T12:05:43.515 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: mgrmap e10: a(active, starting, since 0.00237909s) 2026-02-17T12:05:43.515 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T12:05:43.515 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "mgr metadata", "who": "a", "id": "a"}]: dispatch 2026-02-17T12:05:43.516 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T12:05:43.516 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T12:05:43.516 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T12:05:43.516 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: Manager daemon a is now available 2026-02-17T12:05:43.516 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:43.516 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/mirror_snapshot_schedule"}]: dispatch 2026-02-17T12:05:43.516 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:43 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/a/trash_purge_schedule"}]: dispatch 2026-02-17T12:05:44.199 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-17T12:05:44.199 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-17T12:05:44.199 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T12:05:44.199 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-17T12:05:44.199 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.863+0000 7fbb149ba640 1 Processor -- start 2026-02-17T12:05:44.199 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.863+0000 7fbb149ba640 1 -- start start 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.863+0000 7fbb149ba640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c110450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.863+0000 7fbb149ba640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c081550 con 0x7fbb0c10e060 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.864+0000 7fbb1272f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c110450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.864+0000 7fbb1272f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c110450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52300/0 (socket says 10.20.193.90:52300) 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.864+0000 7fbb1272f640 1 -- 10.20.193.90:0/4202710095 learned_addr learned my addr 10.20.193.90:0/4202710095 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.864+0000 7fbb1272f640 1 -- 10.20.193.90:0/4202710095 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0c110990 con 0x7fbb0c10e060 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.864+0000 7fbb1272f640 1 --2- 10.20.193.90:0/4202710095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c110450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009920 tx=0x7fbb0402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba80eb21e1a0588 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.864+0000 7fbb1172d640 1 -- 10.20.193.90:0/4202710095 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0403c070 con 0x7fbb0c10e060 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.864+0000 7fbb1172d640 1 -- 10.20.193.90:0/4202710095 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fbb04037440 con 0x7fbb0c10e060 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.864+0000 7fbb1172d640 1 -- 10.20.193.90:0/4202710095 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb040354d0 con 0x7fbb0c10e060 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 -- 10.20.193.90:0/4202710095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 msgr2=0x7fbb0c110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.200 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 --2- 10.20.193.90:0/4202710095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c110450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009920 tx=0x7fbb0402ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 -- 10.20.193.90:0/4202710095 shutdown_connections 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 --2- 10.20.193.90:0/4202710095 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c110450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 -- 10.20.193.90:0/4202710095 >> 10.20.193.90:0/4202710095 conn(0x7fbb0c07c4a0 msgr2=0x7fbb0c07e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 -- 10.20.193.90:0/4202710095 shutdown_connections 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 -- 10.20.193.90:0/4202710095 wait complete. 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 Processor -- start 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 -- start start 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c1a3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb149ba640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c111770 con 0x7fbb0c10e060 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb1272f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c1a3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.201 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb1272f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c1a3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52314/0 (socket says 10.20.193.90:52314) 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb1272f640 1 -- 10.20.193.90:0/2486738255 learned_addr learned my addr 10.20.193.90:0/2486738255 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb1272f640 1 -- 10.20.193.90:0/2486738255 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0c1a37d0 con 0x7fbb0c10e060 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.865+0000 7fbb1272f640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c1a3290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbb0402fd40 tx=0x7fbb0402fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb04047070 con 0x7fbb0c10e060 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fbb04035c20 con 0x7fbb0c10e060 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbb149ba640 1 -- 10.20.193.90:0/2486738255 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0c1a3a60 con 0x7fbb0c10e060 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0403c070 con 0x7fbb0c10e060 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbb149ba640 1 -- 10.20.193.90:0/2486738255 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0c1a6750 con 0x7fbb0c10e060 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbb149ba640 20 mgrc start_tell_command target: cmd: [{"prefix": "get_command_descriptions"}] 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbb149ba640 5 mgrc start_tell_command no mgr session (no running mgr daemon?), or not active mgr, waiting 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 9) ==== 50260+0+0 (secure 0 0 0) 0x7fbb04042440 con 0x7fbb0c10e060 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 20 mgrc handle_mgr_map mgrmap(e 9) 2026-02-17T12:05:44.202 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 4 mgrc handle_mgr_map Got map version 9 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 0x7fbae80400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 10 mgrc reconnect resending 0 (tell) 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 --> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbae80407c0 con 0x7fbae803dbf0 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbb11f2e640 1 -- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 msgr2=0x7fbae80400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.90:6800/978560331 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbb04076a70 con 0x7fbb0c10e060 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:40.866+0000 7fbb11f2e640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 0x7fbae80400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:41.067+0000 7fbb11f2e640 1 -- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 msgr2=0x7fbae80400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.90:6800/978560331 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:41.067+0000 7fbb11f2e640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 0x7fbae80400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T12:05:44.203 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:41.468+0000 7fbb11f2e640 1 -- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 msgr2=0x7fbae80400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.90:6800/978560331 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:41.468+0000 7fbb11f2e640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 0x7fbae80400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:42.269+0000 7fbb11f2e640 1 -- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 msgr2=0x7fbae80400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.90:6800/978560331 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:42.269+0000 7fbb11f2e640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 0x7fbae80400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:43.161+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mgrmap(e 10) ==== 50027+0+0 (secure 0 0 0) 0x7fbb04075870 con 0x7fbb0c10e060 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:43.161+0000 7fbaf77fe640 20 mgrc handle_mgr_map mgrmap(e 10) 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:43.161+0000 7fbaf77fe640 4 mgrc handle_mgr_map Got map version 10 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:43.161+0000 7fbaf77fe640 4 mgrc handle_mgr_map Active mgr is now 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:43.161+0000 7fbaf77fe640 4 mgrc reconnect Terminating session with v2:10.20.193.90:6800/978560331 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:43.161+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 msgr2=0x7fbae80400b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:43.161+0000 7fbaf77fe640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 0x7fbae80400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:43.161+0000 7fbaf77fe640 4 mgrc reconnect No active mgr available yet 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.162+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mgrmap(e 11) ==== 50154+0+0 (secure 0 0 0) 0x7fbb04075f70 con 0x7fbb0c10e060 2026-02-17T12:05:44.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.162+0000 7fbaf77fe640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.163+0000 7fbaf77fe640 4 mgrc handle_mgr_map Got map version 11 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.163+0000 7fbaf77fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.163+0000 7fbaf77fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.163+0000 7fbaf77fe640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbae80416d0 0x7fbae8043ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.163+0000 7fbaf77fe640 10 mgrc reconnect resending 0 (tell) 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.163+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fbb0404ee50 con 0x7fbae80416d0 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.163+0000 7fbb11f2e640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbae80416d0 0x7fbae8043ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.163+0000 7fbb11f2e640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbae80416d0 0x7fbae8043ac0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8003a80 tx=0x7fbaf80092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.163+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7fbb0404ee50 con 0x7fbae80416d0 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.163+0000 7fbaf77fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 20 mgrc start_tell_command target: cmd: [{"prefix": "mgr_status"}] 2026-02-17T12:05:44.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 -- 10.20.193.90:0/2486738255 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fbb0c10e4c0 con 0x7fbae80416d0 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbaf77fe640 1 -- 10.20.193.90:0/2486738255 <== mgr.14150 v2:10.20.193.90:6800/3256128927 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fbb0c10e4c0 con 0x7fbae80416d0 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbaf77fe640 20 mgrc handle_command_reply tid 1 r 0 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 10 mgrc shutdown 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 -- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbae80416d0 msgr2=0x7fbae8043ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbae80416d0 0x7fbae8043ac0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8003a80 tx=0x7fbaf80092b0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 -- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 msgr2=0x7fbb0c1a3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c1a3290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbb0402fd40 tx=0x7fbb0402fd70 comp rx=0 tx=0).stop 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 -- 10.20.193.90:0/2486738255 shutdown_connections 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbae80416d0 0x7fbae8043ac0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:6800/978560331,v1:10.20.193.90:6801/978560331] conn(0x7fbae803dbf0 0x7fbae80400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 --2- 10.20.193.90:0/2486738255 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb0c10e060 0x7fbb0c1a3290 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 -- 10.20.193.90:0/2486738255 >> 10.20.193.90:0/2486738255 conn(0x7fbb0c07c4a0 msgr2=0x7fbb0c07d020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:44.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 -- 10.20.193.90:0/2486738255 shutdown_connections 2026-02-17T12:05:44.207 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.167+0000 7fbb149ba640 1 -- 10.20.193.90:0/2486738255 wait complete. 2026-02-17T12:05:44.207 INFO:teuthology.orchestra.run.trial090.stdout:mgr epoch 9 is available 2026-02-17T12:05:44.207 INFO:teuthology.orchestra.run.trial090.stdout:Generating a dashboard self-signed certificate... 2026-02-17T12:05:44.456 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-17T12:05:44.456 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.305+0000 7fcba532c640 1 Processor -- start 2026-02-17T12:05:44.456 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.305+0000 7fcba532c640 1 -- start start 2026-02-17T12:05:44.456 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.305+0000 7fcba532c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba0109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.456 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.305+0000 7fcba532c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcba01099d0 con 0x7fcba0109000 2026-02-17T12:05:44.456 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.305+0000 7fcb9effd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba0109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.456 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.305+0000 7fcb9effd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba0109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57010/0 (socket says 10.20.193.90:57010) 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.305+0000 7fcb9effd640 1 -- 10.20.193.90:0/3249945611 learned_addr learned my addr 10.20.193.90:0/3249945611 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.305+0000 7fcb9effd640 1 -- 10.20.193.90:0/3249945611 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba010a200 con 0x7fcba0109000 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcb9effd640 1 --2- 10.20.193.90:0/3249945611 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba0109400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009920 tx=0x7fcb9402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c41de785fe46428 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcb9dffb640 1 -- 10.20.193.90:0/3249945611 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9403c070 con 0x7fcba0109000 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcb9dffb640 1 -- 10.20.193.90:0/3249945611 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fcb94037440 con 0x7fcba0109000 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcb9dffb640 1 -- 10.20.193.90:0/3249945611 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb940354d0 con 0x7fcba0109000 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcba532c640 1 -- 10.20.193.90:0/3249945611 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 msgr2=0x7fcba0109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcba532c640 1 --2- 10.20.193.90:0/3249945611 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba0109400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009920 tx=0x7fcb9402ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcba532c640 1 -- 10.20.193.90:0/3249945611 shutdown_connections 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcba532c640 1 --2- 10.20.193.90:0/3249945611 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba0109400 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.457 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcba532c640 1 -- 10.20.193.90:0/3249945611 >> 10.20.193.90:0/3249945611 conn(0x7fcba007c4e0 msgr2=0x7fcba007c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcba532c640 1 -- 10.20.193.90:0/3249945611 shutdown_connections 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.306+0000 7fcba532c640 1 -- 10.20.193.90:0/3249945611 wait complete. 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcba532c640 1 Processor -- start 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcba532c640 1 -- start start 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcba532c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcba532c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcba010d430 con 0x7fcba0109000 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcb9effd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcb9effd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba019ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57018/0 (socket says 10.20.193.90:57018) 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcb9effd640 1 -- 10.20.193.90:0/438796579 learned_addr learned my addr 10.20.193.90:0/438796579 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcb9effd640 1 -- 10.20.193.90:0/438796579 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba019f3b0 con 0x7fcba0109000 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcb9effd640 1 --2- 10.20.193.90:0/438796579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba019ee70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb94037d90 tx=0x7fcb9402fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.458 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcb7ffff640 1 -- 10.20.193.90:0/438796579 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb94047070 con 0x7fcba0109000 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcb7ffff640 1 -- 10.20.193.90:0/438796579 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fcb94042440 con 0x7fcba0109000 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcba532c640 1 -- 10.20.193.90:0/438796579 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba019f640 con 0x7fcba0109000 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcb7ffff640 1 -- 10.20.193.90:0/438796579 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9403c070 con 0x7fcba0109000 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.307+0000 7fcba532c640 1 -- 10.20.193.90:0/438796579 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba01a2330 con 0x7fcba0109000 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.308+0000 7fcba532c640 1 -- 10.20.193.90:0/438796579 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba0109480 con 0x7fcba0109000 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.308+0000 7fcb7ffff640 1 -- 10.20.193.90:0/438796579 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 50154+0+0 (secure 0 0 0) 0x7fcb940425f0 con 0x7fcba0109000 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.308+0000 7fcb7ffff640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.308+0000 7fcb7ffff640 4 mgrc handle_mgr_map Got map version 11 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.308+0000 7fcb7ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.308+0000 7fcb7ffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.308+0000 7fcb7ffff640 1 --2- 10.20.193.90:0/438796579 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcb7403db20 0x7fcb7403ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.459 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.308+0000 7fcb7ffff640 1 -- 10.20.193.90:0/438796579 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcb94076cc0 con 0x7fcba0109000 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.308+0000 7fcb9e7fc640 1 --2- 10.20.193.90:0/438796579 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcb7403db20 0x7fcb7403ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.308+0000 7fcb9e7fc640 1 --2- 10.20.193.90:0/438796579 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcb7403db20 0x7fcb7403ffe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcb880099c0 tx=0x7fcb88006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.310+0000 7fcb7ffff640 1 -- 10.20.193.90:0/438796579 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcb94045120 con 0x7fcba0109000 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.396+0000 7fcba532c640 20 mgrc start_command cmd: [{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.396+0000 7fcba532c640 1 -- 10.20.193.90:0/438796579 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fcba0106e70 con 0x7fcb7403db20 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.429+0000 7fcb7ffff640 1 -- 10.20.193.90:0/438796579 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fcba0106e70 con 0x7fcb7403db20 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.429+0000 7fcb7ffff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 10 mgrc shutdown 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 1 -- 10.20.193.90:0/438796579 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcb7403db20 msgr2=0x7fcb7403ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 1 --2- 10.20.193.90:0/438796579 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcb7403db20 0x7fcb7403ffe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcb880099c0 tx=0x7fcb88006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 1 -- 10.20.193.90:0/438796579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 msgr2=0x7fcba019ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 1 --2- 10.20.193.90:0/438796579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba019ee70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb94037d90 tx=0x7fcb9402fcd0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.460 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 1 -- 10.20.193.90:0/438796579 shutdown_connections 2026-02-17T12:05:44.461 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 1 --2- 10.20.193.90:0/438796579 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcb7403db20 0x7fcb7403ffe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.461 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 1 --2- 10.20.193.90:0/438796579 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcba0109000 0x7fcba019ee70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.461 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 1 -- 10.20.193.90:0/438796579 >> 10.20.193.90:0/438796579 conn(0x7fcba007c4e0 msgr2=0x7fcba0106760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:44.461 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 1 -- 10.20.193.90:0/438796579 shutdown_connections 2026-02-17T12:05:44.461 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.430+0000 7fcba532c640 1 -- 10.20.193.90:0/438796579 wait complete. 2026-02-17T12:05:44.461 INFO:teuthology.orchestra.run.trial090.stdout:Creating initial admin user... 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: [17/Feb/2026:12:05:44] ENGINE Bus STARTING 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: mgrmap e11: a(active, since 1.00425s) 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: [17/Feb/2026:12:05:44] ENGINE Serving on https://10.20.193.90:7150 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: [17/Feb/2026:12:05:44] ENGINE Client ('10.20.193.90', 39310) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: [17/Feb/2026:12:05:44] ENGINE Serving on http://10.20.193.90:8765 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: [17/Feb/2026:12:05:44] ENGINE Bus STARTED 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:44.649 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:44 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:44.831 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$VEdgKDObkvfi/tX.xPdFH./uQUyfVCBIj2bp/knnLdAnm2b4V9XHy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771329944, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-17T12:05:44.832 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.552+0000 7f3530681640 1 Processor -- start 2026-02-17T12:05:44.832 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.552+0000 7f3530681640 1 -- start start 2026-02-17T12:05:44.832 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.552+0000 7f3530681640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f3528110450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.832 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.552+0000 7f3530681640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3528081590 con 0x7f352810e060 2026-02-17T12:05:44.832 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.553+0000 7f352e3f6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f3528110450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.832 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.553+0000 7f352e3f6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f3528110450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57026/0 (socket says 10.20.193.90:57026) 2026-02-17T12:05:44.832 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.553+0000 7f352e3f6640 1 -- 10.20.193.90:0/3776038312 learned_addr learned my addr 10.20.193.90:0/3776038312 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:44.832 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.553+0000 7f352e3f6640 1 -- 10.20.193.90:0/3776038312 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3528110990 con 0x7f352810e060 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.553+0000 7f352e3f6640 1 --2- 10.20.193.90:0/3776038312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f3528110450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3518009920 tx=0x7f351802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c715aecda83a48 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.553+0000 7f352d3f4640 1 -- 10.20.193.90:0/3776038312 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351803c070 con 0x7f352810e060 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.553+0000 7f352d3f4640 1 -- 10.20.193.90:0/3776038312 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3518037440 con 0x7f352810e060 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.553+0000 7f352d3f4640 1 -- 10.20.193.90:0/3776038312 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35180354d0 con 0x7f352810e060 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.553+0000 7f3530681640 1 -- 10.20.193.90:0/3776038312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 msgr2=0x7f3528110450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.553+0000 7f3530681640 1 --2- 10.20.193.90:0/3776038312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f3528110450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3518009920 tx=0x7f351802ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 -- 10.20.193.90:0/3776038312 shutdown_connections 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 --2- 10.20.193.90:0/3776038312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f3528110450 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 -- 10.20.193.90:0/3776038312 >> 10.20.193.90:0/3776038312 conn(0x7f352807c4e0 msgr2=0x7f352807e920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 -- 10.20.193.90:0/3776038312 shutdown_connections 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 -- 10.20.193.90:0/3776038312 wait complete. 2026-02-17T12:05:44.833 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 Processor -- start 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 -- start start 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f35281a32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3528111780 con 0x7f352810e060 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f352e3f6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f35281a32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f352e3f6640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f35281a32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57028/0 (socket says 10.20.193.90:57028) 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f352e3f6640 1 -- 10.20.193.90:0/1821793616 learned_addr learned my addr 10.20.193.90:0/1821793616 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f352e3f6640 1 -- 10.20.193.90:0/1821793616 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35281a3810 con 0x7f352810e060 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f352e3f6640 1 --2- 10.20.193.90:0/1821793616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f35281a32d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f351802fcd0 tx=0x7f351802fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f350f7fe640 1 -- 10.20.193.90:0/1821793616 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3518047070 con 0x7f352810e060 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f350f7fe640 1 -- 10.20.193.90:0/1821793616 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3518042440 con 0x7f352810e060 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 -- 10.20.193.90:0/1821793616 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35281a3aa0 con 0x7f352810e060 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f350f7fe640 1 -- 10.20.193.90:0/1821793616 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f351803c070 con 0x7f352810e060 2026-02-17T12:05:44.834 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.554+0000 7f3530681640 1 -- 10.20.193.90:0/1821793616 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35281a6790 con 0x7f352810e060 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.555+0000 7f3530681640 1 -- 10.20.193.90:0/1821793616 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35281a3f80 con 0x7f352810e060 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.555+0000 7f350f7fe640 1 -- 10.20.193.90:0/1821793616 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 50154+0+0 (secure 0 0 0) 0x7f3518041570 con 0x7f352810e060 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.555+0000 7f350f7fe640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.555+0000 7f350f7fe640 4 mgrc handle_mgr_map Got map version 11 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.555+0000 7f350f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.555+0000 7f350f7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.555+0000 7f350f7fe640 1 --2- 10.20.193.90:0/1821793616 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f350403db20 0x7f350403ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.555+0000 7f350f7fe640 1 -- 10.20.193.90:0/1821793616 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3518076ce0 con 0x7f352810e060 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.555+0000 7f352dbf5640 1 --2- 10.20.193.90:0/1821793616 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f350403db20 0x7f350403ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.556+0000 7f352dbf5640 1 --2- 10.20.193.90:0/1821793616 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f350403db20 0x7f350403ffe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f351c0099c0 tx=0x7f351c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:44.835 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.558+0000 7f350f7fe640 1 -- 10.20.193.90:0/1821793616 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f35281a3f80 con 0x7f352810e060 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.648+0000 7f3530681640 20 mgrc start_command cmd: [{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}] 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.648+0000 7f3530681640 1 -- 10.20.193.90:0/1821793616 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f35281a6960 con 0x7f350403db20 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.789+0000 7f350f7fe640 1 -- 10.20.193.90:0/1821793616 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f35281a6960 con 0x7f350403db20 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.789+0000 7f350f7fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 10 mgrc shutdown 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 1 -- 10.20.193.90:0/1821793616 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f350403db20 msgr2=0x7f350403ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 1 --2- 10.20.193.90:0/1821793616 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f350403db20 0x7f350403ffe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f351c0099c0 tx=0x7f351c006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 1 -- 10.20.193.90:0/1821793616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 msgr2=0x7f35281a32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 1 --2- 10.20.193.90:0/1821793616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f35281a32d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f351802fcd0 tx=0x7f351802fd00 comp rx=0 tx=0).stop 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 1 -- 10.20.193.90:0/1821793616 shutdown_connections 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 1 --2- 10.20.193.90:0/1821793616 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f350403db20 0x7f350403ffe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.836 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 1 --2- 10.20.193.90:0/1821793616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f352810e060 0x7f35281a32d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:44.837 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 1 -- 10.20.193.90:0/1821793616 >> 10.20.193.90:0/1821793616 conn(0x7f352807c4e0 msgr2=0x7f352807d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:44.837 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 1 -- 10.20.193.90:0/1821793616 shutdown_connections 2026-02-17T12:05:44.837 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.790+0000 7f3530681640 1 -- 10.20.193.90:0/1821793616 wait complete. 2026-02-17T12:05:44.837 INFO:teuthology.orchestra.run.trial090.stdout:Fetching dashboard port number... 2026-02-17T12:05:45.039 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 8443 2026-02-17T12:05:45.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.922+0000 7f9717540640 1 Processor -- start 2026-02-17T12:05:45.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.922+0000 7f9717540640 1 -- start start 2026-02-17T12:05:45.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.922+0000 7f9717540640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f9710109430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:45.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.922+0000 7f9717540640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9710109a00 con 0x7f9710109030 2026-02-17T12:05:45.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.922+0000 7f97152b5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f9710109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:45.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.922+0000 7f97152b5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f9710109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57038/0 (socket says 10.20.193.90:57038) 2026-02-17T12:05:45.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.922+0000 7f97152b5640 1 -- 10.20.193.90:0/939595010 learned_addr learned my addr 10.20.193.90:0/939595010 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:45.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f97152b5640 1 -- 10.20.193.90:0/939595010 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971010a230 con 0x7f9710109030 2026-02-17T12:05:45.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f97152b5640 1 --2- 10.20.193.90:0/939595010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f9710109430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9700009920 tx=0x7f970002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa52aa970933508c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f96fffff640 1 -- 10.20.193.90:0/939595010 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970003c070 con 0x7f9710109030 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f96fffff640 1 -- 10.20.193.90:0/939595010 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f9700037440 con 0x7f9710109030 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f96fffff640 1 -- 10.20.193.90:0/939595010 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97000354d0 con 0x7f9710109030 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f9717540640 1 -- 10.20.193.90:0/939595010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 msgr2=0x7f9710109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f9717540640 1 --2- 10.20.193.90:0/939595010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f9710109430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9700009920 tx=0x7f970002ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f9717540640 1 -- 10.20.193.90:0/939595010 shutdown_connections 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f9717540640 1 --2- 10.20.193.90:0/939595010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f9710109430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f9717540640 1 -- 10.20.193.90:0/939595010 >> 10.20.193.90:0/939595010 conn(0x7f971007c4e0 msgr2=0x7f971007c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f9717540640 1 -- 10.20.193.90:0/939595010 shutdown_connections 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.923+0000 7f9717540640 1 -- 10.20.193.90:0/939595010 wait complete. 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f9717540640 1 Processor -- start 2026-02-17T12:05:45.041 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f9717540640 1 -- start start 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f9717540640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f971019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f9717540640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f971010d460 con 0x7f9710109030 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f97152b5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f971019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f97152b5640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f971019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57046/0 (socket says 10.20.193.90:57046) 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f97152b5640 1 -- 10.20.193.90:0/3190879082 learned_addr learned my addr 10.20.193.90:0/3190879082 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f97152b5640 1 -- 10.20.193.90:0/3190879082 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971019f3a0 con 0x7f9710109030 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f97152b5640 1 --2- 10.20.193.90:0/3190879082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f971019ee60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9700037d90 tx=0x7f970002fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f96fe7fc640 1 -- 10.20.193.90:0/3190879082 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9700047070 con 0x7f9710109030 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f96fe7fc640 1 -- 10.20.193.90:0/3190879082 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f9700042440 con 0x7f9710109030 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f9717540640 1 -- 10.20.193.90:0/3190879082 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971019f630 con 0x7f9710109030 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f96fe7fc640 1 -- 10.20.193.90:0/3190879082 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f970003c070 con 0x7f9710109030 2026-02-17T12:05:45.042 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.924+0000 7f9717540640 1 -- 10.20.193.90:0/3190879082 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97101a2320 con 0x7f9710109030 2026-02-17T12:05:45.043 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.925+0000 7f9717540640 1 -- 10.20.193.90:0/3190879082 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97101094b0 con 0x7f9710109030 2026-02-17T12:05:45.043 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.925+0000 7f96fe7fc640 1 -- 10.20.193.90:0/3190879082 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 50154+0+0 (secure 0 0 0) 0x7f97000425f0 con 0x7f9710109030 2026-02-17T12:05:45.043 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.925+0000 7f96fe7fc640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-17T12:05:45.043 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.925+0000 7f96fe7fc640 4 mgrc handle_mgr_map Got map version 11 2026-02-17T12:05:45.043 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.925+0000 7f96fe7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:45.043 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.925+0000 7f96fe7fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:45.043 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.925+0000 7f96fe7fc640 1 --2- 10.20.193.90:0/3190879082 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f96ec03dad0 0x7f96ec03ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:45.043 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.925+0000 7f96fe7fc640 1 -- 10.20.193.90:0/3190879082 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9700076c40 con 0x7f9710109030 2026-02-17T12:05:45.043 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.925+0000 7f9714ab4640 1 --2- 10.20.193.90:0/3190879082 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f96ec03dad0 0x7f96ec03ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:45.043 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.925+0000 7f9714ab4640 1 --2- 10.20.193.90:0/3190879082 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f96ec03dad0 0x7f96ec03ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f97040099c0 tx=0x7f9704006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:44.928+0000 7f96fe7fc640 1 -- 10.20.193.90:0/3190879082 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f970007c020 con 0x7f9710109030 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.013+0000 7f9717540640 1 -- 10.20.193.90:0/3190879082 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f97101a2780 con 0x7f9710109030 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.013+0000 7f96fe7fc640 1 -- 10.20.193.90:0/3190879082 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f970004a360 con 0x7f9710109030 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 10 mgrc shutdown 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 1 -- 10.20.193.90:0/3190879082 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f96ec03dad0 msgr2=0x7f96ec03ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 1 --2- 10.20.193.90:0/3190879082 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f96ec03dad0 0x7f96ec03ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f97040099c0 tx=0x7f9704006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 1 -- 10.20.193.90:0/3190879082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 msgr2=0x7f971019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 1 --2- 10.20.193.90:0/3190879082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f971019ee60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9700037d90 tx=0x7f970002fcd0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 1 -- 10.20.193.90:0/3190879082 shutdown_connections 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 1 --2- 10.20.193.90:0/3190879082 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f96ec03dad0 0x7f96ec03ff90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 1 --2- 10.20.193.90:0/3190879082 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9710109030 0x7f971019ee60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.044 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 1 -- 10.20.193.90:0/3190879082 >> 10.20.193.90:0/3190879082 conn(0x7f971007c4e0 msgr2=0x7f9710106720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:45.045 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 1 -- 10.20.193.90:0/3190879082 shutdown_connections 2026-02-17T12:05:45.045 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.014+0000 7f9717540640 1 -- 10.20.193.90:0/3190879082 wait complete. 2026-02-17T12:05:45.045 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T12:05:45.045 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout disabled 2026-02-17T12:05:45.049 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T12:05:45.049 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-17T12:05:45.049 INFO:teuthology.orchestra.run.trial090.stdout:firewalld.service is not enabled 2026-02-17T12:05:45.049 INFO:teuthology.orchestra.run.trial090.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-17T12:05:45.050 INFO:teuthology.orchestra.run.trial090.stdout:Ceph Dashboard is now available at: 2026-02-17T12:05:45.050 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:45.050 INFO:teuthology.orchestra.run.trial090.stdout: URL: https://trial090:8443/ 2026-02-17T12:05:45.050 INFO:teuthology.orchestra.run.trial090.stdout: User: admin 2026-02-17T12:05:45.051 INFO:teuthology.orchestra.run.trial090.stdout: Password: k68sr7jt6d 2026-02-17T12:05:45.051 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:45.051 INFO:teuthology.orchestra.run.trial090.stdout:Saving cluster configuration to /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/config directory 2026-02-17T12:05:45.307 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.149+0000 7fe920c43640 1 Processor -- start 2026-02-17T12:05:45.307 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.149+0000 7fe920c43640 1 -- start start 2026-02-17T12:05:45.307 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.149+0000 7fe920c43640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:45.307 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.149+0000 7fe920c43640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c1099d0 con 0x7fe91c109000 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.149+0000 7fe91a575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.150+0000 7fe91a575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57062/0 (socket says 10.20.193.90:57062) 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.150+0000 7fe91a575640 1 -- 10.20.193.90:0/550129460 learned_addr learned my addr 10.20.193.90:0/550129460 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.150+0000 7fe91a575640 1 -- 10.20.193.90:0/550129460 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c10a200 con 0x7fe91c109000 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.150+0000 7fe91a575640 1 --2- 10.20.193.90:0/550129460 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c109400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe910009920 tx=0x7fe91002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62321f5988898957 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.150+0000 7fe919573640 1 -- 10.20.193.90:0/550129460 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe91003c070 con 0x7fe91c109000 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.150+0000 7fe919573640 1 -- 10.20.193.90:0/550129460 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe910037440 con 0x7fe91c109000 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.150+0000 7fe919573640 1 -- 10.20.193.90:0/550129460 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9100354d0 con 0x7fe91c109000 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 -- 10.20.193.90:0/550129460 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 msgr2=0x7fe91c109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 --2- 10.20.193.90:0/550129460 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c109400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe910009920 tx=0x7fe91002ef20 comp rx=0 tx=0).stop 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 -- 10.20.193.90:0/550129460 shutdown_connections 2026-02-17T12:05:45.308 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 --2- 10.20.193.90:0/550129460 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c109400 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 -- 10.20.193.90:0/550129460 >> 10.20.193.90:0/550129460 conn(0x7fe91c07c520 msgr2=0x7fe91c07c930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 -- 10.20.193.90:0/550129460 shutdown_connections 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 -- 10.20.193.90:0/550129460 wait complete. 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 Processor -- start 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 -- start start 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe920c43640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c10d430 con 0x7fe91c109000 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe91a575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe91a575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c19ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57070/0 (socket says 10.20.193.90:57070) 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe91a575640 1 -- 10.20.193.90:0/250556212 learned_addr learned my addr 10.20.193.90:0/250556212 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:45.309 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe91a575640 1 -- 10.20.193.90:0/250556212 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c19f390 con 0x7fe91c109000 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.151+0000 7fe91a575640 1 --2- 10.20.193.90:0/250556212 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c19ee50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe910037d90 tx=0x7fe91002fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe9037fe640 1 -- 10.20.193.90:0/250556212 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe910047070 con 0x7fe91c109000 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe9037fe640 1 -- 10.20.193.90:0/250556212 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe910042440 con 0x7fe91c109000 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe920c43640 1 -- 10.20.193.90:0/250556212 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91c19f620 con 0x7fe91c109000 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe9037fe640 1 -- 10.20.193.90:0/250556212 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe91003c070 con 0x7fe91c109000 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe920c43640 1 -- 10.20.193.90:0/250556212 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91c1a2310 con 0x7fe91c109000 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe920c43640 1 -- 10.20.193.90:0/250556212 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91c109480 con 0x7fe91c109000 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe9037fe640 1 -- 10.20.193.90:0/250556212 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 50154+0+0 (secure 0 0 0) 0x7fe910035b60 con 0x7fe91c109000 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe9037fe640 20 mgrc handle_mgr_map mgrmap(e 11) 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe9037fe640 4 mgrc handle_mgr_map Got map version 11 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe9037fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe9037fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:45.310 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe9037fe640 1 --2- 10.20.193.90:0/250556212 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8f403db20 0x7fe8f403ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.152+0000 7fe9037fe640 1 -- 10.20.193.90:0/250556212 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe910076c80 con 0x7fe91c109000 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.153+0000 7fe919d74640 1 --2- 10.20.193.90:0/250556212 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8f403db20 0x7fe8f403ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.153+0000 7fe919d74640 1 --2- 10.20.193.90:0/250556212 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8f403db20 0x7fe8f403ffe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe9040099c0 tx=0x7fe904006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.155+0000 7fe9037fe640 1 -- 10.20.193.90:0/250556212 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe9100425f0 con 0x7fe91c109000 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.279+0000 7fe920c43640 1 -- 10.20.193.90:0/250556212 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fe91c1a2770 con 0x7fe91c109000 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.280+0000 7fe9037fe640 1 -- 10.20.193.90:0/250556212 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fe910036c70 con 0x7fe91c109000 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.281+0000 7fe920c43640 10 mgrc shutdown 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.281+0000 7fe920c43640 1 -- 10.20.193.90:0/250556212 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8f403db20 msgr2=0x7fe8f403ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.281+0000 7fe920c43640 1 --2- 10.20.193.90:0/250556212 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8f403db20 0x7fe8f403ffe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe9040099c0 tx=0x7fe904006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.281+0000 7fe920c43640 1 -- 10.20.193.90:0/250556212 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 msgr2=0x7fe91c19ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:45.311 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.281+0000 7fe920c43640 1 --2- 10.20.193.90:0/250556212 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c19ee50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe910037d90 tx=0x7fe91002fcd0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.282+0000 7fe920c43640 1 -- 10.20.193.90:0/250556212 shutdown_connections 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.282+0000 7fe920c43640 1 --2- 10.20.193.90:0/250556212 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8f403db20 0x7fe8f403ffe0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.282+0000 7fe920c43640 1 --2- 10.20.193.90:0/250556212 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe91c109000 0x7fe91c19ee50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.282+0000 7fe920c43640 1 -- 10.20.193.90:0/250556212 >> 10.20.193.90:0/250556212 conn(0x7fe91c07c520 msgr2=0x7fe91c106700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.282+0000 7fe920c43640 1 -- 10.20.193.90:0/250556212 shutdown_connections 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr 2026-02-17T12:05:45.282+0000 7fe920c43640 1 -- 10.20.193.90:0/250556212 wait complete. 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout:Or, if you are only running a single cluster on this host: 2026-02-17T12:05:45.312 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout: ceph telemetry on 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout:For more information see: 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:45.313 INFO:teuthology.orchestra.run.trial090.stdout:Bootstrap complete. 2026-02-17T12:05:45.328 INFO:tasks.cephadm:Fetching config... 2026-02-17T12:05:45.329 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:45.329 DEBUG:teuthology.orchestra.run.trial090:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-17T12:05:45.347 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-17T12:05:45.347 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:45.347 DEBUG:teuthology.orchestra.run.trial090:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-17T12:05:45.403 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-17T12:05:45.404 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:45.404 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-17T12:05:45.469 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-17T12:05:45.470 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:45.470 DEBUG:teuthology.orchestra.run.trial090:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-17T12:05:45.528 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-17T12:05:45.528 DEBUG:teuthology.orchestra.run.trial090:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEeD8U8wrhi0+/VFeY02MAiQlk6k7A947pn1Utip1eqD ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-17T12:05:45.600 INFO:teuthology.orchestra.run.trial090.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEeD8U8wrhi0+/VFeY02MAiQlk6k7A947pn1Utip1eqD ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:45.611 DEBUG:teuthology.orchestra.run.trial198:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEeD8U8wrhi0+/VFeY02MAiQlk6k7A947pn1Utip1eqD ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-17T12:05:45.647 INFO:teuthology.orchestra.run.trial198.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEeD8U8wrhi0+/VFeY02MAiQlk6k7A947pn1Utip1eqD ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:45.657 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-17T12:05:45.813 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:05:45.873 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:45 trial090 ceph-mon[39228]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:45.873 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:45 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:45.873 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:45 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3190879082' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-17T12:05:45.873 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:45 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/250556212' entity='client.admin' 2026-02-17T12:05:45.937 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 -- 10.20.193.90:0/4231184480 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39a8104620 msgr2=0x7f39a8104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 --2- 10.20.193.90:0/4231184480 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39a8104620 0x7f39a8104a20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f399c0099b0 tx=0x7f399c02f2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 -- 10.20.193.90:0/4231184480 shutdown_connections 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 --2- 10.20.193.90:0/4231184480 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39a8104620 0x7f39a8104a20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 -- 10.20.193.90:0/4231184480 >> 10.20.193.90:0/4231184480 conn(0x7f39a80ffdb0 msgr2=0x7f39a81021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 -- 10.20.193.90:0/4231184480 shutdown_connections 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 -- 10.20.193.90:0/4231184480 wait complete. 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 Processor -- start 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 -- start start 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39a8104620 0x7f39a819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.936+0000 7f39acc72640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39a8109aa0 con 0x7f39a8104620 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f39a6575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39a8104620 0x7f39a819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f39a6575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39a8104620 0x7f39a819b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57088/0 (socket says 10.20.193.90:57088) 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f39a6575640 1 -- 10.20.193.90:0/2549791025 learned_addr learned my addr 10.20.193.90:0/2549791025 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f39a6575640 1 -- 10.20.193.90:0/2549791025 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a819b720 con 0x7f39a8104620 2026-02-17T12:05:45.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f39a6575640 1 --2- 10.20.193.90:0/2549791025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39a8104620 0x7f39a819b1e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f399c005ec0 tx=0x7f399c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:45.939 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f398f7fe640 1 -- 10.20.193.90:0/2549791025 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c038510 con 0x7f39a8104620 2026-02-17T12:05:45.939 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f39acc72640 1 -- 10.20.193.90:0/2549791025 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a819b9b0 con 0x7f39a8104620 2026-02-17T12:05:45.939 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f398f7fe640 1 -- 10.20.193.90:0/2549791025 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f399c046070 con 0x7f39a8104620 2026-02-17T12:05:45.939 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f398f7fe640 1 -- 10.20.193.90:0/2549791025 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399c041810 con 0x7f39a8104620 2026-02-17T12:05:45.939 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f39acc72640 1 -- 10.20.193.90:0/2549791025 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a819e6a0 con 0x7f39a8104620 2026-02-17T12:05:45.939 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.937+0000 7f39acc72640 1 -- 10.20.193.90:0/2549791025 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a810a240 con 0x7f39a8104620 2026-02-17T12:05:45.939 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.938+0000 7f398f7fe640 1 -- 10.20.193.90:0/2549791025 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 12) ==== 50260+0+0 (secure 0 0 0) 0x7f399c0386b0 con 0x7f39a8104620 2026-02-17T12:05:45.939 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.938+0000 7f398f7fe640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T12:05:45.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.938+0000 7f398f7fe640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T12:05:45.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.938+0000 7f398f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:45.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.938+0000 7f398f7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:45.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.938+0000 7f398f7fe640 1 --2- 10.20.193.90:0/2549791025 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f398003dbf0 0x7f39800400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:45.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.938+0000 7f398f7fe640 1 -- 10.20.193.90:0/2549791025 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f399c076fd0 con 0x7f39a8104620 2026-02-17T12:05:45.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.938+0000 7f39a5d74640 1 --2- 10.20.193.90:0/2549791025 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f398003dbf0 0x7f39800400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:45.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.938+0000 7f39a5d74640 1 --2- 10.20.193.90:0/2549791025 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f398003dbf0 0x7f39800400b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39900099c0 tx=0x7f3990006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:45.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:45.940+0000 7f398f7fe640 1 -- 10.20.193.90:0/2549791025 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f399c050020 con 0x7f39a8104620 2026-02-17T12:05:46.025 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.023+0000 7f39acc72640 1 -- 10.20.193.90:0/2549791025 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f39a81948a0 con 0x7f39a8104620 2026-02-17T12:05:46.026 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.025+0000 7f398f7fe640 1 -- 10.20.193.90:0/2549791025 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f399c0389d0 con 0x7f39a8104620 2026-02-17T12:05:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 10 mgrc shutdown 2026-02-17T12:05:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 1 -- 10.20.193.90:0/2549791025 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f398003dbf0 msgr2=0x7f39800400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 1 --2- 10.20.193.90:0/2549791025 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f398003dbf0 0x7f39800400b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39900099c0 tx=0x7f3990006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 1 -- 10.20.193.90:0/2549791025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39a8104620 msgr2=0x7f39a819b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 1 --2- 10.20.193.90:0/2549791025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39a8104620 0x7f39a819b1e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f399c005ec0 tx=0x7f399c004290 comp rx=0 tx=0).stop 2026-02-17T12:05:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 1 -- 10.20.193.90:0/2549791025 shutdown_connections 2026-02-17T12:05:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 1 --2- 10.20.193.90:0/2549791025 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f398003dbf0 0x7f39800400b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 1 --2- 10.20.193.90:0/2549791025 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39a8104620 0x7f39a819b1e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 1 -- 10.20.193.90:0/2549791025 >> 10.20.193.90:0/2549791025 conn(0x7f39a80ffdb0 msgr2=0x7f39a8100400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:46.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 1 -- 10.20.193.90:0/2549791025 shutdown_connections 2026-02-17T12:05:46.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.026+0000 7f39acc72640 1 -- 10.20.193.90:0/2549791025 wait complete. 2026-02-17T12:05:46.066 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-17T12:05:46.067 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-17T12:05:46.218 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:05:46.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 -- 10.20.193.90:0/4234241026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80c01045f0 msgr2=0x7f80c01049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 --2- 10.20.193.90:0/4234241026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80c01045f0 0x7f80c01049f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0099b0 tx=0x7f80ac02f2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 -- 10.20.193.90:0/4234241026 shutdown_connections 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 --2- 10.20.193.90:0/4234241026 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80c01045f0 0x7f80c01049f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 -- 10.20.193.90:0/4234241026 >> 10.20.193.90:0/4234241026 conn(0x7f80c00ffdb0 msgr2=0x7f80c01021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 -- 10.20.193.90:0/4234241026 shutdown_connections 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 -- 10.20.193.90:0/4234241026 wait complete. 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 Processor -- start 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 -- start start 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80c01045f0 0x7f80c019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80c64a8640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80c0109a70 con 0x7f80c01045f0 2026-02-17T12:05:46.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80bffff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80c01045f0 0x7f80c019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80bffff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80c01045f0 0x7f80c019b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57102/0 (socket says 10.20.193.90:57102) 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.328+0000 7f80bffff640 1 -- 10.20.193.90:0/790441991 learned_addr learned my addr 10.20.193.90:0/790441991 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.329+0000 7f80bffff640 1 -- 10.20.193.90:0/790441991 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c019b710 con 0x7f80c01045f0 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.329+0000 7f80bffff640 1 --2- 10.20.193.90:0/790441991 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80c01045f0 0x7f80c019b1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005ec0 tx=0x7f80ac004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.329+0000 7f80bd7fa640 1 -- 10.20.193.90:0/790441991 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac038510 con 0x7f80c01045f0 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.329+0000 7f80bd7fa640 1 -- 10.20.193.90:0/790441991 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f80ac046070 con 0x7f80c01045f0 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.329+0000 7f80c64a8640 1 -- 10.20.193.90:0/790441991 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c019b9a0 con 0x7f80c01045f0 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.329+0000 7f80bd7fa640 1 -- 10.20.193.90:0/790441991 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac041810 con 0x7f80c01045f0 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.329+0000 7f80c64a8640 1 -- 10.20.193.90:0/790441991 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c019e690 con 0x7f80c01045f0 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.329+0000 7f80c64a8640 1 -- 10.20.193.90:0/790441991 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c010a210 con 0x7f80c01045f0 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.329+0000 7f80bd7fa640 1 -- 10.20.193.90:0/790441991 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 12) ==== 50260+0+0 (secure 0 0 0) 0x7f80ac0386b0 con 0x7f80c01045f0 2026-02-17T12:05:46.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.329+0000 7f80bd7fa640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T12:05:46.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.330+0000 7f80bd7fa640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T12:05:46.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.330+0000 7f80bd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:46.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.330+0000 7f80bd7fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:46.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.330+0000 7f80bd7fa640 1 --2- 10.20.193.90:0/790441991 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f809403dbf0 0x7f80940400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:46.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.330+0000 7f80bd7fa640 1 -- 10.20.193.90:0/790441991 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f80ac077080 con 0x7f80c01045f0 2026-02-17T12:05:46.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.330+0000 7f80bf7fe640 1 --2- 10.20.193.90:0/790441991 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f809403dbf0 0x7f80940400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:46.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.330+0000 7f80bf7fe640 1 --2- 10.20.193.90:0/790441991 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f809403dbf0 0x7f80940400b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f80b00099c0 tx=0x7f80b0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:46.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.332+0000 7f80bd7fa640 1 -- 10.20.193.90:0/790441991 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f80ac050200 con 0x7f80c01045f0 2026-02-17T12:05:46.417 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.416+0000 7f80c64a8640 20 mgrc start_command cmd: [{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:46.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.416+0000 7f80c64a8640 1 -- 10.20.193.90:0/790441991 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f80c01947d0 con 0x7f809403dbf0 2026-02-17T12:05:46.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80bd7fa640 1 -- 10.20.193.90:0/790441991 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f80c01947d0 con 0x7f809403dbf0 2026-02-17T12:05:46.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80bd7fa640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:46.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 10 mgrc shutdown 2026-02-17T12:05:46.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 1 -- 10.20.193.90:0/790441991 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f809403dbf0 msgr2=0x7f80940400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:46.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 1 --2- 10.20.193.90:0/790441991 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f809403dbf0 0x7f80940400b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f80b00099c0 tx=0x7f80b0006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:46.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 1 -- 10.20.193.90:0/790441991 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80c01045f0 msgr2=0x7f80c019b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:46.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 1 --2- 10.20.193.90:0/790441991 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80c01045f0 0x7f80c019b1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005ec0 tx=0x7f80ac004290 comp rx=0 tx=0).stop 2026-02-17T12:05:46.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 1 -- 10.20.193.90:0/790441991 shutdown_connections 2026-02-17T12:05:46.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 1 --2- 10.20.193.90:0/790441991 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f809403dbf0 0x7f80940400b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:46.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 1 --2- 10.20.193.90:0/790441991 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f80c01045f0 0x7f80c019b1d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:46.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 1 -- 10.20.193.90:0/790441991 >> 10.20.193.90:0/790441991 conn(0x7f80c00ffdb0 msgr2=0x7f80c0100450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:46.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 1 -- 10.20.193.90:0/790441991 shutdown_connections 2026-02-17T12:05:46.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:46.419+0000 7f80c64a8640 1 -- 10.20.193.90:0/790441991 wait complete. 2026-02-17T12:05:46.455 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial198 2026-02-17T12:05:46.456 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:05:46.456 DEBUG:teuthology.orchestra.run.trial198:> dd of=/etc/ceph/ceph.conf 2026-02-17T12:05:46.473 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:05:46.474 DEBUG:teuthology.orchestra.run.trial198:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T12:05:46.530 INFO:tasks.cephadm:Adding host trial198 to orchestrator... 2026-02-17T12:05:46.530 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph orch host add trial198 2026-02-17T12:05:46.745 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:05:47.056 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: mgrmap e12: a(active, since 2s) 2026-02-17T12:05:47.056 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:47.056 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:47.056 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial090", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/2549791025' entity='client.admin' 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:05:47.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:46 trial090 ceph-mon[39228]: Updating trial090:/etc/ceph/ceph.conf 2026-02-17T12:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.227+0000 7fdb9b13c640 1 -- 10.20.193.90:0/3994955317 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94102580 msgr2=0x7fdb94102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.227+0000 7fdb9b13c640 1 --2- 10.20.193.90:0/3994955317 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94102580 0x7fdb94102960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb840099b0 tx=0x7fdb8402f2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.227+0000 7fdb9b13c640 1 -- 10.20.193.90:0/3994955317 shutdown_connections 2026-02-17T12:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.227+0000 7fdb9b13c640 1 --2- 10.20.193.90:0/3994955317 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94102580 0x7fdb94102960 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.227+0000 7fdb9b13c640 1 -- 10.20.193.90:0/3994955317 >> 10.20.193.90:0/3994955317 conn(0x7fdb940791b0 msgr2=0x7fdb94100450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.227+0000 7fdb9b13c640 1 -- 10.20.193.90:0/3994955317 shutdown_connections 2026-02-17T12:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.227+0000 7fdb9b13c640 1 -- 10.20.193.90:0/3994955317 wait complete. 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb9b13c640 1 Processor -- start 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb9b13c640 1 -- start start 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb9b13c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94102580 0x7fdb9419b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb9b13c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9410bd30 con 0x7fdb94102580 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb98eb1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94102580 0x7fdb9419b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb98eb1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94102580 0x7fdb9419b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57128/0 (socket says 10.20.193.90:57128) 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb98eb1640 1 -- 10.20.193.90:0/835977245 learned_addr learned my addr 10.20.193.90:0/835977245 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb98eb1640 1 -- 10.20.193.90:0/835977245 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9419bad0 con 0x7fdb94102580 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb98eb1640 1 --2- 10.20.193.90:0/835977245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94102580 0x7fdb9419b590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb84004290 tx=0x7fdb840042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb89ffb640 1 -- 10.20.193.90:0/835977245 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb84038510 con 0x7fdb94102580 2026-02-17T12:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb9b13c640 1 -- 10.20.193.90:0/835977245 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9419bd60 con 0x7fdb94102580 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb89ffb640 1 -- 10.20.193.90:0/835977245 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fdb84046070 con 0x7fdb94102580 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb89ffb640 1 -- 10.20.193.90:0/835977245 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb84041610 con 0x7fdb94102580 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.228+0000 7fdb9b13c640 1 -- 10.20.193.90:0/835977245 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb9419fe60 con 0x7fdb94102580 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.229+0000 7fdb9b13c640 1 -- 10.20.193.90:0/835977245 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb94103a60 con 0x7fdb94102580 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.229+0000 7fdb89ffb640 1 -- 10.20.193.90:0/835977245 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 12) ==== 50260+0+0 (secure 0 0 0) 0x7fdb840386b0 con 0x7fdb94102580 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.229+0000 7fdb89ffb640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.229+0000 7fdb89ffb640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.229+0000 7fdb89ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.229+0000 7fdb89ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.229+0000 7fdb89ffb640 1 --2- 10.20.193.90:0/835977245 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fdb7003dbf0 0x7fdb700400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.229+0000 7fdb89ffb640 1 -- 10.20.193.90:0/835977245 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdb84076fb0 con 0x7fdb94102580 2026-02-17T12:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.229+0000 7fdb8bfff640 1 --2- 10.20.193.90:0/835977245 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fdb7003dbf0 0x7fdb700400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:47.234 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.229+0000 7fdb8bfff640 1 --2- 10.20.193.90:0/835977245 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fdb7003dbf0 0x7fdb700400b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0099c0 tx=0x7fdb7c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:47.234 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.232+0000 7fdb89ffb640 1 -- 10.20.193.90:0/835977245 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdb8404ade0 con 0x7fdb94102580 2026-02-17T12:05:47.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.318+0000 7fdb9b13c640 20 mgrc start_command cmd: [{"prefix": "orch host add", "hostname": "trial198", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:47.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:47.318+0000 7fdb9b13c640 1 -- 10.20.193.90:0/835977245 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial198", "target": ["mon-mgr", ""]}) -- 0x7fdb941029e0 con 0x7fdb7003dbf0 2026-02-17T12:05:48.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:47 trial090 ceph-mon[39228]: Updating trial090:/var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/config/ceph.conf 2026-02-17T12:05:48.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:47 trial090 ceph-mon[39228]: Updating trial090:/etc/ceph/ceph.client.admin.keyring 2026-02-17T12:05:48.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:47 trial090 ceph-mon[39228]: Updating trial090:/var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T12:05:48.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:47 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:48.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:47 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:48.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:47 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:48.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:47 trial090 ceph-mon[39228]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial198", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:48.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.870+0000 7fdb89ffb640 1 -- 10.20.193.90:0/835977245 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fdb941029e0 con 0x7fdb7003dbf0 2026-02-17T12:05:48.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.870+0000 7fdb89ffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:48.870 INFO:teuthology.orchestra.run.trial090.stdout:Added host 'trial198' with addr '10.20.193.198' 2026-02-17T12:05:48.874 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 10 mgrc shutdown 2026-02-17T12:05:48.874 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 1 -- 10.20.193.90:0/835977245 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fdb7003dbf0 msgr2=0x7fdb700400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:48.874 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 1 --2- 10.20.193.90:0/835977245 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fdb7003dbf0 0x7fdb700400b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c0099c0 tx=0x7fdb7c006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:48.874 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 1 -- 10.20.193.90:0/835977245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94102580 msgr2=0x7fdb9419b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:48.874 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 1 --2- 10.20.193.90:0/835977245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94102580 0x7fdb9419b590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb84004290 tx=0x7fdb840042c0 comp rx=0 tx=0).stop 2026-02-17T12:05:48.874 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 1 -- 10.20.193.90:0/835977245 shutdown_connections 2026-02-17T12:05:48.874 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 1 --2- 10.20.193.90:0/835977245 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fdb7003dbf0 0x7fdb700400b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:48.874 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 1 --2- 10.20.193.90:0/835977245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94102580 0x7fdb9419b590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:48.874 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 1 -- 10.20.193.90:0/835977245 >> 10.20.193.90:0/835977245 conn(0x7fdb940791b0 msgr2=0x7fdb9410a360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:48.875 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 1 -- 10.20.193.90:0/835977245 shutdown_connections 2026-02-17T12:05:48.875 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:48.873+0000 7fdb9b13c640 1 -- 10.20.193.90:0/835977245 wait complete. 2026-02-17T12:05:48.911 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-17T12:05:49.060 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:05:49.161 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.161+0000 7f60b9740640 1 -- 10.20.193.90:0/3128351904 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b41033b0 msgr2=0x7f60b41007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:49.161 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.161+0000 7f60b9740640 1 --2- 10.20.193.90:0/3128351904 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b41033b0 0x7f60b41007c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f60a80099b0 tx=0x7f60a802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:49.161 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.161+0000 7f60b9740640 1 -- 10.20.193.90:0/3128351904 shutdown_connections 2026-02-17T12:05:49.161 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.161+0000 7f60b9740640 1 --2- 10.20.193.90:0/3128351904 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b41033b0 0x7f60b41007c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:49.161 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.161+0000 7f60b9740640 1 -- 10.20.193.90:0/3128351904 >> 10.20.193.90:0/3128351904 conn(0x7f60b40fc630 msgr2=0x7f60b40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:49.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.161+0000 7f60b9740640 1 -- 10.20.193.90:0/3128351904 shutdown_connections 2026-02-17T12:05:49.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.161+0000 7f60b9740640 1 -- 10.20.193.90:0/3128351904 wait complete. 2026-02-17T12:05:49.162 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:48 trial090 ceph-mon[39228]: Deploying cephadm binary to trial198 2026-02-17T12:05:49.162 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:48 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:49.162 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:48 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b9740640 1 Processor -- start 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b9740640 1 -- start start 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b9740640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b41033b0 0x7f60b4103c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b9740640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f60b410e160 con 0x7f60b41033b0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b2ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b41033b0 0x7f60b4103c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b2ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b41033b0 0x7f60b4103c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57140/0 (socket says 10.20.193.90:57140) 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b2ffd640 1 -- 10.20.193.90:0/1193294514 learned_addr learned my addr 10.20.193.90:0/1193294514 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b2ffd640 1 -- 10.20.193.90:0/1193294514 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b4107bd0 con 0x7f60b41033b0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b2ffd640 1 --2- 10.20.193.90:0/1193294514 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b41033b0 0x7f60b4103c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f60a8002410 tx=0x7f60a8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f6093fff640 1 -- 10.20.193.90:0/1193294514 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60a8038510 con 0x7f60b41033b0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b9740640 1 -- 10.20.193.90:0/1193294514 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b4107ec0 con 0x7f60b41033b0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f6093fff640 1 -- 10.20.193.90:0/1193294514 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f60a8046070 con 0x7f60b41033b0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f6093fff640 1 -- 10.20.193.90:0/1193294514 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60a8041630 con 0x7f60b41033b0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.162+0000 7f60b9740640 1 -- 10.20.193.90:0/1193294514 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b41043e0 con 0x7f60b41033b0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.163+0000 7f60b9740640 1 -- 10.20.193.90:0/1193294514 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b4101a70 con 0x7f60b41033b0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.163+0000 7f6093fff640 1 -- 10.20.193.90:0/1193294514 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 12) ==== 50260+0+0 (secure 0 0 0) 0x7f60a80386b0 con 0x7f60b41033b0 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.163+0000 7f6093fff640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T12:05:49.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.163+0000 7f6093fff640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T12:05:49.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.163+0000 7f6093fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:49.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.163+0000 7f6093fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:49.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.163+0000 7f6093fff640 1 --2- 10.20.193.90:0/1193294514 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f608803dbf0 0x7f60880400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:49.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.163+0000 7f6093fff640 1 -- 10.20.193.90:0/1193294514 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f60a8076f90 con 0x7f60b41033b0 2026-02-17T12:05:49.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.163+0000 7f60b27fc640 1 --2- 10.20.193.90:0/1193294514 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f608803dbf0 0x7f60880400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:49.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.163+0000 7f60b27fc640 1 --2- 10.20.193.90:0/1193294514 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f608803dbf0 0x7f60880400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f609c0099c0 tx=0x7f609c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:49.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.166+0000 7f6093fff640 1 -- 10.20.193.90:0/1193294514 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f60a80389d0 con 0x7f60b41033b0 2026-02-17T12:05:49.251 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.251+0000 7f60b9740640 20 mgrc start_command cmd: [{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-17T12:05:49.251 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.251+0000 7f60b9740640 1 -- 10.20.193.90:0/1193294514 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60b406a7e0 con 0x7f608803dbf0 2026-02-17T12:05:49.251 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.251+0000 7f6093fff640 1 -- 10.20.193.90:0/1193294514 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f60b406a7e0 con 0x7f608803dbf0 2026-02-17T12:05:49.252 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.251+0000 7f6093fff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:49.252 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:49.252 INFO:teuthology.orchestra.run.trial090.stdout:[{"addr": "10.20.193.90", "hostname": "trial090", "labels": [], "status": ""}, {"addr": "10.20.193.198", "hostname": "trial198", "labels": [], "status": ""}] 2026-02-17T12:05:49.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 10 mgrc shutdown 2026-02-17T12:05:49.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 1 -- 10.20.193.90:0/1193294514 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f608803dbf0 msgr2=0x7f60880400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:49.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 1 --2- 10.20.193.90:0/1193294514 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f608803dbf0 0x7f60880400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f609c0099c0 tx=0x7f609c006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:49.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 1 -- 10.20.193.90:0/1193294514 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b41033b0 msgr2=0x7f60b4103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:49.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 1 --2- 10.20.193.90:0/1193294514 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b41033b0 0x7f60b4103c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f60a8002410 tx=0x7f60a8004290 comp rx=0 tx=0).stop 2026-02-17T12:05:49.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 1 -- 10.20.193.90:0/1193294514 shutdown_connections 2026-02-17T12:05:49.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 1 --2- 10.20.193.90:0/1193294514 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f608803dbf0 0x7f60880400b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:49.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 1 --2- 10.20.193.90:0/1193294514 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b41033b0 0x7f60b4103c70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:49.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 1 -- 10.20.193.90:0/1193294514 >> 10.20.193.90:0/1193294514 conn(0x7f60b40fc630 msgr2=0x7f60b40fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:49.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 1 -- 10.20.193.90:0/1193294514 shutdown_connections 2026-02-17T12:05:49.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.252+0000 7f60b9740640 1 -- 10.20.193.90:0/1193294514 wait complete. 2026-02-17T12:05:49.287 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-17T12:05:49.287 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd crush tunables default 2026-02-17T12:05:49.433 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:05:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.535+0000 7f3c6be6c640 1 -- 10.20.193.90:0/829821902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c64077660 msgr2=0x7f3c64077a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.535+0000 7f3c6be6c640 1 --2- 10.20.193.90:0/829821902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c64077660 0x7f3c64077a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c540099b0 tx=0x7f3c5402f2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.535+0000 7f3c6be6c640 1 -- 10.20.193.90:0/829821902 shutdown_connections 2026-02-17T12:05:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.535+0000 7f3c6be6c640 1 --2- 10.20.193.90:0/829821902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c64077660 0x7f3c64077a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.535+0000 7f3c6be6c640 1 -- 10.20.193.90:0/829821902 >> 10.20.193.90:0/829821902 conn(0x7f3c641002d0 msgr2=0x7f3c641026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.535+0000 7f3c6be6c640 1 -- 10.20.193.90:0/829821902 shutdown_connections 2026-02-17T12:05:49.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.535+0000 7f3c6be6c640 1 -- 10.20.193.90:0/829821902 wait complete. 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c6be6c640 1 Processor -- start 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c6be6c640 1 -- start start 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c6be6c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c64077660 0x7f3c6419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c6be6c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c64112500 con 0x7f3c64077660 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c69be1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c64077660 0x7f3c6419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c69be1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c64077660 0x7f3c6419fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57162/0 (socket says 10.20.193.90:57162) 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c69be1640 1 -- 10.20.193.90:0/100353593 learned_addr learned my addr 10.20.193.90:0/100353593 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c69be1640 1 -- 10.20.193.90:0/100353593 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c641a00f0 con 0x7f3c64077660 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c69be1640 1 --2- 10.20.193.90:0/100353593 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c64077660 0x7f3c6419fbb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c54004290 tx=0x7f3c540042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c52ffd640 1 -- 10.20.193.90:0/100353593 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c54038510 con 0x7f3c64077660 2026-02-17T12:05:49.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c52ffd640 1 -- 10.20.193.90:0/100353593 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3c54046070 con 0x7f3c64077660 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c6be6c640 1 -- 10.20.193.90:0/100353593 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c641a0380 con 0x7f3c64077660 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c52ffd640 1 -- 10.20.193.90:0/100353593 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c54041610 con 0x7f3c64077660 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.536+0000 7f3c6be6c640 1 -- 10.20.193.90:0/100353593 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c641a07e0 con 0x7f3c64077660 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.537+0000 7f3c6be6c640 1 -- 10.20.193.90:0/100353593 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c64078da0 con 0x7f3c64077660 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.537+0000 7f3c52ffd640 1 -- 10.20.193.90:0/100353593 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 12) ==== 50260+0+0 (secure 0 0 0) 0x7f3c540386b0 con 0x7f3c64077660 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.537+0000 7f3c52ffd640 20 mgrc handle_mgr_map mgrmap(e 12) 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.537+0000 7f3c52ffd640 4 mgrc handle_mgr_map Got map version 12 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.537+0000 7f3c52ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.537+0000 7f3c52ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.537+0000 7f3c52ffd640 1 --2- 10.20.193.90:0/100353593 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3c4003dc40 0x7f3c40040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.537+0000 7f3c52ffd640 1 -- 10.20.193.90:0/100353593 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3c54076fc0 con 0x7f3c64077660 2026-02-17T12:05:49.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.537+0000 7f3c693e0640 1 --2- 10.20.193.90:0/100353593 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3c4003dc40 0x7f3c40040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:49.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.537+0000 7f3c693e0640 1 --2- 10.20.193.90:0/100353593 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3c4003dc40 0x7f3c40040100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3c580099c0 tx=0x7f3c58006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:49.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.539+0000 7f3c52ffd640 1 -- 10.20.193.90:0/100353593 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3c5404ade0 con 0x7f3c64077660 2026-02-17T12:05:49.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:49.624+0000 7f3c6be6c640 1 -- 10.20.193.90:0/100353593 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f3c64077ac0 con 0x7f3c64077660 2026-02-17T12:05:50.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.030+0000 7f3c52ffd640 1 -- 10.20.193.90:0/100353593 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f3c5404b460 con 0x7f3c64077660 2026-02-17T12:05:50.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.030+0000 7f3c52ffd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:05:50.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.030+0000 7f3c52ffd640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:05:50.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.030+0000 7f3c52ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:50.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.192+0000 7f3c52ffd640 1 -- 10.20.193.90:0/100353593 <== mon.0 v2:10.20.193.90:3300/0 8 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f3c54005690 con 0x7f3c64077660 2026-02-17T12:05:50.193 INFO:teuthology.orchestra.run.trial090.stderr:adjusted tunables profile to default 2026-02-17T12:05:50.195 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 10 mgrc shutdown 2026-02-17T12:05:50.196 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 1 -- 10.20.193.90:0/100353593 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3c4003dc40 msgr2=0x7f3c40040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:50.196 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 1 --2- 10.20.193.90:0/100353593 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3c4003dc40 0x7f3c40040100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3c580099c0 tx=0x7f3c58006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:50.196 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 1 -- 10.20.193.90:0/100353593 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c64077660 msgr2=0x7f3c6419fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:50.196 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 1 --2- 10.20.193.90:0/100353593 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c64077660 0x7f3c6419fbb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c54004290 tx=0x7f3c540042c0 comp rx=0 tx=0).stop 2026-02-17T12:05:50.196 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 1 -- 10.20.193.90:0/100353593 shutdown_connections 2026-02-17T12:05:50.196 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 1 --2- 10.20.193.90:0/100353593 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3c4003dc40 0x7f3c40040100 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:50.196 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 1 --2- 10.20.193.90:0/100353593 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3c64077660 0x7f3c6419fbb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:50.196 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 1 -- 10.20.193.90:0/100353593 >> 10.20.193.90:0/100353593 conn(0x7f3c641002d0 msgr2=0x7f3c641105a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:50.197 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 1 -- 10.20.193.90:0/100353593 shutdown_connections 2026-02-17T12:05:50.197 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:50.195+0000 7f3c6be6c640 1 -- 10.20.193.90:0/100353593 wait complete. 2026-02-17T12:05:50.233 INFO:tasks.cephadm:Adding mon.a on trial090 2026-02-17T12:05:50.233 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph orch apply mon '1;trial090:10.20.193.90=a' 2026-02-17T12:05:50.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:50 trial090 ceph-mon[39228]: Added host trial198 2026-02-17T12:05:50.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:50 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:50.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:50 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:50.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:50 trial090 ceph-mon[39228]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T12:05:50.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:50 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/100353593' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-17T12:05:50.461 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T12:05:50.496 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T12:05:50.608 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 -- 10.20.193.198:0/1018011129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8cfc1045f0 msgr2=0x7f8cfc1049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:50.608 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 --2- 10.20.193.198:0/1018011129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8cfc1045f0 0x7f8cfc1049f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00099b0 tx=0x7f8cf002f2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:50.608 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 -- 10.20.193.198:0/1018011129 shutdown_connections 2026-02-17T12:05:50.608 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 --2- 10.20.193.198:0/1018011129 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8cfc1045f0 0x7f8cfc1049f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:50.608 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 -- 10.20.193.198:0/1018011129 >> 10.20.193.198:0/1018011129 conn(0x7f8cfc0ffdb0 msgr2=0x7f8cfc1021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:50.608 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 -- 10.20.193.198:0/1018011129 shutdown_connections 2026-02-17T12:05:50.608 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 -- 10.20.193.198:0/1018011129 wait complete. 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 Processor -- start 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 -- start start 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8cfc1045f0 0x7f8cfc19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.600+0000 7f8d0106b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc109a70 con 0x7f8cfc1045f0 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.601+0000 7f8cfad76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8cfc1045f0 0x7f8cfc19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.601+0000 7f8cfad76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8cfc1045f0 0x7f8cfc19b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.198:43010/0 (socket says 10.20.193.198:43010) 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.601+0000 7f8cfad76640 1 -- 10.20.193.198:0/1253299452 learned_addr learned my addr 10.20.193.198:0/1253299452 (peer_addr_for_me v2:10.20.193.198:0/0) 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.601+0000 7f8cfad76640 1 -- 10.20.193.198:0/1253299452 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc19b710 con 0x7f8cfc1045f0 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.601+0000 7f8cfad76640 1 --2- 10.20.193.198:0/1253299452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8cfc1045f0 0x7f8cfc19b1d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0005ec0 tx=0x7f8cf0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.601+0000 7f8cdbfff640 1 -- 10.20.193.198:0/1253299452 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf0038510 con 0x7f8cfc1045f0 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.602+0000 7f8d0106b640 1 -- 10.20.193.198:0/1253299452 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cfc19b9a0 con 0x7f8cfc1045f0 2026-02-17T12:05:50.609 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.602+0000 7f8d0106b640 1 -- 10.20.193.198:0/1253299452 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cfc19e690 con 0x7f8cfc1045f0 2026-02-17T12:05:50.610 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.602+0000 7f8cdbfff640 1 -- 10.20.193.198:0/1253299452 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8cf0046070 con 0x7f8cfc1045f0 2026-02-17T12:05:50.610 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.602+0000 7f8cdbfff640 1 -- 10.20.193.198:0/1253299452 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cf004b7c0 con 0x7f8cfc1045f0 2026-02-17T12:05:50.610 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.602+0000 7f8d0106b640 1 -- 10.20.193.198:0/1253299452 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cfc10a210 con 0x7f8cfc1045f0 2026-02-17T12:05:50.611 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.603+0000 7f8cdbfff640 1 -- 10.20.193.198:0/1253299452 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f8cf004b960 con 0x7f8cfc1045f0 2026-02-17T12:05:50.611 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.603+0000 7f8cdbfff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:05:50.611 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.603+0000 7f8cdbfff640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:05:50.611 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.603+0000 7f8cdbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:50.611 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.603+0000 7f8cdbfff640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:50.611 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.603+0000 7f8cdbfff640 1 --2- 10.20.193.198:0/1253299452 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8cd003dd30 0x7f8cd00401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:50.612 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.603+0000 7f8cdbfff640 1 -- 10.20.193.198:0/1253299452 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8cf0077610 con 0x7f8cfc1045f0 2026-02-17T12:05:50.612 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.603+0000 7f8cfa575640 1 --2- 10.20.193.198:0/1253299452 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8cd003dd30 0x7f8cd00401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:50.612 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.604+0000 7f8cfa575640 1 --2- 10.20.193.198:0/1253299452 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8cd003dd30 0x7f8cd00401f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40099c0 tx=0x7f8ce4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:50.612 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.605+0000 7f8cdbfff640 1 -- 10.20.193.198:0/1253299452 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8cf00048c0 con 0x7f8cfc1045f0 2026-02-17T12:05:50.697 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.692+0000 7f8d0106b640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial090:10.20.193.90=a", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:50.698 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.692+0000 7f8d0106b640 1 -- 10.20.193.198:0/1253299452 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "1;trial090:10.20.193.90=a", "target": ["mon-mgr", ""]}) -- 0x7f8cfc1947d0 con 0x7f8cd003dd30 2026-02-17T12:05:50.703 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.697+0000 7f8cdbfff640 1 -- 10.20.193.198:0/1253299452 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8cfc1947d0 con 0x7f8cd003dd30 2026-02-17T12:05:50.703 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.697+0000 7f8cdbfff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:50.704 INFO:teuthology.orchestra.run.trial198.stdout:Scheduled mon update... 2026-02-17T12:05:50.705 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.698+0000 7f8d0106b640 10 mgrc shutdown 2026-02-17T12:05:50.705 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.698+0000 7f8d0106b640 1 -- 10.20.193.198:0/1253299452 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8cd003dd30 msgr2=0x7f8cd00401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:50.705 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.698+0000 7f8d0106b640 1 --2- 10.20.193.198:0/1253299452 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8cd003dd30 0x7f8cd00401f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40099c0 tx=0x7f8ce4006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:50.705 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.698+0000 7f8d0106b640 1 -- 10.20.193.198:0/1253299452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8cfc1045f0 msgr2=0x7f8cfc19b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:50.705 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.698+0000 7f8d0106b640 1 --2- 10.20.193.198:0/1253299452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8cfc1045f0 0x7f8cfc19b1d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0005ec0 tx=0x7f8cf0004290 comp rx=0 tx=0).stop 2026-02-17T12:05:50.705 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.698+0000 7f8d0106b640 1 -- 10.20.193.198:0/1253299452 shutdown_connections 2026-02-17T12:05:50.705 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.698+0000 7f8d0106b640 1 --2- 10.20.193.198:0/1253299452 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8cd003dd30 0x7f8cd00401f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:50.705 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.698+0000 7f8d0106b640 1 --2- 10.20.193.198:0/1253299452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8cfc1045f0 0x7f8cfc19b1d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:50.705 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.698+0000 7f8d0106b640 1 -- 10.20.193.198:0/1253299452 >> 10.20.193.198:0/1253299452 conn(0x7f8cfc0ffdb0 msgr2=0x7f8cfc1003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:50.706 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.699+0000 7f8d0106b640 1 -- 10.20.193.198:0/1253299452 shutdown_connections 2026-02-17T12:05:50.706 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:50.699+0000 7f8d0106b640 1 -- 10.20.193.198:0/1253299452 wait complete. 2026-02-17T12:05:50.740 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2026-02-17T12:05:50.740 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T12:05:50.887 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T12:05:50.917 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T12:05:51.029 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 -- 10.20.193.198:0/1260978692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50ec104620 msgr2=0x7f50ec104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:51.029 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 --2- 10.20.193.198:0/1260978692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50ec104620 0x7f50ec104a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f50e00099b0 tx=0x7f50e002f2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.029 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 -- 10.20.193.198:0/1260978692 shutdown_connections 2026-02-17T12:05:51.029 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 --2- 10.20.193.198:0/1260978692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50ec104620 0x7f50ec104a20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.029 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 -- 10.20.193.198:0/1260978692 >> 10.20.193.198:0/1260978692 conn(0x7f50ec0ffdb0 msgr2=0x7f50ec1021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:51.030 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 -- 10.20.193.198:0/1260978692 shutdown_connections 2026-02-17T12:05:51.030 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 -- 10.20.193.198:0/1260978692 wait complete. 2026-02-17T12:05:51.030 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 Processor -- start 2026-02-17T12:05:51.030 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 -- start start 2026-02-17T12:05:51.030 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50ec104620 0x7f50ec19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:51.030 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50f175b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec109aa0 con 0x7f50ec104620 2026-02-17T12:05:51.030 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50eaffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50ec104620 0x7f50ec19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:51.030 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50eaffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50ec104620 0x7f50ec19b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.198:43026/0 (socket says 10.20.193.198:43026) 2026-02-17T12:05:51.030 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.021+0000 7f50eaffd640 1 -- 10.20.193.198:0/1251801726 learned_addr learned my addr 10.20.193.198:0/1251801726 (peer_addr_for_me v2:10.20.193.198:0/0) 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.022+0000 7f50eaffd640 1 -- 10.20.193.198:0/1251801726 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ec19b720 con 0x7f50ec104620 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.022+0000 7f50eaffd640 1 --2- 10.20.193.198:0/1251801726 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50ec104620 0x7f50ec19b1e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50e0005ec0 tx=0x7f50e0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.022+0000 7f50cbfff640 1 -- 10.20.193.198:0/1251801726 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e0038510 con 0x7f50ec104620 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.022+0000 7f50cbfff640 1 -- 10.20.193.198:0/1251801726 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f50e0046070 con 0x7f50ec104620 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.022+0000 7f50f175b640 1 -- 10.20.193.198:0/1251801726 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ec19b9b0 con 0x7f50ec104620 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.022+0000 7f50cbfff640 1 -- 10.20.193.198:0/1251801726 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e0041810 con 0x7f50ec104620 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.022+0000 7f50f175b640 1 -- 10.20.193.198:0/1251801726 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ec19e6a0 con 0x7f50ec104620 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.022+0000 7f50f175b640 1 -- 10.20.193.198:0/1251801726 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ec10a240 con 0x7f50ec104620 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.022+0000 7f50cbfff640 1 -- 10.20.193.198:0/1251801726 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f50e0041ac0 con 0x7f50ec104620 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.022+0000 7f50cbfff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.023+0000 7f50cbfff640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:05:51.031 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.023+0000 7f50cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:51.032 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.023+0000 7f50cbfff640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:51.032 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.023+0000 7f50cbfff640 1 --2- 10.20.193.198:0/1251801726 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f50c003dc90 0x7f50c0040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:51.032 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.023+0000 7f50cbfff640 1 -- 10.20.193.198:0/1251801726 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f50e00773c0 con 0x7f50ec104620 2026-02-17T12:05:51.032 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.023+0000 7f50ea7fc640 1 --2- 10.20.193.198:0/1251801726 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f50c003dc90 0x7f50c0040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:51.032 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.024+0000 7f50ea7fc640 1 --2- 10.20.193.198:0/1251801726 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f50c003dc90 0x7f50c0040150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f50d40099c0 tx=0x7f50d4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:51.033 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.025+0000 7f50cbfff640 1 -- 10.20.193.198:0/1251801726 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f50e0035e10 con 0x7f50ec104620 2026-02-17T12:05:51.147 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.141+0000 7f50f175b640 1 -- 10.20.193.198:0/1251801726 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f50ec194830 con 0x7f50ec104620 2026-02-17T12:05:51.147 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.141+0000 7f50cbfff640 1 -- 10.20.193.198:0/1251801726 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f50e0038d00 con 0x7f50ec104620 2026-02-17T12:05:51.148 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:05:51.148 INFO:teuthology.orchestra.run.trial198.stdout:{"epoch":1,"fsid":"ea07e39e-0bf8-11f1-bf0e-d404e6e7d460","modified":"2026-02-17T12:05:24.347025Z","created":"2026-02-17T12:05:24.347025Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:3300","nonce":0},{"type":"v1","addr":"10.20.193.90:6789","nonce":0}]},"addr":"10.20.193.90:6789/0","public_addr":"10.20.193.90:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T12:05:51.149 INFO:teuthology.orchestra.run.trial198.stderr:dumped monmap epoch 1 2026-02-17T12:05:51.149 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 10 mgrc shutdown 2026-02-17T12:05:51.149 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 1 -- 10.20.193.198:0/1251801726 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f50c003dc90 msgr2=0x7f50c0040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:51.149 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 1 --2- 10.20.193.198:0/1251801726 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f50c003dc90 0x7f50c0040150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f50d40099c0 tx=0x7f50d4006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.149 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 1 -- 10.20.193.198:0/1251801726 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50ec104620 msgr2=0x7f50ec19b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:51.149 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 1 --2- 10.20.193.198:0/1251801726 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50ec104620 0x7f50ec19b1e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f50e0005ec0 tx=0x7f50e0004290 comp rx=0 tx=0).stop 2026-02-17T12:05:51.150 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 1 -- 10.20.193.198:0/1251801726 shutdown_connections 2026-02-17T12:05:51.150 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 1 --2- 10.20.193.198:0/1251801726 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f50c003dc90 0x7f50c0040150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.150 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 1 --2- 10.20.193.198:0/1251801726 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f50ec104620 0x7f50ec19b1e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.150 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 1 -- 10.20.193.198:0/1251801726 >> 10.20.193.198:0/1251801726 conn(0x7f50ec0ffdb0 msgr2=0x7f50ec100400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:51.150 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 1 -- 10.20.193.198:0/1251801726 shutdown_connections 2026-02-17T12:05:51.150 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:51.142+0000 7f50f175b640 1 -- 10.20.193.198:0/1251801726 wait complete. 2026-02-17T12:05:51.185 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-17T12:05:51.186 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-17T12:05:51.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: mgrmap e13: a(active, since 6s) 2026-02-17T12:05:51.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:51.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/100353593' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-17T12:05:51.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: osdmap e4: 0 total, 0 up, 0 in 2026-02-17T12:05:51.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:51.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:51.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:51.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:51.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:51.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd/host:trial198", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:05:51.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:05:51.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:51 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:05:51.336 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.449+0000 7fabcd02e640 1 -- 10.20.193.90:0/379606008 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fabc810a650 msgr2=0x7fabc810aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.449+0000 7fabcd02e640 1 --2- 10.20.193.90:0/379606008 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fabc810a650 0x7fabc810aa30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0099b0 tx=0x7fabbc02f2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.449+0000 7fabcd02e640 1 -- 10.20.193.90:0/379606008 shutdown_connections 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.449+0000 7fabcd02e640 1 --2- 10.20.193.90:0/379606008 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fabc810a650 0x7fabc810aa30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.449+0000 7fabcd02e640 1 -- 10.20.193.90:0/379606008 >> 10.20.193.90:0/379606008 conn(0x7fabc81002a0 msgr2=0x7fabc81026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.449+0000 7fabcd02e640 1 -- 10.20.193.90:0/379606008 shutdown_connections 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.449+0000 7fabcd02e640 1 -- 10.20.193.90:0/379606008 wait complete. 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7fabcd02e640 1 Processor -- start 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7fabcd02e640 1 -- start start 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7fabcd02e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fabc810a650 0x7fabc819b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7fabcd02e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fabc810dfd0 con 0x7fabc810a650 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7fabc6d76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fabc810a650 0x7fabc819b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7fabc6d76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fabc810a650 0x7fabc819b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57186/0 (socket says 10.20.193.90:57186) 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7fabc6d76640 1 -- 10.20.193.90:0/3062219653 learned_addr learned my addr 10.20.193.90:0/3062219653 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7fabc6d76640 1 -- 10.20.193.90:0/3062219653 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc819ba70 con 0x7fabc810a650 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7fabc6d76640 1 --2- 10.20.193.90:0/3062219653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fabc810a650 0x7fabc819b530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fabbc004290 tx=0x7fabbc0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7faba7fff640 1 -- 10.20.193.90:0/3062219653 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabbc038510 con 0x7fabc810a650 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7faba7fff640 1 -- 10.20.193.90:0/3062219653 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fabbc046070 con 0x7fabc810a650 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7fabcd02e640 1 -- 10.20.193.90:0/3062219653 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc819bd00 con 0x7fabc810a650 2026-02-17T12:05:51.451 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.450+0000 7faba7fff640 1 -- 10.20.193.90:0/3062219653 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabbc041610 con 0x7fabc810a650 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7fabcd02e640 1 -- 10.20.193.90:0/3062219653 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc819fe00 con 0x7fabc810a650 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7fabcd02e640 1 -- 10.20.193.90:0/3062219653 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc8105d00 con 0x7fabc810a650 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7faba7fff640 1 -- 10.20.193.90:0/3062219653 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fabbc0418c0 con 0x7fabc810a650 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7faba7fff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7faba7fff640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7faba7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7faba7fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7faba7fff640 1 --2- 10.20.193.90:0/3062219653 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fab9c03dce0 0x7fab9c0401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7faba7fff640 1 -- 10.20.193.90:0/3062219653 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fabbc077070 con 0x7fabc810a650 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7fabc6575640 1 --2- 10.20.193.90:0/3062219653 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fab9c03dce0 0x7fab9c0401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:51.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.451+0000 7fabc6575640 1 --2- 10.20.193.90:0/3062219653 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fab9c03dce0 0x7fab9c0401a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fabb00099c0 tx=0x7fabb0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:51.454 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.454+0000 7faba7fff640 1 -- 10.20.193.90:0/3062219653 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fabbc035320 con 0x7fabc810a650 2026-02-17T12:05:51.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.536+0000 7fabcd02e640 1 -- 10.20.193.90:0/3062219653 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fabc810aab0 con 0x7fabc810a650 2026-02-17T12:05:51.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.537+0000 7faba7fff640 1 -- 10.20.193.90:0/3062219653 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+175 (secure 0 0 0) 0x7fabbc040360 con 0x7fabc810a650 2026-02-17T12:05:51.538 INFO:teuthology.orchestra.run.trial090.stdout:# minimal ceph.conf for ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:51.538 INFO:teuthology.orchestra.run.trial090.stdout:[global] 2026-02-17T12:05:51.538 INFO:teuthology.orchestra.run.trial090.stdout: fsid = ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 2026-02-17T12:05:51.538 INFO:teuthology.orchestra.run.trial090.stdout: mon_host = [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 10 mgrc shutdown 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 1 -- 10.20.193.90:0/3062219653 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fab9c03dce0 msgr2=0x7fab9c0401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 1 --2- 10.20.193.90:0/3062219653 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fab9c03dce0 0x7fab9c0401a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fabb00099c0 tx=0x7fabb0006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 1 -- 10.20.193.90:0/3062219653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fabc810a650 msgr2=0x7fabc819b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 1 --2- 10.20.193.90:0/3062219653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fabc810a650 0x7fabc819b530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fabbc004290 tx=0x7fabbc0042c0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 1 -- 10.20.193.90:0/3062219653 shutdown_connections 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 1 --2- 10.20.193.90:0/3062219653 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fab9c03dce0 0x7fab9c0401a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 1 --2- 10.20.193.90:0/3062219653 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fabc810a650 0x7fabc819b530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 1 -- 10.20.193.90:0/3062219653 >> 10.20.193.90:0/3062219653 conn(0x7fabc81002a0 msgr2=0x7fabc8109800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 1 -- 10.20.193.90:0/3062219653 shutdown_connections 2026-02-17T12:05:51.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:51.538+0000 7fabcd02e640 1 -- 10.20.193.90:0/3062219653 wait complete. 2026-02-17T12:05:51.608 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-17T12:05:51.609 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:51.609 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.conf 2026-02-17T12:05:51.633 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:51.633 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T12:05:51.697 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:05:51.697 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/ceph/ceph.conf 2026-02-17T12:05:51.723 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:05:51.723 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T12:05:51.786 INFO:tasks.cephadm:Adding mgr.a on trial090 2026-02-17T12:05:51.786 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph orch apply mgr '1;trial090=a' 2026-02-17T12:05:51.968 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/config/ceph.conf 2026-02-17T12:05:52.075 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.067+0000 7f885d827640 1 -- 10.20.193.198:0/533841078 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88580770e0 msgr2=0x7f8858075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:52.075 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.067+0000 7f885d827640 1 --2- 10.20.193.198:0/533841078 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88580770e0 0x7f8858075540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88480099b0 tx=0x7f884802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:52.075 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.067+0000 7f885d827640 1 -- 10.20.193.198:0/533841078 shutdown_connections 2026-02-17T12:05:52.075 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.067+0000 7f885d827640 1 --2- 10.20.193.198:0/533841078 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88580770e0 0x7f8858075540 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:52.075 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.067+0000 7f885d827640 1 -- 10.20.193.198:0/533841078 >> 10.20.193.198:0/533841078 conn(0x7f88580fd930 msgr2=0x7f88580ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:52.075 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.067+0000 7f885d827640 1 -- 10.20.193.198:0/533841078 shutdown_connections 2026-02-17T12:05:52.075 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.067+0000 7f885d827640 1 -- 10.20.193.198:0/533841078 wait complete. 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.067+0000 7f885d827640 1 Processor -- start 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.067+0000 7f885d827640 1 -- start start 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f885d827640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88580770e0 0x7f885819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f885d827640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8858105370 con 0x7f88580770e0 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f885c825640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88580770e0 0x7f885819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f885c825640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88580770e0 0x7f885819f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.198:43038/0 (socket says 10.20.193.198:43038) 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f885c825640 1 -- 10.20.193.198:0/2072552058 learned_addr learned my addr 10.20.193.198:0/2072552058 (peer_addr_for_me v2:10.20.193.198:0/0) 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f885c825640 1 -- 10.20.193.198:0/2072552058 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885819fa60 con 0x7f88580770e0 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f885c825640 1 --2- 10.20.193.198:0/2072552058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88580770e0 0x7f885819f520 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f884802f860 tx=0x7f8848004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f884dffb640 1 -- 10.20.193.198:0/2072552058 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8848038510 con 0x7f88580770e0 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f884dffb640 1 -- 10.20.193.198:0/2072552058 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8848046070 con 0x7f88580770e0 2026-02-17T12:05:52.076 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f885d827640 1 -- 10.20.193.198:0/2072552058 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885819fcf0 con 0x7f88580770e0 2026-02-17T12:05:52.077 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f885d827640 1 -- 10.20.193.198:0/2072552058 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88581a29e0 con 0x7f88580770e0 2026-02-17T12:05:52.077 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.068+0000 7f884dffb640 1 -- 10.20.193.198:0/2072552058 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8848041640 con 0x7f88580770e0 2026-02-17T12:05:52.077 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.069+0000 7f885d827640 1 -- 10.20.193.198:0/2072552058 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8858105b10 con 0x7f88580770e0 2026-02-17T12:05:52.078 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.069+0000 7f884dffb640 1 -- 10.20.193.198:0/2072552058 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f88480386b0 con 0x7f88580770e0 2026-02-17T12:05:52.078 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.069+0000 7f884dffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:05:52.078 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.069+0000 7f884dffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:05:52.078 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.069+0000 7f884dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:52.079 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.069+0000 7f884dffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:52.079 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.069+0000 7f884dffb640 1 --2- 10.20.193.198:0/2072552058 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f883403dc90 0x7f8834040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:52.079 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.069+0000 7f884dffb640 1 -- 10.20.193.198:0/2072552058 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8848077920 con 0x7f88580770e0 2026-02-17T12:05:52.079 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.070+0000 7f884ffff640 1 --2- 10.20.193.198:0/2072552058 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f883403dc90 0x7f8834040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:52.079 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.070+0000 7f884ffff640 1 --2- 10.20.193.198:0/2072552058 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f883403dc90 0x7f8834040150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f88400099c0 tx=0x7f8840006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:52.079 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.072+0000 7f884dffb640 1 -- 10.20.193.198:0/2072552058 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8848038d20 con 0x7f88580770e0 2026-02-17T12:05:52.167 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.161+0000 7f885d827640 20 mgrc start_command cmd: [{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial090=a", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:52.167 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.161+0000 7f885d827640 1 -- 10.20.193.198:0/2072552058 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial090=a", "target": ["mon-mgr", ""]}) -- 0x7f8858198b80 con 0x7f883403dc90 2026-02-17T12:05:52.170 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.165+0000 7f884dffb640 1 -- 10.20.193.198:0/2072552058 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8858198b80 con 0x7f883403dc90 2026-02-17T12:05:52.170 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.165+0000 7f884dffb640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:05:52.171 INFO:teuthology.orchestra.run.trial198.stdout:Scheduled mgr update... 2026-02-17T12:05:52.171 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 10 mgrc shutdown 2026-02-17T12:05:52.171 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 1 -- 10.20.193.198:0/2072552058 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f883403dc90 msgr2=0x7f8834040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:52.171 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 1 --2- 10.20.193.198:0/2072552058 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f883403dc90 0x7f8834040150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f88400099c0 tx=0x7f8840006eb0 comp rx=0 tx=0).stop 2026-02-17T12:05:52.171 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 1 -- 10.20.193.198:0/2072552058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88580770e0 msgr2=0x7f885819f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:52.171 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 1 --2- 10.20.193.198:0/2072552058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88580770e0 0x7f885819f520 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f884802f860 tx=0x7f8848004290 comp rx=0 tx=0).stop 2026-02-17T12:05:52.171 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 1 -- 10.20.193.198:0/2072552058 shutdown_connections 2026-02-17T12:05:52.172 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 1 --2- 10.20.193.198:0/2072552058 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f883403dc90 0x7f8834040150 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:52.172 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 1 --2- 10.20.193.198:0/2072552058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88580770e0 0x7f885819f520 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:52.172 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 1 -- 10.20.193.198:0/2072552058 >> 10.20.193.198:0/2072552058 conn(0x7f88580fd930 msgr2=0x7f88580fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:52.172 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 1 -- 10.20.193.198:0/2072552058 shutdown_connections 2026-02-17T12:05:52.172 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:05:52.166+0000 7f885d827640 1 -- 10.20.193.198:0/2072552058 wait complete. 2026-02-17T12:05:52.207 INFO:tasks.cephadm:Deploying OSDs... 2026-02-17T12:05:52.208 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:05:52.208 DEBUG:teuthology.orchestra.run.trial090:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T12:05:52.224 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T12:05:52.224 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_1 2026-02-17T12:05:52.281 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T12:05:52.281 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:05:52.281 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1315 Links: 1 2026-02-17T12:05:52.282 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:05:52.282 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:05:52.282 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-17 12:05:46.119069684 +0000 2026-02-17T12:05:52.282 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-17 12:04:08.933381739 +0000 2026-02-17T12:05:52.282 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-17 12:04:08.933381739 +0000 2026-02-17T12:05:52.282 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-17 12:04:08.933381739 +0000 2026-02-17T12:05:52.282 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T12:05:52.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;trial090:10.20.193.90=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: Saving service mon spec with placement trial090:10.20.193.90=a;count:1 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: Updating trial198:/etc/ceph/ceph.conf 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: Updating trial198:/var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/config/ceph.conf 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: Updating trial198:/etc/ceph/ceph.client.admin.keyring 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='client.? 10.20.193.198:0/1251801726' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: Updating trial198:/var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.330 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: Reconfiguring mon.a (unknown last config time)... 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: Reconfiguring daemon mon.a on trial090 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3062219653' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:52.331 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:05:52.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:05:52.332 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:52 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:52.344 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-17T12:05:52.344 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-17T12:05:52.344 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000178541 s, 2.9 MB/s 2026-02-17T12:05:52.345 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T12:05:52.404 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_2 2026-02-17T12:05:52.462 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T12:05:52.462 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:05:52.462 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-17T12:05:52.462 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:05:52.462 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:05:52.462 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-17 12:05:46.119069684 +0000 2026-02-17T12:05:52.462 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-17 12:04:08.932381757 +0000 2026-02-17T12:05:52.463 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-17 12:04:08.932381757 +0000 2026-02-17T12:05:52.463 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-17 12:04:08.932381757 +0000 2026-02-17T12:05:52.463 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T12:05:52.525 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-17T12:05:52.525 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-17T12:05:52.526 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.00013964 s, 3.7 MB/s 2026-02-17T12:05:52.527 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T12:05:52.584 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_3 2026-02-17T12:05:52.640 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T12:05:52.641 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:05:52.641 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-17T12:05:52.641 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:05:52.641 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:05:52.641 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-17 12:05:46.119069684 +0000 2026-02-17T12:05:52.641 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-17 12:04:08.932381757 +0000 2026-02-17T12:05:52.641 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-17 12:04:08.932381757 +0000 2026-02-17T12:05:52.641 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-17 12:04:08.932381757 +0000 2026-02-17T12:05:52.642 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T12:05:52.703 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-17T12:05:52.704 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-17T12:05:52.704 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000225378 s, 2.3 MB/s 2026-02-17T12:05:52.705 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T12:05:52.762 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_4 2026-02-17T12:05:52.818 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T12:05:52.818 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:05:52.819 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-17T12:05:52.819 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:05:52.819 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:05:52.819 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-17 12:05:46.119069684 +0000 2026-02-17T12:05:52.819 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-17 12:04:08.933381739 +0000 2026-02-17T12:05:52.819 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-17 12:04:08.933381739 +0000 2026-02-17T12:05:52.819 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-17 12:04:08.933381739 +0000 2026-02-17T12:05:52.819 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T12:05:52.881 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-17T12:05:52.881 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-17T12:05:52.882 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000216903 s, 2.4 MB/s 2026-02-17T12:05:52.883 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T12:05:52.940 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:05:52.940 DEBUG:teuthology.orchestra.run.trial198:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T12:05:52.959 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T12:05:52.959 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_1 2026-02-17T12:05:53.017 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T12:05:53.017 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:05:53.017 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-17T12:05:53.018 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:05:53.018 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:05:53.018 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-17 12:05:50.689871303 +0000 2026-02-17T12:05:53.018 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-17 12:04:07.004802579 +0000 2026-02-17T12:05:53.018 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-17 12:04:07.004802579 +0000 2026-02-17T12:05:53.018 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-17 12:04:07.004802579 +0000 2026-02-17T12:05:53.018 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T12:05:53.081 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-17T12:05:53.082 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-17T12:05:53.082 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000166109 s, 3.1 MB/s 2026-02-17T12:05:53.083 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T12:05:53.140 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_2 2026-02-17T12:05:53.196 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T12:05:53.196 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:05:53.196 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-17T12:05:53.196 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:05:53.196 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:05:53.196 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-17 12:05:50.689871303 +0000 2026-02-17T12:05:53.197 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-17 12:04:07.004802579 +0000 2026-02-17T12:05:53.197 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-17 12:04:07.004802579 +0000 2026-02-17T12:05:53.197 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-17 12:04:07.004802579 +0000 2026-02-17T12:05:53.197 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T12:05:53.259 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-17T12:05:53.259 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-17T12:05:53.260 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000135432 s, 3.8 MB/s 2026-02-17T12:05:53.261 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T12:05:53.318 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_3 2026-02-17T12:05:53.374 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T12:05:53.374 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:05:53.374 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-17T12:05:53.374 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:05:53.374 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:05:53.374 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-17 12:05:50.689871303 +0000 2026-02-17T12:05:53.374 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-17 12:04:07.004802579 +0000 2026-02-17T12:05:53.374 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-17 12:04:07.004802579 +0000 2026-02-17T12:05:53.374 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-17 12:04:07.004802579 +0000 2026-02-17T12:05:53.374 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T12:05:53.436 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-17T12:05:53.436 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-17T12:05:53.436 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000154788 s, 3.3 MB/s 2026-02-17T12:05:53.438 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T12:05:53.495 DEBUG:teuthology.orchestra.run.trial198:> stat /dev/vg_nvme/lv_4 2026-02-17T12:05:53.551 INFO:teuthology.orchestra.run.trial198.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T12:05:53.551 INFO:teuthology.orchestra.run.trial198.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:05:53.551 INFO:teuthology.orchestra.run.trial198.stdout:Device: 6h/6d Inode: 1288 Links: 1 2026-02-17T12:05:53.551 INFO:teuthology.orchestra.run.trial198.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:05:53.552 INFO:teuthology.orchestra.run.trial198.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:05:53.552 INFO:teuthology.orchestra.run.trial198.stdout:Access: 2026-02-17 12:05:50.689871303 +0000 2026-02-17T12:05:53.552 INFO:teuthology.orchestra.run.trial198.stdout:Modify: 2026-02-17 12:04:07.003802597 +0000 2026-02-17T12:05:53.552 INFO:teuthology.orchestra.run.trial198.stdout:Change: 2026-02-17 12:04:07.003802597 +0000 2026-02-17T12:05:53.552 INFO:teuthology.orchestra.run.trial198.stdout: Birth: 2026-02-17 12:04:07.003802597 +0000 2026-02-17T12:05:53.552 DEBUG:teuthology.orchestra.run.trial198:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T12:05:53.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;trial090=a", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:53.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: Saving service mgr spec with placement trial090=a;count:1 2026-02-17T12:05:53.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:53.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:05:53.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:05:53.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:05:53.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:53.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:53.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: Reconfiguring mgr.a (unknown last config time)... 2026-02-17T12:05:53.581 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.a", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T12:05:53.581 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T12:05:53.581 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:05:53.581 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: Reconfiguring daemon mgr.a on trial090 2026-02-17T12:05:53.581 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:53.581 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:53 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:05:53.614 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records in 2026-02-17T12:05:53.615 INFO:teuthology.orchestra.run.trial198.stderr:1+0 records out 2026-02-17T12:05:53.615 INFO:teuthology.orchestra.run.trial198.stderr:512 bytes copied, 0.000149318 s, 3.4 MB/s 2026-02-17T12:05:53.616 DEBUG:teuthology.orchestra.run.trial198:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T12:05:53.674 INFO:tasks.cephadm:Deploying osd.0 on trial090 with /dev/vg_nvme/lv_4... 2026-02-17T12:05:53.674 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-17T12:05:53.822 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:05:54.595 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:05:54.612 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_4 2026-02-17T12:05:54.764 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:05:54.879 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.875+0000 7f85eb636640 1 -- 10.20.193.90:0/1854995183 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f85e4102290 msgr2=0x7f85e4102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:05:54.880 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.875+0000 7f85eb636640 1 --2- 10.20.193.90:0/1854995183 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f85e4102290 0x7f85e4102690 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0099b0 tx=0x7f85dc02f2b0 comp rx=0 tx=0).stop 2026-02-17T12:05:54.880 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.875+0000 7f85eb636640 1 -- 10.20.193.90:0/1854995183 shutdown_connections 2026-02-17T12:05:54.880 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.875+0000 7f85eb636640 1 --2- 10.20.193.90:0/1854995183 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f85e4102290 0x7f85e4102690 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:05:54.880 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.875+0000 7f85eb636640 1 -- 10.20.193.90:0/1854995183 >> 10.20.193.90:0/1854995183 conn(0x7f85e40fda00 msgr2=0x7f85e40ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:05:54.880 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.875+0000 7f85eb636640 1 -- 10.20.193.90:0/1854995183 shutdown_connections 2026-02-17T12:05:54.881 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.875+0000 7f85eb636640 1 -- 10.20.193.90:0/1854995183 wait complete. 2026-02-17T12:05:54.881 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85eb636640 1 Processor -- start 2026-02-17T12:05:54.881 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85eb636640 1 -- start start 2026-02-17T12:05:54.881 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85eb636640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f85e4102290 0x7f85e4198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:54.881 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85eb636640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85e4107710 con 0x7f85e4102290 2026-02-17T12:05:54.881 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85ea634640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f85e4102290 0x7f85e4198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:54.881 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85ea634640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f85e4102290 0x7f85e4198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41458/0 (socket says 10.20.193.90:41458) 2026-02-17T12:05:54.881 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85ea634640 1 -- 10.20.193.90:0/3279259184 learned_addr learned my addr 10.20.193.90:0/3279259184 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:05:54.882 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85ea634640 1 -- 10.20.193.90:0/3279259184 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e4199430 con 0x7f85e4102290 2026-02-17T12:05:54.882 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85ea634640 1 --2- 10.20.193.90:0/3279259184 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f85e4102290 0x7f85e4198ef0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85dc005ec0 tx=0x7f85dc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:54.882 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85cf7fe640 1 -- 10.20.193.90:0/3279259184 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85dc038510 con 0x7f85e4102290 2026-02-17T12:05:54.882 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85cf7fe640 1 -- 10.20.193.90:0/3279259184 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f85dc046070 con 0x7f85e4102290 2026-02-17T12:05:54.882 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85eb636640 1 -- 10.20.193.90:0/3279259184 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e41996c0 con 0x7f85e4102290 2026-02-17T12:05:54.882 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85cf7fe640 1 -- 10.20.193.90:0/3279259184 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85dc041810 con 0x7f85e4102290 2026-02-17T12:05:54.882 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.876+0000 7f85eb636640 1 -- 10.20.193.90:0/3279259184 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e419c3b0 con 0x7f85e4102290 2026-02-17T12:05:54.882 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.877+0000 7f85eb636640 1 -- 10.20.193.90:0/3279259184 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e4107eb0 con 0x7f85e4102290 2026-02-17T12:05:54.883 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.877+0000 7f85cf7fe640 1 -- 10.20.193.90:0/3279259184 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f85dc0386b0 con 0x7f85e4102290 2026-02-17T12:05:54.883 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.877+0000 7f85cf7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:05:54.883 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.877+0000 7f85cf7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:05:54.883 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.877+0000 7f85cf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:54.883 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.877+0000 7f85cf7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:05:54.883 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.877+0000 7f85cf7fe640 1 --2- 10.20.193.90:0/3279259184 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f85c003dce0 0x7f85c00401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:05:54.883 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.877+0000 7f85cf7fe640 1 -- 10.20.193.90:0/3279259184 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f85dc077070 con 0x7f85e4102290 2026-02-17T12:05:54.884 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.877+0000 7f85e9e33640 1 --2- 10.20.193.90:0/3279259184 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f85c003dce0 0x7f85c00401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:05:54.884 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.877+0000 7f85e9e33640 1 --2- 10.20.193.90:0/3279259184 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f85c003dce0 0x7f85c00401a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85d00099c0 tx=0x7f85d0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:05:54.884 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.880+0000 7f85cf7fe640 1 -- 10.20.193.90:0/3279259184 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f85dc0389d0 con 0x7f85e4102290 2026-02-17T12:05:54.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.967+0000 7f85eb636640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}] 2026-02-17T12:05:54.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:05:54.967+0000 7f85eb636640 1 -- 10.20.193.90:0/3279259184 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f85e41924e0 con 0x7f85c003dce0 2026-02-17T12:05:55.079 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:55 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T12:05:55.080 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:55 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T12:05:55.080 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:55 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:05:56.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:56 trial090 ceph-mon[39228]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:05:56.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:56 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/4149440509' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "909678ba-587a-477a-b1a4-beaa075742ec"}]: dispatch 2026-02-17T12:05:56.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:56 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/4149440509' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "909678ba-587a-477a-b1a4-beaa075742ec"}]': finished 2026-02-17T12:05:56.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:56 trial090 ceph-mon[39228]: osdmap e5: 1 total, 0 up, 1 in 2026-02-17T12:05:56.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:56 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:05:56.329 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:05:56 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/1409325018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T12:06:00.250 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:00 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-17T12:06:00.250 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:00 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:01.352 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:01 trial090 ceph-mon[39228]: Deploying daemon osd.0 on trial090 2026-02-17T12:06:02.363 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:02 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:06:02.363 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:02 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:02.363 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:02 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:02.990 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 0 on host 'trial090' 2026-02-17T12:06:02.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.989+0000 7f85cf7fe640 1 -- 10.20.193.90:0/3279259184 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f85e41924e0 con 0x7f85c003dce0 2026-02-17T12:06:02.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.989+0000 7f85cf7fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:06:02.992 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 10 mgrc shutdown 2026-02-17T12:06:02.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 1 -- 10.20.193.90:0/3279259184 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f85c003dce0 msgr2=0x7f85c00401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:02.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 1 --2- 10.20.193.90:0/3279259184 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f85c003dce0 0x7f85c00401a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85d00099c0 tx=0x7f85d0006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:02.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 1 -- 10.20.193.90:0/3279259184 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f85e4102290 msgr2=0x7f85e4198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:02.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 1 --2- 10.20.193.90:0/3279259184 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f85e4102290 0x7f85e4198ef0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85dc005ec0 tx=0x7f85dc004290 comp rx=0 tx=0).stop 2026-02-17T12:06:02.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 1 -- 10.20.193.90:0/3279259184 shutdown_connections 2026-02-17T12:06:02.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 1 --2- 10.20.193.90:0/3279259184 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f85c003dce0 0x7f85c00401a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:02.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 1 --2- 10.20.193.90:0/3279259184 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f85e4102290 0x7f85e4198ef0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:02.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 1 -- 10.20.193.90:0/3279259184 >> 10.20.193.90:0/3279259184 conn(0x7f85e40fda00 msgr2=0x7f85e40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:02.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 1 -- 10.20.193.90:0/3279259184 shutdown_connections 2026-02-17T12:06:02.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:02.991+0000 7f85eb636640 1 -- 10.20.193.90:0/3279259184 wait complete. 2026-02-17T12:06:03.028 DEBUG:teuthology.orchestra.run.trial090:osd.0> sudo journalctl -f -n 0 -u ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@osd.0.service 2026-02-17T12:06:03.031 INFO:tasks.cephadm:Deploying osd.1 on trial090 with /dev/vg_nvme/lv_3... 2026-02-17T12:06:03.031 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-17T12:06:03.237 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:03.579 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:03 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:03.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:03 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:03.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:03 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:03.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:03 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:06:03.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:03 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:03.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:03 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:06:03.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:03 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:03.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:03 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:03.964 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:03 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-0[51039]: 2026-02-17T12:06:03.889+0000 7f4989f05740 -1 Falling back to public interface 2026-02-17T12:06:04.359 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:04.376 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_3 2026-02-17T12:06:04.529 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:04.572 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:04 trial090 ceph-mon[39228]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T12:06:04.572 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:04 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:04.572 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:04 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:04.572 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:04 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:06:04.572 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:04 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:04.573 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:04 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:04.573 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:04 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:06:04.573 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:04 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:04.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 -- 10.20.193.90:0/3051328412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8dc104710 msgr2=0x7fe8dc104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:04.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 --2- 10.20.193.90:0/3051328412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8dc104710 0x7fe8dc104b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00099b0 tx=0x7fe8d002f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:04.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 -- 10.20.193.90:0/3051328412 shutdown_connections 2026-02-17T12:06:04.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 --2- 10.20.193.90:0/3051328412 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8dc104710 0x7fe8dc104b10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:04.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 -- 10.20.193.90:0/3051328412 >> 10.20.193.90:0/3051328412 conn(0x7fe8dc0ffea0 msgr2=0x7fe8dc1022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:04.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 -- 10.20.193.90:0/3051328412 shutdown_connections 2026-02-17T12:06:04.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 -- 10.20.193.90:0/3051328412 wait complete. 2026-02-17T12:06:04.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 Processor -- start 2026-02-17T12:06:04.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 -- start start 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8dc104710 0x7fe8dc19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8e1188640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc109b90 con 0x7fe8dc104710 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.632+0000 7fe8dad76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8dc104710 0x7fe8dc19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8dad76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8dc104710 0x7fe8dc19b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:35788/0 (socket says 10.20.193.90:35788) 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8dad76640 1 -- 10.20.193.90:0/3875897092 learned_addr learned my addr 10.20.193.90:0/3875897092 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8dad76640 1 -- 10.20.193.90:0/3875897092 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc19b830 con 0x7fe8dc104710 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8dad76640 1 --2- 10.20.193.90:0/3875897092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8dc104710 0x7fe8dc19b2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0005ec0 tx=0x7fe8d0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8bbfff640 1 -- 10.20.193.90:0/3875897092 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d0038510 con 0x7fe8dc104710 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8bbfff640 1 -- 10.20.193.90:0/3875897092 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fe8d0046070 con 0x7fe8dc104710 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8e1188640 1 -- 10.20.193.90:0/3875897092 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc19bac0 con 0x7fe8dc104710 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8bbfff640 1 -- 10.20.193.90:0/3875897092 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d0041810 con 0x7fe8dc104710 2026-02-17T12:06:04.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8e1188640 1 -- 10.20.193.90:0/3875897092 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc19e7b0 con 0x7fe8dc104710 2026-02-17T12:06:04.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8e1188640 1 -- 10.20.193.90:0/3875897092 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc19bfa0 con 0x7fe8dc104710 2026-02-17T12:06:04.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8bbfff640 1 -- 10.20.193.90:0/3875897092 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fe8d00419b0 con 0x7fe8dc104710 2026-02-17T12:06:04.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.633+0000 7fe8bbfff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:04.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.634+0000 7fe8bbfff640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:04.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.634+0000 7fe8bbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:04.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.634+0000 7fe8bbfff640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:04.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.634+0000 7fe8bbfff640 1 --2- 10.20.193.90:0/3875897092 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8b003dce0 0x7fe8b00401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:04.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.634+0000 7fe8bbfff640 1 -- 10.20.193.90:0/3875897092 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1270+0+0 (secure 0 0 0) 0x7fe8d00771f0 con 0x7fe8dc104710 2026-02-17T12:06:04.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.634+0000 7fe8da575640 1 --2- 10.20.193.90:0/3875897092 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8b003dce0 0x7fe8b00401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:04.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.634+0000 7fe8da575640 1 --2- 10.20.193.90:0/3875897092 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8b003dce0 0x7fe8b00401a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40099c0 tx=0x7fe8c4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:04.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.636+0000 7fe8bbfff640 1 -- 10.20.193.90:0/3875897092 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe8dc19bfa0 con 0x7fe8dc104710 2026-02-17T12:06:04.726 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.725+0000 7fe8e1188640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}] 2026-02-17T12:06:04.726 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:04.725+0000 7fe8e1188640 1 -- 10.20.193.90:0/3875897092 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe8dc194a50 con 0x7fe8b003dce0 2026-02-17T12:06:05.499 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:05 trial090 ceph-mon[39228]: Detected new or changed devices on trial090 2026-02-17T12:06:05.499 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:05 trial090 ceph-mon[39228]: Adjusting osd_memory_target on trial090 to 84047M 2026-02-17T12:06:05.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:05 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T12:06:05.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:05 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T12:06:05.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:05 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:05.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:05 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3927791210' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49398bfe-ec6a-46b3-af4b-ca2939b00b7b"}]: dispatch 2026-02-17T12:06:05.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:05 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3927791210' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49398bfe-ec6a-46b3-af4b-ca2939b00b7b"}]': finished 2026-02-17T12:06:05.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:05 trial090 ceph-mon[39228]: osdmap e6: 2 total, 0 up, 2 in 2026-02-17T12:06:05.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:05 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:06:05.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:05 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:06:06.732 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:06 trial090 ceph-mon[39228]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:06:06.733 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:06 trial090 ceph-mon[39228]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T12:06:06.733 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:06 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3866450832' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T12:06:08.079 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:07 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-0[51039]: 2026-02-17T12:06:07.708+0000 7f4989f05740 -1 osd.0 0 log_to_monitors true 2026-02-17T12:06:08.829 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:08 trial090 ceph-mon[39228]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T12:06:08.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:08 trial090 ceph-mon[39228]: from='osd.0 [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-17T12:06:09.678 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:09 trial090 ceph-mon[39228]: from='osd.0 [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-17T12:06:09.678 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:09 trial090 ceph-mon[39228]: osdmap e7: 2 total, 0 up, 2 in 2026-02-17T12:06:09.678 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:09 trial090 ceph-mon[39228]: from='osd.0 [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial090", "root=default"]}]: dispatch 2026-02-17T12:06:09.678 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:09 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:06:09.678 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:09 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:06:09.678 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:09 trial090 ceph-mon[39228]: from='osd.0 [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-17T12:06:09.678 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:09 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-0[51039]: 2026-02-17T12:06:09.425+0000 7f4985e86640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T12:06:09.678 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:09 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-0[51039]: 2026-02-17T12:06:09.428+0000 7f4981cb0640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:06:10.479 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:10 trial090 ceph-mon[39228]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T12:06:10.479 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:10 trial090 ceph-mon[39228]: osdmap e8: 2 total, 0 up, 2 in 2026-02-17T12:06:10.479 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:10 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:06:10.480 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:10 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:06:10.480 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:10 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:06:11.579 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:11 trial090 ceph-mon[39228]: purged_snaps scrub starts 2026-02-17T12:06:11.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:11 trial090 ceph-mon[39228]: purged_snaps scrub ok 2026-02-17T12:06:11.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:11 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:06:11.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:11 trial090 ceph-mon[39228]: osd.0 [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641] boot 2026-02-17T12:06:11.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:11 trial090 ceph-mon[39228]: osdmap e9: 2 total, 1 up, 2 in 2026-02-17T12:06:11.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:11 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T12:06:11.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:11 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:06:11.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:11 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T12:06:11.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:11 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:12.579 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:12 trial090 ceph-mon[39228]: Deploying daemon osd.1 on trial090 2026-02-17T12:06:12.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:12 trial090 ceph-mon[39228]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T12:06:12.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:12 trial090 ceph-mon[39228]: osdmap e10: 2 total, 1 up, 2 in 2026-02-17T12:06:12.580 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:12 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:06:13.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.436+0000 7fe8bbfff640 1 -- 10.20.193.90:0/3875897092 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fe8dc194a50 con 0x7fe8b003dce0 2026-02-17T12:06:13.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.436+0000 7fe8bbfff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:06:13.438 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 1 on host 'trial090' 2026-02-17T12:06:13.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 10 mgrc shutdown 2026-02-17T12:06:13.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 1 -- 10.20.193.90:0/3875897092 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8b003dce0 msgr2=0x7fe8b00401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:13.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 1 --2- 10.20.193.90:0/3875897092 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8b003dce0 0x7fe8b00401a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40099c0 tx=0x7fe8c4006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:13.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 1 -- 10.20.193.90:0/3875897092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8dc104710 msgr2=0x7fe8dc19b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:13.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 1 --2- 10.20.193.90:0/3875897092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8dc104710 0x7fe8dc19b2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0005ec0 tx=0x7fe8d0004290 comp rx=0 tx=0).stop 2026-02-17T12:06:13.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 1 -- 10.20.193.90:0/3875897092 shutdown_connections 2026-02-17T12:06:13.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 1 --2- 10.20.193.90:0/3875897092 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fe8b003dce0 0x7fe8b00401a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:13.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 1 --2- 10.20.193.90:0/3875897092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe8dc104710 0x7fe8dc19b2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:13.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 1 -- 10.20.193.90:0/3875897092 >> 10.20.193.90:0/3875897092 conn(0x7fe8dc0ffea0 msgr2=0x7fe8dc100990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:13.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 1 -- 10.20.193.90:0/3875897092 shutdown_connections 2026-02-17T12:06:13.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:13.438+0000 7fe8e1188640 1 -- 10.20.193.90:0/3875897092 wait complete. 2026-02-17T12:06:13.475 DEBUG:teuthology.orchestra.run.trial090:osd.1> sudo journalctl -f -n 0 -u ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@osd.1.service 2026-02-17T12:06:13.478 INFO:tasks.cephadm:Deploying osd.2 on trial090 with /dev/vg_nvme/lv_2... 2026-02-17T12:06:13.478 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-17T12:06:13.644 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:13 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:06:13.644 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:13 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:13.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:13 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:13.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:13 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:13.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:13 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:13.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:13 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:13.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:13 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:06:13.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:13 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:13.679 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:14.775 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T12:06:14.776 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:06:14.776 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:14.776 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:14.776 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:14.776 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:14.776 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:06:14.776 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:06:14.776 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:14.776 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:14.776 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:06:14.777 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:14 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:14.777 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:14 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-1[57086]: 2026-02-17T12:06:14.374+0000 7f568b9b9740 -1 Falling back to public interface 2026-02-17T12:06:14.826 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:14.842 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_2 2026-02-17T12:06:14.993 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:15.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 -- 10.20.193.90:0/597549506 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5f1806bad0 msgr2=0x7f5f18107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:15.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 --2- 10.20.193.90:0/597549506 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5f1806bad0 0x7f5f18107460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f080099b0 tx=0x7f5f0802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:15.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 -- 10.20.193.90:0/597549506 shutdown_connections 2026-02-17T12:06:15.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 --2- 10.20.193.90:0/597549506 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5f1806bad0 0x7f5f18107460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:15.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 -- 10.20.193.90:0/597549506 >> 10.20.193.90:0/597549506 conn(0x7f5f180fcaf0 msgr2=0x7f5f180fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:15.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 -- 10.20.193.90:0/597549506 shutdown_connections 2026-02-17T12:06:15.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 -- 10.20.193.90:0/597549506 wait complete. 2026-02-17T12:06:15.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 Processor -- start 2026-02-17T12:06:15.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 -- start start 2026-02-17T12:06:15.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5f1806bad0 0x7f5f1819b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:15.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.096+0000 7f5f20510640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18109b70 con 0x7f5f1806bad0 2026-02-17T12:06:15.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5f1e285640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5f1806bad0 0x7f5f1819b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5f1e285640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5f1806bad0 0x7f5f1819b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33716/0 (socket says 10.20.193.90:33716) 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5f1e285640 1 -- 10.20.193.90:0/398881680 learned_addr learned my addr 10.20.193.90:0/398881680 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5f1e285640 1 -- 10.20.193.90:0/398881680 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1819b810 con 0x7f5f1806bad0 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5f1e285640 1 --2- 10.20.193.90:0/398881680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5f1806bad0 0x7f5f1819b2d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009ae0 tx=0x7f5f08004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5eff7fe640 1 -- 10.20.193.90:0/398881680 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f08038640 con 0x7f5f1806bad0 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5eff7fe640 1 -- 10.20.193.90:0/398881680 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f5f08046070 con 0x7f5f1806bad0 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5f20510640 1 -- 10.20.193.90:0/398881680 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1819baa0 con 0x7f5f1806bad0 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5eff7fe640 1 -- 10.20.193.90:0/398881680 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f08041870 con 0x7f5f1806bad0 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5f20510640 1 -- 10.20.193.90:0/398881680 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f1819e790 con 0x7f5f1806bad0 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5f20510640 1 -- 10.20.193.90:0/398881680 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f1810a310 con 0x7f5f1806bad0 2026-02-17T12:06:15.101 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5eff7fe640 1 -- 10.20.193.90:0/398881680 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f5f080387e0 con 0x7f5f1806bad0 2026-02-17T12:06:15.102 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.097+0000 7f5eff7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:15.102 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.098+0000 7f5eff7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:15.102 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.098+0000 7f5eff7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:15.102 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.098+0000 7f5eff7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:15.102 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.098+0000 7f5eff7fe640 1 --2- 10.20.193.90:0/398881680 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ef403dce0 0x7f5ef40401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:15.102 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.098+0000 7f5eff7fe640 1 -- 10.20.193.90:0/398881680 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1880+0+0 (secure 0 0 0) 0x7f5f08077550 con 0x7f5f1806bad0 2026-02-17T12:06:15.102 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.098+0000 7f5f1da84640 1 --2- 10.20.193.90:0/398881680 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ef403dce0 0x7f5ef40401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:15.102 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.098+0000 7f5f1da84640 1 --2- 10.20.193.90:0/398881680 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ef403dce0 0x7f5ef40401a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0099c0 tx=0x7f5f0c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:15.103 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.100+0000 7f5eff7fe640 1 -- 10.20.193.90:0/398881680 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5f0803e220 con 0x7f5f1806bad0 2026-02-17T12:06:15.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.188+0000 7f5f20510640 20 mgrc start_command cmd: [{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}] 2026-02-17T12:06:15.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:15.188+0000 7f5f20510640 1 -- 10.20.193.90:0/398881680 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5f18194940 con 0x7f5ef403dce0 2026-02-17T12:06:15.713 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:15 trial090 ceph-mon[39228]: Detected new or changed devices on trial090 2026-02-17T12:06:15.714 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:15 trial090 ceph-mon[39228]: Adjusting osd_memory_target on trial090 to 42023M 2026-02-17T12:06:15.714 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:15 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T12:06:15.714 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:15 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T12:06:15.714 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:15 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:16.829 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:16 trial090 ceph-mon[39228]: pgmap v16: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T12:06:16.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:16 trial090 ceph-mon[39228]: from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T12:06:16.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:16 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/2266007118' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8541b38-1a42-44f6-a18e-0c5e92857ed2"}]: dispatch 2026-02-17T12:06:16.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:16 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/2266007118' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8541b38-1a42-44f6-a18e-0c5e92857ed2"}]': finished 2026-02-17T12:06:16.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:16 trial090 ceph-mon[39228]: osdmap e11: 3 total, 1 up, 3 in 2026-02-17T12:06:16.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:16 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:06:16.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:16 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:06:16.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:16 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3628679073' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T12:06:18.829 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:18 trial090 ceph-mon[39228]: pgmap v18: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T12:06:18.830 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:18 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-1[57086]: 2026-02-17T12:06:18.657+0000 7f568b9b9740 -1 osd.1 0 log_to_monitors true 2026-02-17T12:06:19.723 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:19 trial090 ceph-mon[39228]: from='osd.1 [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-17T12:06:20.518 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:20 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-1[57086]: 2026-02-17T12:06:20.441+0000 7f568793a640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T12:06:20.518 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:20 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-1[57086]: 2026-02-17T12:06:20.443+0000 7f5683764640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:06:20.519 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:20 trial090 ceph-mon[39228]: pgmap v19: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T12:06:20.519 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:20 trial090 ceph-mon[39228]: from='osd.1 [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-17T12:06:20.519 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:20 trial090 ceph-mon[39228]: osdmap e12: 3 total, 1 up, 3 in 2026-02-17T12:06:20.519 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:20 trial090 ceph-mon[39228]: from='osd.1 [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial090", "root=default"]}]: dispatch 2026-02-17T12:06:20.519 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:20 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:06:20.519 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:20 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:06:20.519 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:20 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-17T12:06:20.520 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:20 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:21.708 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:21 trial090 ceph-mon[39228]: Deploying daemon osd.2 on trial090 2026-02-17T12:06:21.708 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:21 trial090 ceph-mon[39228]: from='osd.1 [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-17T12:06:21.708 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:21 trial090 ceph-mon[39228]: osdmap e13: 3 total, 1 up, 3 in 2026-02-17T12:06:21.709 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:21 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:06:21.709 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:21 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:06:22.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:22 trial090 ceph-mon[39228]: purged_snaps scrub starts 2026-02-17T12:06:22.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:22 trial090 ceph-mon[39228]: purged_snaps scrub ok 2026-02-17T12:06:22.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:22 trial090 ceph-mon[39228]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T12:06:22.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:22 trial090 ceph-mon[39228]: osd.1 [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063] boot 2026-02-17T12:06:22.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:22 trial090 ceph-mon[39228]: osdmap e14: 3 total, 2 up, 3 in 2026-02-17T12:06:22.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:22 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T12:06:22.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:22 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:06:22.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:22 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:06:22.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:22 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:22.831 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:22 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:23.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.131+0000 7f5eff7fe640 1 -- 10.20.193.90:0/398881680 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f5f18194940 con 0x7f5ef403dce0 2026-02-17T12:06:23.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.131+0000 7f5eff7fe640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:06:23.132 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 2 on host 'trial090' 2026-02-17T12:06:23.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 10 mgrc shutdown 2026-02-17T12:06:23.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 1 -- 10.20.193.90:0/398881680 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ef403dce0 msgr2=0x7f5ef40401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 1 --2- 10.20.193.90:0/398881680 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ef403dce0 0x7f5ef40401a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0099c0 tx=0x7f5f0c006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 1 -- 10.20.193.90:0/398881680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5f1806bad0 msgr2=0x7f5f1819b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 1 --2- 10.20.193.90:0/398881680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5f1806bad0 0x7f5f1819b2d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009ae0 tx=0x7f5f08004290 comp rx=0 tx=0).stop 2026-02-17T12:06:23.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 1 -- 10.20.193.90:0/398881680 shutdown_connections 2026-02-17T12:06:23.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 1 --2- 10.20.193.90:0/398881680 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ef403dce0 0x7f5ef40401a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 1 --2- 10.20.193.90:0/398881680 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5f1806bad0 0x7f5f1819b2d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 1 -- 10.20.193.90:0/398881680 >> 10.20.193.90:0/398881680 conn(0x7f5f180fcaf0 msgr2=0x7f5f180fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:23.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 1 -- 10.20.193.90:0/398881680 shutdown_connections 2026-02-17T12:06:23.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.133+0000 7f5f20510640 1 -- 10.20.193.90:0/398881680 wait complete. 2026-02-17T12:06:23.171 DEBUG:teuthology.orchestra.run.trial090:osd.2> sudo journalctl -f -n 0 -u ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460@osd.2.service 2026-02-17T12:06:23.174 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2026-02-17T12:06:23.174 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:06:23.389 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:23.502 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 -- 10.20.193.90:0/1931857620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5b8104710 msgr2=0x7ff5b8104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.502 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 --2- 10.20.193.90:0/1931857620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5b8104710 0x7ff5b8104b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80099b0 tx=0x7ff5a802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.502 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 -- 10.20.193.90:0/1931857620 shutdown_connections 2026-02-17T12:06:23.502 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 --2- 10.20.193.90:0/1931857620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5b8104710 0x7ff5b8104b10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 -- 10.20.193.90:0/1931857620 >> 10.20.193.90:0/1931857620 conn(0x7ff5b80ffea0 msgr2=0x7ff5b81022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 -- 10.20.193.90:0/1931857620 shutdown_connections 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 -- 10.20.193.90:0/1931857620 wait complete. 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 Processor -- start 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 -- start start 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5b8104710 0x7ff5b819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5c03b3640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b8109b90 con 0x7ff5b8104710 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5be128640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5b8104710 0x7ff5b819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5be128640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5b8104710 0x7ff5b819b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33816/0 (socket says 10.20.193.90:33816) 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5be128640 1 -- 10.20.193.90:0/4045471410 learned_addr learned my addr 10.20.193.90:0/4045471410 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.499+0000 7ff5be128640 1 -- 10.20.193.90:0/4045471410 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b819b830 con 0x7ff5b8104710 2026-02-17T12:06:23.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.500+0000 7ff5be128640 1 --2- 10.20.193.90:0/4045471410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5b8104710 0x7ff5b819b2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8002410 tx=0x7ff5a8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.500+0000 7ff59f7fe640 1 -- 10.20.193.90:0/4045471410 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a8038510 con 0x7ff5b8104710 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.500+0000 7ff59f7fe640 1 -- 10.20.193.90:0/4045471410 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7ff5a8046070 con 0x7ff5b8104710 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.500+0000 7ff59f7fe640 1 -- 10.20.193.90:0/4045471410 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a8041730 con 0x7ff5b8104710 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.500+0000 7ff5c03b3640 1 -- 10.20.193.90:0/4045471410 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b819bac0 con 0x7ff5b8104710 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.500+0000 7ff5c03b3640 1 -- 10.20.193.90:0/4045471410 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b819e7b0 con 0x7ff5b8104710 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.500+0000 7ff5c03b3640 1 -- 10.20.193.90:0/4045471410 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b810a330 con 0x7ff5b8104710 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.500+0000 7ff59f7fe640 1 -- 10.20.193.90:0/4045471410 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7ff5a80386b0 con 0x7ff5b8104710 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.500+0000 7ff59f7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.501+0000 7ff59f7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.501+0000 7ff59f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.501+0000 7ff59f7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:23.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.501+0000 7ff59f7fe640 1 --2- 10.20.193.90:0/4045471410 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7ff59403dc90 0x7ff594040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:23.505 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.501+0000 7ff59f7fe640 1 -- 10.20.193.90:0/4045471410 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7ff5a8077470 con 0x7ff5b8104710 2026-02-17T12:06:23.505 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.501+0000 7ff5bd927640 1 --2- 10.20.193.90:0/4045471410 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7ff59403dc90 0x7ff594040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:23.505 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.501+0000 7ff5bd927640 1 --2- 10.20.193.90:0/4045471410 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7ff59403dc90 0x7ff594040150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0099c0 tx=0x7ff5ac006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:23.505 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:23 trial090 ceph-mon[39228]: osdmap e15: 3 total, 2 up, 3 in 2026-02-17T12:06:23.505 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:23 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:06:23.505 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:23 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:23.505 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:23 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:23.506 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:23 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:23.506 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:23 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:06:23.506 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:23 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:23.506 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:23 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T12:06:23.506 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:23 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:23.506 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:23 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:23.506 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.503+0000 7ff59f7fe640 1 -- 10.20.193.90:0/4045471410 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff5a8007c50 con 0x7ff5b8104710 2026-02-17T12:06:23.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.589+0000 7ff5c03b3640 1 -- 10.20.193.90:0/4045471410 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff5b81948f0 con 0x7ff5b8104710 2026-02-17T12:06:23.590 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:23.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.589+0000 7ff59f7fe640 1 -- 10.20.193.90:0/4045471410 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7ff5a8038c90 con 0x7ff5b8104710 2026-02-17T12:06:23.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.589+0000 7ff5c03b3640 10 mgrc shutdown 2026-02-17T12:06:23.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.590+0000 7ff5c03b3640 1 -- 10.20.193.90:0/4045471410 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7ff59403dc90 msgr2=0x7ff594040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.590+0000 7ff5c03b3640 1 --2- 10.20.193.90:0/4045471410 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7ff59403dc90 0x7ff594040150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0099c0 tx=0x7ff5ac006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.590+0000 7ff5c03b3640 1 -- 10.20.193.90:0/4045471410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5b8104710 msgr2=0x7ff5b819b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:23.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.590+0000 7ff5c03b3640 1 --2- 10.20.193.90:0/4045471410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5b8104710 0x7ff5b819b2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8002410 tx=0x7ff5a8004290 comp rx=0 tx=0).stop 2026-02-17T12:06:23.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.590+0000 7ff5c03b3640 1 -- 10.20.193.90:0/4045471410 shutdown_connections 2026-02-17T12:06:23.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.590+0000 7ff5c03b3640 1 --2- 10.20.193.90:0/4045471410 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7ff59403dc90 0x7ff594040150 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.590+0000 7ff5c03b3640 1 --2- 10.20.193.90:0/4045471410 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5b8104710 0x7ff5b819b2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:23.593 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.590+0000 7ff5c03b3640 1 -- 10.20.193.90:0/4045471410 >> 10.20.193.90:0/4045471410 conn(0x7ff5b80ffea0 msgr2=0x7ff5b8100990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:23.593 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.590+0000 7ff5c03b3640 1 -- 10.20.193.90:0/4045471410 shutdown_connections 2026-02-17T12:06:23.593 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:23.590+0000 7ff5c03b3640 1 -- 10.20.193.90:0/4045471410 wait complete. 2026-02-17T12:06:23.628 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771329981,"num_in_osds":3,"osd_in_since":1771329975,"num_remapped_pgs":0} 2026-02-17T12:06:24.330 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:23 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-2[63013]: 2026-02-17T12:06:23.906+0000 7f0c4e756740 -1 Falling back to public interface 2026-02-17T12:06:24.630 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:06:24.785 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:24.807 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:06:24.808 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/4045471410' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:06:24.808 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:24.808 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:24.808 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:06:24.808 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:06:24.808 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T12:06:24.808 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:24.808 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T12:06:24.809 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T12:06:24.809 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:24 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:24.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.892+0000 7f144bc35640 1 -- 10.20.193.90:0/3665491237 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f14441046e0 msgr2=0x7f1444104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:24.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.892+0000 7f144bc35640 1 --2- 10.20.193.90:0/3665491237 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f14441046e0 0x7f1444104ae0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f14340099b0 tx=0x7f143402f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:24.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.892+0000 7f144bc35640 1 -- 10.20.193.90:0/3665491237 shutdown_connections 2026-02-17T12:06:24.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.892+0000 7f144bc35640 1 --2- 10.20.193.90:0/3665491237 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f14441046e0 0x7f1444104ae0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:24.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.892+0000 7f144bc35640 1 -- 10.20.193.90:0/3665491237 >> 10.20.193.90:0/3665491237 conn(0x7f14440ffe70 msgr2=0x7f14441022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:24.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.892+0000 7f144bc35640 1 -- 10.20.193.90:0/3665491237 shutdown_connections 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.892+0000 7f144bc35640 1 -- 10.20.193.90:0/3665491237 wait complete. 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.892+0000 7f144bc35640 1 Processor -- start 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.892+0000 7f144bc35640 1 -- start start 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f144bc35640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f14441046e0 0x7f144419b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f144bc35640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1444109b60 con 0x7f14441046e0 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f14499aa640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f14441046e0 0x7f144419b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f14499aa640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f14441046e0 0x7f144419b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:45784/0 (socket says 10.20.193.90:45784) 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f14499aa640 1 -- 10.20.193.90:0/2247923070 learned_addr learned my addr 10.20.193.90:0/2247923070 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f14499aa640 1 -- 10.20.193.90:0/2247923070 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144419b840 con 0x7f14441046e0 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f14499aa640 1 --2- 10.20.193.90:0/2247923070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f14441046e0 0x7f144419b300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1434005ec0 tx=0x7f1434004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f1432ffd640 1 -- 10.20.193.90:0/2247923070 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1434038510 con 0x7f14441046e0 2026-02-17T12:06:24.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f1432ffd640 1 -- 10.20.193.90:0/2247923070 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1434046070 con 0x7f14441046e0 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f144bc35640 1 -- 10.20.193.90:0/2247923070 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144419bad0 con 0x7f14441046e0 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f1432ffd640 1 -- 10.20.193.90:0/2247923070 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1434041810 con 0x7f14441046e0 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f144bc35640 1 -- 10.20.193.90:0/2247923070 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f144419e7c0 con 0x7f14441046e0 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.893+0000 7f144bc35640 1 -- 10.20.193.90:0/2247923070 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f144410a300 con 0x7f14441046e0 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.894+0000 7f1432ffd640 1 -- 10.20.193.90:0/2247923070 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f14340419b0 con 0x7f14441046e0 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.894+0000 7f1432ffd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.894+0000 7f1432ffd640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.894+0000 7f1432ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.894+0000 7f1432ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.894+0000 7f1432ffd640 1 --2- 10.20.193.90:0/2247923070 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f142003dce0 0x7f14200401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:24.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.894+0000 7f1432ffd640 1 -- 10.20.193.90:0/2247923070 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7f1434077630 con 0x7f14441046e0 2026-02-17T12:06:24.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.894+0000 7f14491a9640 1 --2- 10.20.193.90:0/2247923070 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f142003dce0 0x7f14200401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:24.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.894+0000 7f14491a9640 1 --2- 10.20.193.90:0/2247923070 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f142003dce0 0x7f14200401a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f14380099c0 tx=0x7f1438006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:24.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.896+0000 7f1432ffd640 1 -- 10.20.193.90:0/2247923070 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1434040360 con 0x7f14441046e0 2026-02-17T12:06:24.981 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.980+0000 7f144bc35640 1 -- 10.20.193.90:0/2247923070 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f14441948c0 con 0x7f14441046e0 2026-02-17T12:06:24.981 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.980+0000 7f1432ffd640 1 -- 10.20.193.90:0/2247923070 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7f1434041cd0 con 0x7f14441046e0 2026-02-17T12:06:24.982 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:24.982 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 10 mgrc shutdown 2026-02-17T12:06:24.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 1 -- 10.20.193.90:0/2247923070 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f142003dce0 msgr2=0x7f14200401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:24.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 1 --2- 10.20.193.90:0/2247923070 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f142003dce0 0x7f14200401a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f14380099c0 tx=0x7f1438006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:24.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 1 -- 10.20.193.90:0/2247923070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f14441046e0 msgr2=0x7f144419b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:24.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 1 --2- 10.20.193.90:0/2247923070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f14441046e0 0x7f144419b300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1434005ec0 tx=0x7f1434004290 comp rx=0 tx=0).stop 2026-02-17T12:06:24.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 1 -- 10.20.193.90:0/2247923070 shutdown_connections 2026-02-17T12:06:24.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 1 --2- 10.20.193.90:0/2247923070 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f142003dce0 0x7f14200401a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:24.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 1 --2- 10.20.193.90:0/2247923070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f14441046e0 0x7f144419b300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:24.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 1 -- 10.20.193.90:0/2247923070 >> 10.20.193.90:0/2247923070 conn(0x7f14440ffe70 msgr2=0x7f14441004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:24.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 1 -- 10.20.193.90:0/2247923070 shutdown_connections 2026-02-17T12:06:24.983 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:24.981+0000 7f144bc35640 1 -- 10.20.193.90:0/2247923070 wait complete. 2026-02-17T12:06:25.022 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771329981,"num_in_osds":3,"osd_in_since":1771329975,"num_remapped_pgs":0} 2026-02-17T12:06:25.829 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:25 trial090 ceph-mon[39228]: Detected new or changed devices on trial090 2026-02-17T12:06:25.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:25 trial090 ceph-mon[39228]: Adjusting osd_memory_target on trial090 to 28015M 2026-02-17T12:06:25.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:25 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/2247923070' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:06:26.023 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:06:26.178 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:26.289 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 -- 10.20.193.90:0/2985732712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73401046e0 msgr2=0x7f7340104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.289 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 --2- 10.20.193.90:0/2985732712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73401046e0 0x7f7340104ae0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f732c0099b0 tx=0x7f732c02f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.290 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 -- 10.20.193.90:0/2985732712 shutdown_connections 2026-02-17T12:06:26.290 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 --2- 10.20.193.90:0/2985732712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73401046e0 0x7f7340104ae0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.290 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 -- 10.20.193.90:0/2985732712 >> 10.20.193.90:0/2985732712 conn(0x7f73400ffe70 msgr2=0x7f73401022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:26.290 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 -- 10.20.193.90:0/2985732712 shutdown_connections 2026-02-17T12:06:26.290 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 -- 10.20.193.90:0/2985732712 wait complete. 2026-02-17T12:06:26.290 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 Processor -- start 2026-02-17T12:06:26.290 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 -- start start 2026-02-17T12:06:26.290 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73401046e0 0x7f734019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.290 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f7346312640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7340109b60 con 0x7f73401046e0 2026-02-17T12:06:26.290 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f733ffff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73401046e0 0x7f734019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.291 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f733ffff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73401046e0 0x7f734019b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:45794/0 (socket says 10.20.193.90:45794) 2026-02-17T12:06:26.291 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f733ffff640 1 -- 10.20.193.90:0/3328112388 learned_addr learned my addr 10.20.193.90:0/3328112388 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:26.291 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.286+0000 7f733ffff640 1 -- 10.20.193.90:0/3328112388 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734019b840 con 0x7f73401046e0 2026-02-17T12:06:26.291 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.287+0000 7f733ffff640 1 --2- 10.20.193.90:0/3328112388 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73401046e0 0x7f734019b300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f732c005ec0 tx=0x7f732c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.291 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.287+0000 7f733d7fa640 1 -- 10.20.193.90:0/3328112388 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f732c038510 con 0x7f73401046e0 2026-02-17T12:06:26.291 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.287+0000 7f733d7fa640 1 -- 10.20.193.90:0/3328112388 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f732c046070 con 0x7f73401046e0 2026-02-17T12:06:26.291 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.287+0000 7f733d7fa640 1 -- 10.20.193.90:0/3328112388 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f732c041810 con 0x7f73401046e0 2026-02-17T12:06:26.291 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.287+0000 7f7346312640 1 -- 10.20.193.90:0/3328112388 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734019bad0 con 0x7f73401046e0 2026-02-17T12:06:26.291 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.287+0000 7f7346312640 1 -- 10.20.193.90:0/3328112388 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734019e7c0 con 0x7f73401046e0 2026-02-17T12:06:26.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.287+0000 7f7346312640 1 -- 10.20.193.90:0/3328112388 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734010a300 con 0x7f73401046e0 2026-02-17T12:06:26.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.287+0000 7f733d7fa640 1 -- 10.20.193.90:0/3328112388 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f732c0386b0 con 0x7f73401046e0 2026-02-17T12:06:26.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.287+0000 7f733d7fa640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:26.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.288+0000 7f733d7fa640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:26.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.288+0000 7f733d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:26.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.288+0000 7f733d7fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:26.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.288+0000 7f733d7fa640 1 --2- 10.20.193.90:0/3328112388 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f731403dce0 0x7f73140401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:26.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.288+0000 7f733d7fa640 1 -- 10.20.193.90:0/3328112388 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7f732c0775b0 con 0x7f73401046e0 2026-02-17T12:06:26.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.288+0000 7f733f7fe640 1 --2- 10.20.193.90:0/3328112388 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f731403dce0 0x7f73140401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:26.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.288+0000 7f733f7fe640 1 --2- 10.20.193.90:0/3328112388 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f731403dce0 0x7f73140401a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f73300099c0 tx=0x7f7330006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:26.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.290+0000 7f733d7fa640 1 -- 10.20.193.90:0/3328112388 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f732c0389d0 con 0x7f73401046e0 2026-02-17T12:06:26.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.375+0000 7f7346312640 1 -- 10.20.193.90:0/3328112388 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f73401948c0 con 0x7f73401046e0 2026-02-17T12:06:26.377 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.375+0000 7f733d7fa640 1 -- 10.20.193.90:0/3328112388 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7f732c007c50 con 0x7f73401046e0 2026-02-17T12:06:26.377 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:26.378 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 10 mgrc shutdown 2026-02-17T12:06:26.378 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 1 -- 10.20.193.90:0/3328112388 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f731403dce0 msgr2=0x7f73140401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.378 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 1 --2- 10.20.193.90:0/3328112388 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f731403dce0 0x7f73140401a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f73300099c0 tx=0x7f7330006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.378 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 1 -- 10.20.193.90:0/3328112388 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73401046e0 msgr2=0x7f734019b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:26.378 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 1 --2- 10.20.193.90:0/3328112388 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73401046e0 0x7f734019b300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f732c005ec0 tx=0x7f732c004290 comp rx=0 tx=0).stop 2026-02-17T12:06:26.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 1 -- 10.20.193.90:0/3328112388 shutdown_connections 2026-02-17T12:06:26.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 1 --2- 10.20.193.90:0/3328112388 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f731403dce0 0x7f73140401a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 1 --2- 10.20.193.90:0/3328112388 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f73401046e0 0x7f734019b300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:26.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 1 -- 10.20.193.90:0/3328112388 >> 10.20.193.90:0/3328112388 conn(0x7f73400ffe70 msgr2=0x7f73401004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:26.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 1 -- 10.20.193.90:0/3328112388 shutdown_connections 2026-02-17T12:06:26.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:26.376+0000 7f7346312640 1 -- 10.20.193.90:0/3328112388 wait complete. 2026-02-17T12:06:26.412 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771329981,"num_in_osds":3,"osd_in_since":1771329975,"num_remapped_pgs":0} 2026-02-17T12:06:26.829 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:26 trial090 ceph-mon[39228]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:06:26.829 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:26 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3328112388' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:06:27.412 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:06:27.567 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.678+0000 7fa37cd44640 1 -- 10.20.193.90:0/4092796127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa378104710 msgr2=0x7fa378104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.678+0000 7fa37cd44640 1 --2- 10.20.193.90:0/4092796127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa378104710 0x7fa378104b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0099b0 tx=0x7fa36c02f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.678+0000 7fa37cd44640 1 -- 10.20.193.90:0/4092796127 shutdown_connections 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.678+0000 7fa37cd44640 1 --2- 10.20.193.90:0/4092796127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa378104710 0x7fa378104b10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.678+0000 7fa37cd44640 1 -- 10.20.193.90:0/4092796127 >> 10.20.193.90:0/4092796127 conn(0x7fa3780ffea0 msgr2=0x7fa3781022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.678+0000 7fa37cd44640 1 -- 10.20.193.90:0/4092796127 shutdown_connections 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.678+0000 7fa37cd44640 1 -- 10.20.193.90:0/4092796127 wait complete. 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa37cd44640 1 Processor -- start 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa37cd44640 1 -- start start 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa37cd44640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa378104710 0x7fa37819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa37cd44640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa378109b90 con 0x7fa378104710 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa376575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa378104710 0x7fa37819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa376575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa378104710 0x7fa37819b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:45820/0 (socket says 10.20.193.90:45820) 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa376575640 1 -- 10.20.193.90:0/2476382083 learned_addr learned my addr 10.20.193.90:0/2476382083 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa376575640 1 -- 10.20.193.90:0/2476382083 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37819b830 con 0x7fa378104710 2026-02-17T12:06:27.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa376575640 1 --2- 10.20.193.90:0/2476382083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa378104710 0x7fa37819b2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa36c005ec0 tx=0x7fa36c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa35f7fe640 1 -- 10.20.193.90:0/2476382083 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa36c038510 con 0x7fa378104710 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa35f7fe640 1 -- 10.20.193.90:0/2476382083 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa36c046070 con 0x7fa378104710 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa37cd44640 1 -- 10.20.193.90:0/2476382083 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37819bac0 con 0x7fa378104710 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa35f7fe640 1 -- 10.20.193.90:0/2476382083 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa36c041810 con 0x7fa378104710 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.679+0000 7fa37cd44640 1 -- 10.20.193.90:0/2476382083 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37819e7b0 con 0x7fa378104710 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.680+0000 7fa37cd44640 1 -- 10.20.193.90:0/2476382083 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa37810a330 con 0x7fa378104710 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.680+0000 7fa35f7fe640 1 -- 10.20.193.90:0/2476382083 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fa36c0386b0 con 0x7fa378104710 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.680+0000 7fa35f7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.680+0000 7fa35f7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.680+0000 7fa35f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.680+0000 7fa35f7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.680+0000 7fa35f7fe640 1 --2- 10.20.193.90:0/2476382083 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa35003dce0 0x7fa3500401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.680+0000 7fa35f7fe640 1 -- 10.20.193.90:0/2476382083 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2312+0+0 (secure 0 0 0) 0x7fa36c0775b0 con 0x7fa378104710 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.681+0000 7fa375d74640 1 --2- 10.20.193.90:0/2476382083 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa35003dce0 0x7fa3500401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:27.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.681+0000 7fa375d74640 1 --2- 10.20.193.90:0/2476382083 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa35003dce0 0x7fa3500401a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa3600099c0 tx=0x7fa360006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:27.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.683+0000 7fa35f7fe640 1 -- 10.20.193.90:0/2476382083 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa36c0389d0 con 0x7fa378104710 2026-02-17T12:06:27.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.767+0000 7fa37cd44640 1 -- 10.20.193.90:0/2476382083 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa3781948f0 con 0x7fa378104710 2026-02-17T12:06:27.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.767+0000 7fa35f7fe640 1 -- 10.20.193.90:0/2476382083 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v15) ==== 74+0+130 (secure 0 0 0) 0x7fa36c04a3c0 con 0x7fa378104710 2026-02-17T12:06:27.769 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:27.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 10 mgrc shutdown 2026-02-17T12:06:27.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 1 -- 10.20.193.90:0/2476382083 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa35003dce0 msgr2=0x7fa3500401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:27.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 1 --2- 10.20.193.90:0/2476382083 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa35003dce0 0x7fa3500401a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa3600099c0 tx=0x7fa360006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 1 -- 10.20.193.90:0/2476382083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa378104710 msgr2=0x7fa37819b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:27.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 1 --2- 10.20.193.90:0/2476382083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa378104710 0x7fa37819b2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa36c005ec0 tx=0x7fa36c004290 comp rx=0 tx=0).stop 2026-02-17T12:06:27.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 1 -- 10.20.193.90:0/2476382083 shutdown_connections 2026-02-17T12:06:27.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 1 --2- 10.20.193.90:0/2476382083 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa35003dce0 0x7fa3500401a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 1 --2- 10.20.193.90:0/2476382083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa378104710 0x7fa37819b2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:27.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 1 -- 10.20.193.90:0/2476382083 >> 10.20.193.90:0/2476382083 conn(0x7fa3780ffea0 msgr2=0x7fa378100990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:27.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 1 -- 10.20.193.90:0/2476382083 shutdown_connections 2026-02-17T12:06:27.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:27.768+0000 7fa37cd44640 1 -- 10.20.193.90:0/2476382083 wait complete. 2026-02-17T12:06:27.827 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":15,"num_osds":3,"num_up_osds":2,"osd_up_since":1771329981,"num_in_osds":3,"osd_in_since":1771329975,"num_remapped_pgs":0} 2026-02-17T12:06:28.079 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:27 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-2[63013]: 2026-02-17T12:06:27.964+0000 7f0c4e756740 -1 osd.2 0 log_to_monitors true 2026-02-17T12:06:28.828 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:06:28.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:28 trial090 ceph-mon[39228]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:06:28.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:28 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/2476382083' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:06:28.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:28 trial090 ceph-mon[39228]: from='osd.2 [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-17T12:06:28.981 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:29.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 -- 10.20.193.90:0/3701187752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f715c104710 msgr2=0x7f715c104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:29.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 --2- 10.20.193.90:0/3701187752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f715c104710 0x7f715c104b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f71500099b0 tx=0x7f715002f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:29.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 -- 10.20.193.90:0/3701187752 shutdown_connections 2026-02-17T12:06:29.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 --2- 10.20.193.90:0/3701187752 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f715c104710 0x7f715c104b10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:29.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 -- 10.20.193.90:0/3701187752 >> 10.20.193.90:0/3701187752 conn(0x7f715c0ffea0 msgr2=0x7f715c1022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 -- 10.20.193.90:0/3701187752 shutdown_connections 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 -- 10.20.193.90:0/3701187752 wait complete. 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 Processor -- start 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 -- start start 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f715c104710 0x7f715c19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f715c109b90 con 0x7f715c104710 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f715a575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f715c104710 0x7f715c19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f715a575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f715c104710 0x7f715c19b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:45864/0 (socket says 10.20.193.90:45864) 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f715a575640 1 -- 10.20.193.90:0/3789418686 learned_addr learned my addr 10.20.193.90:0/3789418686 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f715a575640 1 -- 10.20.193.90:0/3789418686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c19b830 con 0x7f715c104710 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f715a575640 1 --2- 10.20.193.90:0/3789418686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f715c104710 0x7f715c19b2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7150005ec0 tx=0x7f7150004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:29.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f71437fe640 1 -- 10.20.193.90:0/3789418686 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7150038510 con 0x7f715c104710 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f71437fe640 1 -- 10.20.193.90:0/3789418686 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7150046070 con 0x7f715c104710 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.080+0000 7f7160fa7640 1 -- 10.20.193.90:0/3789418686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715c19bac0 con 0x7f715c104710 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f71437fe640 1 -- 10.20.193.90:0/3789418686 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7150041810 con 0x7f715c104710 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f7160fa7640 1 -- 10.20.193.90:0/3789418686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715c19e7b0 con 0x7f715c104710 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f71437fe640 1 -- 10.20.193.90:0/3789418686 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f71500419b0 con 0x7f715c104710 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f71437fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f71437fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f71437fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f71437fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f71437fe640 1 --2- 10.20.193.90:0/3789418686 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f713403dce0 0x7f71340401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:29.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f7160fa7640 1 -- 10.20.193.90:0/3789418686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715c10a330 con 0x7f715c104710 2026-02-17T12:06:29.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f71437fe640 1 -- 10.20.193.90:0/3789418686 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2333+0+0 (secure 0 0 0) 0x7f71500775a0 con 0x7f715c104710 2026-02-17T12:06:29.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.081+0000 7f7159d74640 1 --2- 10.20.193.90:0/3789418686 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f713403dce0 0x7f71340401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:29.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.082+0000 7f7159d74640 1 --2- 10.20.193.90:0/3789418686 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f713403dce0 0x7f71340401a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71440099c0 tx=0x7f7144006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:29.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.084+0000 7f71437fe640 1 -- 10.20.193.90:0/3789418686 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7150051060 con 0x7f715c104710 2026-02-17T12:06:29.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.167+0000 7f7160fa7640 1 -- 10.20.193.90:0/3789418686 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f715c1948f0 con 0x7f715c104710 2026-02-17T12:06:29.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.167+0000 7f71437fe640 1 -- 10.20.193.90:0/3789418686 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v16) ==== 74+0+130 (secure 0 0 0) 0x7f7150047270 con 0x7f715c104710 2026-02-17T12:06:29.168 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:29.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.167+0000 7f7160fa7640 10 mgrc shutdown 2026-02-17T12:06:29.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.168+0000 7f7160fa7640 1 -- 10.20.193.90:0/3789418686 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f713403dce0 msgr2=0x7f71340401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:29.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.168+0000 7f7160fa7640 1 --2- 10.20.193.90:0/3789418686 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f713403dce0 0x7f71340401a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71440099c0 tx=0x7f7144006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:29.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.168+0000 7f7160fa7640 1 -- 10.20.193.90:0/3789418686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f715c104710 msgr2=0x7f715c19b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:29.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.168+0000 7f7160fa7640 1 --2- 10.20.193.90:0/3789418686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f715c104710 0x7f715c19b2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7150005ec0 tx=0x7f7150004290 comp rx=0 tx=0).stop 2026-02-17T12:06:29.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.168+0000 7f7160fa7640 1 -- 10.20.193.90:0/3789418686 shutdown_connections 2026-02-17T12:06:29.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.168+0000 7f7160fa7640 1 --2- 10.20.193.90:0/3789418686 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f713403dce0 0x7f71340401a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:29.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.168+0000 7f7160fa7640 1 --2- 10.20.193.90:0/3789418686 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f715c104710 0x7f715c19b2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:29.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.168+0000 7f7160fa7640 1 -- 10.20.193.90:0/3789418686 >> 10.20.193.90:0/3789418686 conn(0x7f715c0ffea0 msgr2=0x7f715c100990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:29.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.168+0000 7f7160fa7640 1 -- 10.20.193.90:0/3789418686 shutdown_connections 2026-02-17T12:06:29.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:29.168+0000 7f7160fa7640 1 -- 10.20.193.90:0/3789418686 wait complete. 2026-02-17T12:06:29.219 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":16,"num_osds":3,"num_up_osds":2,"osd_up_since":1771329981,"num_in_osds":3,"osd_in_since":1771329975,"num_remapped_pgs":0} 2026-02-17T12:06:29.829 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:29 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-2[63013]: 2026-02-17T12:06:29.458+0000 7f0c4a6d7640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T12:06:29.830 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:29 trial090 ceph-ea07e39e-0bf8-11f1-bf0e-d404e6e7d460-osd-2[63013]: 2026-02-17T12:06:29.461+0000 7f0c46501640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T12:06:29.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:29 trial090 ceph-mon[39228]: from='osd.2 [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-17T12:06:29.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:29 trial090 ceph-mon[39228]: osdmap e16: 3 total, 2 up, 3 in 2026-02-17T12:06:29.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:29 trial090 ceph-mon[39228]: from='osd.2 [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]}]: dispatch 2026-02-17T12:06:29.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:29 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:06:29.831 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:29 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3789418686' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:06:29.831 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:29 trial090 ceph-mon[39228]: from='osd.2 [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-17T12:06:30.220 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T12:06:30.371 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.477+0000 7fb26008e640 1 -- 10.20.193.90:0/2773773809 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2581046e0 msgr2=0x7fb258104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.477+0000 7fb26008e640 1 --2- 10.20.193.90:0/2773773809 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2581046e0 0x7fb258104ae0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb2480099b0 tx=0x7fb24802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.477+0000 7fb26008e640 1 -- 10.20.193.90:0/2773773809 shutdown_connections 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.477+0000 7fb26008e640 1 --2- 10.20.193.90:0/2773773809 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2581046e0 0x7fb258104ae0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.477+0000 7fb26008e640 1 -- 10.20.193.90:0/2773773809 >> 10.20.193.90:0/2773773809 conn(0x7fb2580ffe70 msgr2=0x7fb2581022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.477+0000 7fb26008e640 1 -- 10.20.193.90:0/2773773809 shutdown_connections 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.477+0000 7fb26008e640 1 -- 10.20.193.90:0/2773773809 wait complete. 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb26008e640 1 Processor -- start 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb26008e640 1 -- start start 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb26008e640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2581046e0 0x7fb25819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb26008e640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb258109b60 con 0x7fb2581046e0 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb25de03640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2581046e0 0x7fb25819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb25de03640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2581046e0 0x7fb25819b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:45884/0 (socket says 10.20.193.90:45884) 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb25de03640 1 -- 10.20.193.90:0/2339761469 learned_addr learned my addr 10.20.193.90:0/2339761469 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb25de03640 1 -- 10.20.193.90:0/2339761469 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25819b840 con 0x7fb2581046e0 2026-02-17T12:06:30.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb25de03640 1 --2- 10.20.193.90:0/2339761469 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2581046e0 0x7fb25819b300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb248005ec0 tx=0x7fb248004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb246ffd640 1 -- 10.20.193.90:0/2339761469 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb248038510 con 0x7fb2581046e0 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb246ffd640 1 -- 10.20.193.90:0/2339761469 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fb248046070 con 0x7fb2581046e0 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb26008e640 1 -- 10.20.193.90:0/2339761469 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25819bad0 con 0x7fb2581046e0 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb246ffd640 1 -- 10.20.193.90:0/2339761469 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb248041810 con 0x7fb2581046e0 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.478+0000 7fb26008e640 1 -- 10.20.193.90:0/2339761469 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25819e7c0 con 0x7fb2581046e0 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.479+0000 7fb26008e640 1 -- 10.20.193.90:0/2339761469 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25810a300 con 0x7fb2581046e0 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.479+0000 7fb246ffd640 1 -- 10.20.193.90:0/2339761469 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fb2480386b0 con 0x7fb2581046e0 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.479+0000 7fb246ffd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.479+0000 7fb246ffd640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.479+0000 7fb246ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.479+0000 7fb246ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.479+0000 7fb246ffd640 1 --2- 10.20.193.90:0/2339761469 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fb23403dce0 0x7fb2340401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.479+0000 7fb246ffd640 1 -- 10.20.193.90:0/2339761469 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2629+0+0 (secure 0 0 0) 0x7fb248077630 con 0x7fb2581046e0 2026-02-17T12:06:30.480 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.479+0000 7fb25d602640 1 --2- 10.20.193.90:0/2339761469 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fb23403dce0 0x7fb2340401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:30.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.479+0000 7fb25d602640 1 --2- 10.20.193.90:0/2339761469 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fb23403dce0 0x7fb2340401a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0099c0 tx=0x7fb24c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:30.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.481+0000 7fb246ffd640 1 -- 10.20.193.90:0/2339761469 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb2480389d0 con 0x7fb2581046e0 2026-02-17T12:06:30.565 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.563+0000 7fb26008e640 1 -- 10.20.193.90:0/2339761469 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb2581948f0 con 0x7fb2581046e0 2026-02-17T12:06:30.565 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:30 trial090 ceph-mon[39228]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:06:30.565 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:30 trial090 ceph-mon[39228]: osdmap e17: 3 total, 2 up, 3 in 2026-02-17T12:06:30.566 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:30 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:06:30.566 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:30 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:06:30.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb246ffd640 1 -- 10.20.193.90:0/2339761469 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v18) ==== 74+0+130 (secure 0 0 0) 0x7fb24804a3c0 con 0x7fb2581046e0 2026-02-17T12:06:30.566 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:30.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb26008e640 10 mgrc shutdown 2026-02-17T12:06:30.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb26008e640 1 -- 10.20.193.90:0/2339761469 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fb23403dce0 msgr2=0x7fb2340401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:30.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb26008e640 1 --2- 10.20.193.90:0/2339761469 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fb23403dce0 0x7fb2340401a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0099c0 tx=0x7fb24c006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb26008e640 1 -- 10.20.193.90:0/2339761469 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2581046e0 msgr2=0x7fb25819b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:30.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb26008e640 1 --2- 10.20.193.90:0/2339761469 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2581046e0 0x7fb25819b300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb248005ec0 tx=0x7fb248004290 comp rx=0 tx=0).stop 2026-02-17T12:06:30.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb26008e640 1 -- 10.20.193.90:0/2339761469 shutdown_connections 2026-02-17T12:06:30.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb26008e640 1 --2- 10.20.193.90:0/2339761469 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fb23403dce0 0x7fb2340401a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb26008e640 1 --2- 10.20.193.90:0/2339761469 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb2581046e0 0x7fb25819b300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb26008e640 1 -- 10.20.193.90:0/2339761469 >> 10.20.193.90:0/2339761469 conn(0x7fb2580ffe70 msgr2=0x7fb2581004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:30.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.564+0000 7fb26008e640 1 -- 10.20.193.90:0/2339761469 shutdown_connections 2026-02-17T12:06:30.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.565+0000 7fb26008e640 1 -- 10.20.193.90:0/2339761469 wait complete. 2026-02-17T12:06:30.600 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":18,"num_osds":3,"num_up_osds":3,"osd_up_since":1771329990,"num_in_osds":3,"osd_in_since":1771329975,"num_remapped_pgs":0} 2026-02-17T12:06:30.600 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T12:06:30.748 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.848+0000 7f3870062640 1 -- 10.20.193.90:0/1407890952 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3868077660 msgr2=0x7f3868077a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.848+0000 7f3870062640 1 --2- 10.20.193.90:0/1407890952 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3868077660 0x7f3868077a40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f38580099b0 tx=0x7f385802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.848+0000 7f3870062640 1 -- 10.20.193.90:0/1407890952 shutdown_connections 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.848+0000 7f3870062640 1 --2- 10.20.193.90:0/1407890952 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3868077660 0x7f3868077a40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.848+0000 7f3870062640 1 -- 10.20.193.90:0/1407890952 >> 10.20.193.90:0/1407890952 conn(0x7f3868100710 msgr2=0x7f3868102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.848+0000 7f3870062640 1 -- 10.20.193.90:0/1407890952 shutdown_connections 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.848+0000 7f3870062640 1 -- 10.20.193.90:0/1407890952 wait complete. 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.848+0000 7f3870062640 1 Processor -- start 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f3870062640 1 -- start start 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f3870062640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3868077660 0x7f38681a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f3870062640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38681125f0 con 0x7f3868077660 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f386ddd7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3868077660 0x7f38681a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f386ddd7640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3868077660 0x7f38681a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:45908/0 (socket says 10.20.193.90:45908) 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f386ddd7640 1 -- 10.20.193.90:0/3470092236 learned_addr learned my addr 10.20.193.90:0/3470092236 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f386ddd7640 1 -- 10.20.193.90:0/3470092236 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38681a5d90 con 0x7f3868077660 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f386ddd7640 1 --2- 10.20.193.90:0/3470092236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3868077660 0x7f38681a5850 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3858004290 tx=0x7f38580042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f3856ffd640 1 -- 10.20.193.90:0/3470092236 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3858038510 con 0x7f3868077660 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f3870062640 1 -- 10.20.193.90:0/3470092236 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38681a6020 con 0x7f3868077660 2026-02-17T12:06:30.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f3856ffd640 1 -- 10.20.193.90:0/3470092236 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3858046070 con 0x7f3868077660 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f3856ffd640 1 -- 10.20.193.90:0/3470092236 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3858041610 con 0x7f3868077660 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.849+0000 7f3870062640 1 -- 10.20.193.90:0/3470092236 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386819fa10 con 0x7f3868077660 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.850+0000 7f3870062640 1 -- 10.20.193.90:0/3470092236 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3868078da0 con 0x7f3868077660 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.850+0000 7f3856ffd640 1 -- 10.20.193.90:0/3470092236 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f3858041910 con 0x7f3868077660 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.850+0000 7f3856ffd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.850+0000 7f3856ffd640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.850+0000 7f3856ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.850+0000 7f3856ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.850+0000 7f3856ffd640 1 --2- 10.20.193.90:0/3470092236 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f384403dc90 0x7f3844040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.850+0000 7f3856ffd640 1 -- 10.20.193.90:0/3470092236 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2629+0+0 (secure 0 0 0) 0x7f3858077690 con 0x7f3868077660 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.850+0000 7f386d5d6640 1 --2- 10.20.193.90:0/3470092236 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f384403dc90 0x7f3844040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:30.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.850+0000 7f386d5d6640 1 --2- 10.20.193.90:0/3470092236 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f384403dc90 0x7f3844040150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f385c0099c0 tx=0x7f385c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:30.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.852+0000 7f3856ffd640 1 -- 10.20.193.90:0/3470092236 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3858035320 con 0x7f3868077660 2026-02-17T12:06:30.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.937+0000 7f3870062640 1 -- 10.20.193.90:0/3470092236 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3868077ac0 con 0x7f3868077660 2026-02-17T12:06:30.938 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.937+0000 7f3856ffd640 1 -- 10.20.193.90:0/3470092236 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+5546 (secure 0 0 0) 0x7f385804a3c0 con 0x7f3868077660 2026-02-17T12:06:30.939 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:30.939 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":18,"fsid":"ea07e39e-0bf8-11f1-bf0e-d404e6e7d460","created":"2026-02-17T12:05:25.277567+0000","modified":"2026-02-17T12:06:30.457165+0000","last_up_change":"2026-02-17T12:06:30.457165+0000","last_in_change":"2026-02-17T12:06:15.874673+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"909678ba-587a-477a-b1a4-beaa075742ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6803","nonce":3942480641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6805","nonce":3942480641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6809","nonce":3942480641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6807","nonce":3942480641}]},"public_addr":"10.20.193.90:6803/3942480641","cluster_addr":"10.20.193.90:6805/3942480641","heartbeat_back_addr":"10.20.193.90:6809/3942480641","heartbeat_front_addr":"10.20.193.90:6807/3942480641","state":["exists","up"]},{"osd":1,"uuid":"49398bfe-ec6a-46b3-af4b-ca2939b00b7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6811","nonce":1772524063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6813","nonce":1772524063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6817","nonce":1772524063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6815","nonce":1772524063}]},"public_addr":"10.20.193.90:6811/1772524063","cluster_addr":"10.20.193.90:6813/1772524063","heartbeat_back_addr":"10.20.193.90:6817/1772524063","heartbeat_front_addr":"10.20.193.90:6815/1772524063","state":["exists","up"]},{"osd":2,"uuid":"c8541b38-1a42-44f6-a18e-0c5e92857ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6819","nonce":4062360030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6821","nonce":4062360030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6825","nonce":4062360030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6823","nonce":4062360030}]},"public_addr":"10.20.193.90:6819/4062360030","cluster_addr":"10.20.193.90:6821/4062360030","heartbeat_back_addr":"10.20.193.90:6825/4062360030","heartbeat_front_addr":"10.20.193.90:6823/4062360030","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:06:08.730066+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:06:19.619418+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.90:0/864447210":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/3994132165":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/3065885320":"2026-02-18T12:05:43.160791+0000","10.20.193.90:6801/978560331":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/2131755214":"2026-02-18T12:05:34.906112+0000","10.20.193.90:6800/978560331":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/1606486405":"2026-02-18T12:05:34.906112+0000","10.20.193.90:6801/4114489928":"2026-02-18T12:05:34.906112+0000","10.20.193.90:6800/4114489928":"2026-02-18T12:05:34.906112+0000","10.20.193.90:0/1658252301":"2026-02-18T12:05:34.906112+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:06:30.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.938+0000 7f3870062640 10 mgrc shutdown 2026-02-17T12:06:30.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.938+0000 7f3870062640 1 -- 10.20.193.90:0/3470092236 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f384403dc90 msgr2=0x7f3844040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:30.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.938+0000 7f3870062640 1 --2- 10.20.193.90:0/3470092236 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f384403dc90 0x7f3844040150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f385c0099c0 tx=0x7f385c006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.939+0000 7f3870062640 1 -- 10.20.193.90:0/3470092236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3868077660 msgr2=0x7f38681a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:30.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.939+0000 7f3870062640 1 --2- 10.20.193.90:0/3470092236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3868077660 0x7f38681a5850 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3858004290 tx=0x7f38580042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.939+0000 7f3870062640 1 -- 10.20.193.90:0/3470092236 shutdown_connections 2026-02-17T12:06:30.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.939+0000 7f3870062640 1 --2- 10.20.193.90:0/3470092236 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f384403dc90 0x7f3844040150 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.939+0000 7f3870062640 1 --2- 10.20.193.90:0/3470092236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3868077660 0x7f38681a5850 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:30.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.939+0000 7f3870062640 1 -- 10.20.193.90:0/3470092236 >> 10.20.193.90:0/3470092236 conn(0x7f3868100710 msgr2=0x7f38681034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:30.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.939+0000 7f3870062640 1 -- 10.20.193.90:0/3470092236 shutdown_connections 2026-02-17T12:06:30.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:30.939+0000 7f3870062640 1 -- 10.20.193.90:0/3470092236 wait complete. 2026-02-17T12:06:30.974 INFO:tasks.cephadm.ceph_manager.ceph:[] 2026-02-17T12:06:30.974 INFO:tasks.cephadm:Setting up client nodes... 2026-02-17T12:06:30.974 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-17T12:06:31.124 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:31.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.235+0000 7f746aecc640 1 -- 10.20.193.90:0/1471580472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f74640770e0 msgr2=0x7f7464075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:31.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.235+0000 7f746aecc640 1 --2- 10.20.193.90:0/1471580472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f74640770e0 0x7f7464075540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f74540099b0 tx=0x7f745402f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:31.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.235+0000 7f746aecc640 1 -- 10.20.193.90:0/1471580472 shutdown_connections 2026-02-17T12:06:31.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.235+0000 7f746aecc640 1 --2- 10.20.193.90:0/1471580472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f74640770e0 0x7f7464075540 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:31.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.235+0000 7f746aecc640 1 -- 10.20.193.90:0/1471580472 >> 10.20.193.90:0/1471580472 conn(0x7f74640fdbc0 msgr2=0x7f7464100020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:31.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.235+0000 7f746aecc640 1 -- 10.20.193.90:0/1471580472 shutdown_connections 2026-02-17T12:06:31.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.235+0000 7f746aecc640 1 -- 10.20.193.90:0/1471580472 wait complete. 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f746aecc640 1 Processor -- start 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f746aecc640 1 -- start start 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f746aecc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f74640770e0 0x7f746419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f746aecc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7464105620 con 0x7f74640770e0 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f7468c41640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f74640770e0 0x7f746419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f7468c41640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f74640770e0 0x7f746419f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:45938/0 (socket says 10.20.193.90:45938) 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f7468c41640 1 -- 10.20.193.90:0/794183543 learned_addr learned my addr 10.20.193.90:0/794183543 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f7468c41640 1 -- 10.20.193.90:0/794183543 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746419fd10 con 0x7f74640770e0 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f7468c41640 1 --2- 10.20.193.90:0/794183543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f74640770e0 0x7f746419f7d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7454009ae0 tx=0x7f7454004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f7459ffb640 1 -- 10.20.193.90:0/794183543 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454038640 con 0x7f74640770e0 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f746aecc640 1 -- 10.20.193.90:0/794183543 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746419ffa0 con 0x7f74640770e0 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f7459ffb640 1 -- 10.20.193.90:0/794183543 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7454046070 con 0x7f74640770e0 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f7459ffb640 1 -- 10.20.193.90:0/794183543 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7454041780 con 0x7f74640770e0 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.236+0000 7f746aecc640 1 -- 10.20.193.90:0/794183543 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74641a2c90 con 0x7f74640770e0 2026-02-17T12:06:31.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.237+0000 7f746aecc640 1 -- 10.20.193.90:0/794183543 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7464105dc0 con 0x7f74640770e0 2026-02-17T12:06:31.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.237+0000 7f7459ffb640 1 -- 10.20.193.90:0/794183543 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f7454041a00 con 0x7f74640770e0 2026-02-17T12:06:31.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.237+0000 7f7459ffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:31.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.237+0000 7f7459ffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:31.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.237+0000 7f7459ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:31.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.237+0000 7f7459ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:31.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.237+0000 7f7459ffb640 1 --2- 10.20.193.90:0/794183543 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f744003dc90 0x7f7440040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:31.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.237+0000 7f7459ffb640 1 -- 10.20.193.90:0/794183543 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2629+0+0 (secure 0 0 0) 0x7f74540780c0 con 0x7f74640770e0 2026-02-17T12:06:31.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.237+0000 7f745bfff640 1 --2- 10.20.193.90:0/794183543 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f744003dc90 0x7f7440040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:31.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.238+0000 7f745bfff640 1 --2- 10.20.193.90:0/794183543 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f744003dc90 0x7f7440040150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f744c0099c0 tx=0x7f744c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:31.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.240+0000 7f7459ffb640 1 -- 10.20.193.90:0/794183543 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7454050020 con 0x7f74640770e0 2026-02-17T12:06:31.353 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.352+0000 7f746aecc640 1 -- 10.20.193.90:0/794183543 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f7464198dc0 con 0x7f74640770e0 2026-02-17T12:06:31.354 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.353+0000 7f7459ffb640 1 -- 10.20.193.90:0/794183543 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v7) ==== 170+0+59 (secure 0 0 0) 0x7f7454050200 con 0x7f74640770e0 2026-02-17T12:06:31.354 INFO:teuthology.orchestra.run.trial090.stdout:[client.0] 2026-02-17T12:06:31.354 INFO:teuthology.orchestra.run.trial090.stdout: key = AQDHWZRpNrYcFRAAy9Mev8Ju3Zd21aXH/VrOUA== 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 10 mgrc shutdown 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 1 -- 10.20.193.90:0/794183543 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f744003dc90 msgr2=0x7f7440040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 1 --2- 10.20.193.90:0/794183543 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f744003dc90 0x7f7440040150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f744c0099c0 tx=0x7f744c006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 1 -- 10.20.193.90:0/794183543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f74640770e0 msgr2=0x7f746419f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 1 --2- 10.20.193.90:0/794183543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f74640770e0 0x7f746419f7d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7454009ae0 tx=0x7f7454004290 comp rx=0 tx=0).stop 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 1 -- 10.20.193.90:0/794183543 shutdown_connections 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 1 --2- 10.20.193.90:0/794183543 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f744003dc90 0x7f7440040150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 1 --2- 10.20.193.90:0/794183543 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f74640770e0 0x7f746419f7d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 1 -- 10.20.193.90:0/794183543 >> 10.20.193.90:0/794183543 conn(0x7f74640fdbc0 msgr2=0x7f74640fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 1 -- 10.20.193.90:0/794183543 shutdown_connections 2026-02-17T12:06:31.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:31.354+0000 7f746aecc640 1 -- 10.20.193.90:0/794183543 wait complete. 2026-02-17T12:06:31.389 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:06:31.389 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-17T12:06:31.389 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T12:06:31.422 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-17T12:06:31.568 INFO:teuthology.orchestra.run.trial198.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/config/ceph.conf 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 -- 10.20.193.198:0/3363750112 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0db81045f0 msgr2=0x7f0db81049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 --2- 10.20.193.198:0/3363750112 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0db81045f0 0x7f0db81049f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0da80099b0 tx=0x7f0da802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 -- 10.20.193.198:0/3363750112 shutdown_connections 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 --2- 10.20.193.198:0/3363750112 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0db81045f0 0x7f0db81049f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 -- 10.20.193.198:0/3363750112 >> 10.20.193.198:0/3363750112 conn(0x7f0db80ffdb0 msgr2=0x7f0db81021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 -- 10.20.193.198:0/3363750112 shutdown_connections 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 -- 10.20.193.198:0/3363750112 wait complete. 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 Processor -- start 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 -- start start 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0db81045f0 0x7f0db819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:31.682 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbf675640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0db8109a70 con 0x7f0db81045f0 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.677+0000 7f0dbd3ea640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0db81045f0 0x7f0db819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.678+0000 7f0dbd3ea640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0db81045f0 0x7f0db819b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.198:41196/0 (socket says 10.20.193.198:41196) 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.678+0000 7f0dbd3ea640 1 -- 10.20.193.198:0/2301359340 learned_addr learned my addr 10.20.193.198:0/2301359340 (peer_addr_for_me v2:10.20.193.198:0/0) 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.678+0000 7f0dbd3ea640 1 -- 10.20.193.198:0/2301359340 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db819b710 con 0x7f0db81045f0 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.678+0000 7f0dbd3ea640 1 --2- 10.20.193.198:0/2301359340 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0db81045f0 0x7f0db819b1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0da8002410 tx=0x7f0da8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.678+0000 7f0da67fc640 1 -- 10.20.193.198:0/2301359340 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da8038510 con 0x7f0db81045f0 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.678+0000 7f0dbf675640 1 -- 10.20.193.198:0/2301359340 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db819b9a0 con 0x7f0db81045f0 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.678+0000 7f0dbf675640 1 -- 10.20.193.198:0/2301359340 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db819e690 con 0x7f0db81045f0 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.678+0000 7f0da67fc640 1 -- 10.20.193.198:0/2301359340 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f0da8046070 con 0x7f0db81045f0 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.678+0000 7f0da67fc640 1 -- 10.20.193.198:0/2301359340 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da804b460 con 0x7f0db81045f0 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.679+0000 7f0dbf675640 1 -- 10.20.193.198:0/2301359340 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db810a210 con 0x7f0db81045f0 2026-02-17T12:06:31.683 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.679+0000 7f0da67fc640 1 -- 10.20.193.198:0/2301359340 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f0da80386b0 con 0x7f0db81045f0 2026-02-17T12:06:31.684 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.679+0000 7f0da67fc640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:31.684 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.679+0000 7f0da67fc640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:31.684 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.679+0000 7f0da67fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:31.684 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.679+0000 7f0da67fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:31.684 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.679+0000 7f0da67fc640 1 --2- 10.20.193.198:0/2301359340 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f0d9403dce0 0x7f0d940401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:31.684 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.679+0000 7f0da67fc640 1 -- 10.20.193.198:0/2301359340 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3004+0+0 (secure 0 0 0) 0x7f0da80776b0 con 0x7f0db81045f0 2026-02-17T12:06:31.684 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.679+0000 7f0dbcbe9640 1 --2- 10.20.193.198:0/2301359340 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f0d9403dce0 0x7f0d940401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:31.684 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.680+0000 7f0dbcbe9640 1 --2- 10.20.193.198:0/2301359340 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f0d9403dce0 0x7f0d940401a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0099c0 tx=0x7f0dac006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:31.686 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.682+0000 7f0da67fc640 1 -- 10.20.193.198:0/2301359340 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0da8035de0 con 0x7f0db81045f0 2026-02-17T12:06:31.798 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.793+0000 7f0dbf675640 1 -- 10.20.193.198:0/2301359340 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f0db81947d0 con 0x7f0db81045f0 2026-02-17T12:06:31.798 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.794+0000 7f0da67fc640 1 -- 10.20.193.198:0/2301359340 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v8) ==== 170+0+59 (secure 0 0 0) 0x7f0da80389d0 con 0x7f0db81045f0 2026-02-17T12:06:31.799 INFO:teuthology.orchestra.run.trial198.stdout:[client.1] 2026-02-17T12:06:31.799 INFO:teuthology.orchestra.run.trial198.stdout: key = AQDHWZRpsFyVLxAAs3VrYryJ54YRFFerli/vYQ== 2026-02-17T12:06:31.800 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.794+0000 7f0dbf675640 10 mgrc shutdown 2026-02-17T12:06:31.800 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.794+0000 7f0dbf675640 1 -- 10.20.193.198:0/2301359340 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f0d9403dce0 msgr2=0x7f0d940401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:31.800 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.794+0000 7f0dbf675640 1 --2- 10.20.193.198:0/2301359340 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f0d9403dce0 0x7f0d940401a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0099c0 tx=0x7f0dac006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:31.800 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.795+0000 7f0dbf675640 1 -- 10.20.193.198:0/2301359340 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0db81045f0 msgr2=0x7f0db819b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:31.800 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.795+0000 7f0dbf675640 1 --2- 10.20.193.198:0/2301359340 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0db81045f0 0x7f0db819b1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0da8002410 tx=0x7f0da8004290 comp rx=0 tx=0).stop 2026-02-17T12:06:31.801 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.795+0000 7f0dbf675640 1 -- 10.20.193.198:0/2301359340 shutdown_connections 2026-02-17T12:06:31.801 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.795+0000 7f0dbf675640 1 --2- 10.20.193.198:0/2301359340 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f0d9403dce0 0x7f0d940401a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:31.801 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.795+0000 7f0dbf675640 1 --2- 10.20.193.198:0/2301359340 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0db81045f0 0x7f0db819b1d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:31.801 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.795+0000 7f0dbf675640 1 -- 10.20.193.198:0/2301359340 >> 10.20.193.198:0/2301359340 conn(0x7f0db80ffdb0 msgr2=0x7f0db81003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:31.801 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.795+0000 7f0dbf675640 1 -- 10.20.193.198:0/2301359340 shutdown_connections 2026-02-17T12:06:31.801 INFO:teuthology.orchestra.run.trial198.stderr:2026-02-17T12:06:31.795+0000 7f0dbf675640 1 -- 10.20.193.198:0/2301359340 wait complete. 2026-02-17T12:06:31.829 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:31 trial090 ceph-mon[39228]: purged_snaps scrub starts 2026-02-17T12:06:31.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:31 trial090 ceph-mon[39228]: purged_snaps scrub ok 2026-02-17T12:06:31.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:31 trial090 ceph-mon[39228]: osd.2 [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030] boot 2026-02-17T12:06:31.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:31 trial090 ceph-mon[39228]: osdmap e18: 3 total, 3 up, 3 in 2026-02-17T12:06:31.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:31 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T12:06:31.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:31 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/2339761469' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T12:06:31.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:31 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3470092236' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:06:31.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:31 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-17T12:06:31.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:31 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/794183543' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T12:06:31.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:31 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/794183543' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T12:06:31.837 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:06:31.837 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-17T12:06:31.837 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-17T12:06:31.914 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T12:06:31.915 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-17T12:06:31.915 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-17T12:06:32.067 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/4280472941 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fb810a680 msgr2=0x7f7fb810aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 --2- 10.20.193.90:0/4280472941 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fb810a680 0x7f7fb810aa60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80099b0 tx=0x7f7fa802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/4280472941 shutdown_connections 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 --2- 10.20.193.90:0/4280472941 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fb810a680 0x7f7fb810aa60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/4280472941 >> 10.20.193.90:0/4280472941 conn(0x7f7fb8100710 msgr2=0x7f7fb8102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/4280472941 shutdown_connections 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/4280472941 wait complete. 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 Processor -- start 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 -- start start 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fb810a680 0x7f7fb819b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbfb2f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb810e090 con 0x7f7fb810a680 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.165+0000 7f7fbd8a4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fb810a680 0x7f7fb819b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fbd8a4640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fb810a680 0x7f7fb819b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:45960/0 (socket says 10.20.193.90:45960) 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fbd8a4640 1 -- 10.20.193.90:0/3000779021 learned_addr learned my addr 10.20.193.90:0/3000779021 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:32.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fbd8a4640 1 -- 10.20.193.90:0/3000779021 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb819bbd0 con 0x7f7fb810a680 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fbd8a4640 1 --2- 10.20.193.90:0/3000779021 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fb810a680 0x7f7fb819b690 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8004290 tx=0x7f7fa80042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fa6ffd640 1 -- 10.20.193.90:0/3000779021 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa8038510 con 0x7f7fb810a680 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fa6ffd640 1 -- 10.20.193.90:0/3000779021 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7fa8046070 con 0x7f7fb810a680 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/3000779021 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb819be60 con 0x7f7fb810a680 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fa6ffd640 1 -- 10.20.193.90:0/3000779021 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa8041610 con 0x7f7fb810a680 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/3000779021 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb819ff60 con 0x7f7fb810a680 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/3000779021 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb8105dc0 con 0x7f7fb810a680 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fa6ffd640 1 -- 10.20.193.90:0/3000779021 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f7fa80418c0 con 0x7f7fb810a680 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.166+0000 7f7fa6ffd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.167+0000 7f7fa6ffd640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.167+0000 7f7fa6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.167+0000 7f7fa6ffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.167+0000 7f7fa6ffd640 1 --2- 10.20.193.90:0/3000779021 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f7f9403dce0 0x7f7f940401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.167+0000 7f7fa6ffd640 1 -- 10.20.193.90:0/3000779021 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3004+0+0 (secure 0 0 0) 0x7f7fa80779e0 con 0x7f7fb810a680 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.167+0000 7f7fbd0a3640 1 --2- 10.20.193.90:0/3000779021 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f7f9403dce0 0x7f7f940401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:32.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.167+0000 7f7fbd0a3640 1 --2- 10.20.193.90:0/3000779021 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f7f9403dce0 0x7f7f940401a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0099c0 tx=0x7f7fac006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:32.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.169+0000 7f7fa6ffd640 1 -- 10.20.193.90:0/3000779021 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7fa8035320 con 0x7f7fb810a680 2026-02-17T12:06:32.272 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.272+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/3000779021 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7fb810aae0 con 0x7f7fb810a680 2026-02-17T12:06:32.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.273+0000 7f7fa6ffd640 1 -- 10.20.193.90:0/3000779021 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v13) ==== 74+0+96689 (secure 0 0 0) 0x7f7fa8040360 con 0x7f7fb810a680 2026-02-17T12:06:32.274 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 10 mgrc shutdown 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/3000779021 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f7f9403dce0 msgr2=0x7f7f940401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 1 --2- 10.20.193.90:0/3000779021 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f7f9403dce0 0x7f7f940401a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0099c0 tx=0x7f7fac006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/3000779021 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fb810a680 msgr2=0x7f7fb819b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 1 --2- 10.20.193.90:0/3000779021 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fb810a680 0x7f7fb819b690 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8004290 tx=0x7f7fa80042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/3000779021 shutdown_connections 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 1 --2- 10.20.193.90:0/3000779021 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f7f9403dce0 0x7f7f940401a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 1 --2- 10.20.193.90:0/3000779021 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7fb810a680 0x7f7fb819b690 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/3000779021 >> 10.20.193.90:0/3000779021 conn(0x7f7fb8100710 msgr2=0x7f7fb8106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/3000779021 shutdown_connections 2026-02-17T12:06:32.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.274+0000 7f7fbfb2f640 1 -- 10.20.193.90:0/3000779021 wait complete. 2026-02-17T12:06:32.310 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":13,"flags":0,"active_gid":14150,"active_name":"a","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":3256128927},{"type":"v1","addr":"10.20.193.90:6801","nonce":3256128927}]},"active_addr":"10.20.193.90:6801/3256128927","active_change":"2026-02-17T12:05:43.160883+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.90:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.90:0","nonce":260968192}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.90:0","nonce":282100834}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.90:0","nonce":11820595}]}]} 2026-02-17T12:06:32.311 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-17T12:06:32.311 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-17T12:06:32.312 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T12:06:32.461 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:32.559 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.558+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4292400928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcd8410a690 msgr2=0x7fcd8410aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:32.559 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.558+0000 7fcd8a2bd640 1 --2- 10.20.193.90:0/4292400928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcd8410a690 0x7fcd8410aa70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcd700099b0 tx=0x7fcd7002f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.559 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.558+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4292400928 shutdown_connections 2026-02-17T12:06:32.559 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.558+0000 7fcd8a2bd640 1 --2- 10.20.193.90:0/4292400928 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcd8410a690 0x7fcd8410aa70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.559 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.558+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4292400928 >> 10.20.193.90:0/4292400928 conn(0x7fcd84100370 msgr2=0x7fcd84102790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:32.559 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.558+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4292400928 shutdown_connections 2026-02-17T12:06:32.559 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.558+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4292400928 wait complete. 2026-02-17T12:06:32.560 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:32 trial090 ceph-mon[39228]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T12:06:32.560 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:32 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-17T12:06:32.560 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:32 trial090 ceph-mon[39228]: osdmap e19: 3 total, 3 up, 3 in 2026-02-17T12:06:32.560 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:32 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-17T12:06:32.560 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:32 trial090 ceph-mon[39228]: from='client.? 10.20.193.198:0/2301359340' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T12:06:32.560 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:32 trial090 ceph-mon[39228]: from='client.? 10.20.193.198:0/2301359340' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T12:06:32.560 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:32 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3000779021' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd8a2bd640 1 Processor -- start 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd8a2bd640 1 -- start start 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd8a2bd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcd8410a690 0x7fcd8419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd8a2bd640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8410e0a0 con 0x7fcd8410a690 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd83fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcd8410a690 0x7fcd8419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd83fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcd8410a690 0x7fcd8419b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:45970/0 (socket says 10.20.193.90:45970) 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd83fff640 1 -- 10.20.193.90:0/4133656182 learned_addr learned my addr 10.20.193.90:0/4133656182 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd83fff640 1 -- 10.20.193.90:0/4133656182 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8419bbb0 con 0x7fcd8410a690 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd83fff640 1 --2- 10.20.193.90:0/4133656182 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcd8410a690 0x7fcd8419b670 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd70004290 tx=0x7fcd700042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd817fa640 1 -- 10.20.193.90:0/4133656182 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd70038510 con 0x7fcd8410a690 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4133656182 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8419be40 con 0x7fcd8410a690 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd817fa640 1 -- 10.20.193.90:0/4133656182 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fcd70046070 con 0x7fcd8410a690 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd817fa640 1 -- 10.20.193.90:0/4133656182 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd70041610 con 0x7fcd8410a690 2026-02-17T12:06:32.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.559+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4133656182 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8419ff40 con 0x7fcd8410a690 2026-02-17T12:06:32.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.560+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4133656182 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd84105dd0 con 0x7fcd8410a690 2026-02-17T12:06:32.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.560+0000 7fcd817fa640 1 -- 10.20.193.90:0/4133656182 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fcd700386b0 con 0x7fcd8410a690 2026-02-17T12:06:32.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.560+0000 7fcd817fa640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:32.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.560+0000 7fcd817fa640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:32.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.560+0000 7fcd817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:32.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.560+0000 7fcd817fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:32.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.560+0000 7fcd817fa640 1 --2- 10.20.193.90:0/4133656182 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcd5803dce0 0x7fcd580401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:32.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.560+0000 7fcd817fa640 1 -- 10.20.193.90:0/4133656182 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7fcd70077720 con 0x7fcd8410a690 2026-02-17T12:06:32.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.560+0000 7fcd837fe640 1 --2- 10.20.193.90:0/4133656182 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcd5803dce0 0x7fcd580401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:32.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.561+0000 7fcd837fe640 1 --2- 10.20.193.90:0/4133656182 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcd5803dce0 0x7fcd580401a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcd740099c0 tx=0x7fcd74006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:32.564 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.563+0000 7fcd817fa640 1 -- 10.20.193.90:0/4133656182 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcd70050020 con 0x7fcd8410a690 2026-02-17T12:06:32.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.646+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4133656182 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd8410aaf0 con 0x7fcd8410a690 2026-02-17T12:06:32.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.646+0000 7fcd817fa640 1 -- 10.20.193.90:0/4133656182 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+7394 (secure 0 0 0) 0x7fcd70040360 con 0x7fcd8410a690 2026-02-17T12:06:32.648 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:32.648 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":20,"fsid":"ea07e39e-0bf8-11f1-bf0e-d404e6e7d460","created":"2026-02-17T12:05:25.277567+0000","modified":"2026-02-17T12:06:32.461909+0000","last_up_change":"2026-02-17T12:06:30.457165+0000","last_in_change":"2026-02-17T12:06:15.874673+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T12:06:31.190396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"909678ba-587a-477a-b1a4-beaa075742ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6803","nonce":3942480641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6805","nonce":3942480641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6809","nonce":3942480641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6807","nonce":3942480641}]},"public_addr":"10.20.193.90:6803/3942480641","cluster_addr":"10.20.193.90:6805/3942480641","heartbeat_back_addr":"10.20.193.90:6809/3942480641","heartbeat_front_addr":"10.20.193.90:6807/3942480641","state":["exists","up"]},{"osd":1,"uuid":"49398bfe-ec6a-46b3-af4b-ca2939b00b7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6811","nonce":1772524063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6813","nonce":1772524063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6817","nonce":1772524063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6815","nonce":1772524063}]},"public_addr":"10.20.193.90:6811/1772524063","cluster_addr":"10.20.193.90:6813/1772524063","heartbeat_back_addr":"10.20.193.90:6817/1772524063","heartbeat_front_addr":"10.20.193.90:6815/1772524063","state":["exists","up"]},{"osd":2,"uuid":"c8541b38-1a42-44f6-a18e-0c5e92857ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6819","nonce":4062360030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6821","nonce":4062360030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6825","nonce":4062360030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6823","nonce":4062360030}]},"public_addr":"10.20.193.90:6819/4062360030","cluster_addr":"10.20.193.90:6821/4062360030","heartbeat_back_addr":"10.20.193.90:6825/4062360030","heartbeat_front_addr":"10.20.193.90:6823/4062360030","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:06:08.730066+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:06:19.619418+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:06:28.957179+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.90:0/864447210":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/3994132165":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/3065885320":"2026-02-18T12:05:43.160791+0000","10.20.193.90:6801/978560331":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/2131755214":"2026-02-18T12:05:34.906112+0000","10.20.193.90:6800/978560331":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/1606486405":"2026-02-18T12:05:34.906112+0000","10.20.193.90:6801/4114489928":"2026-02-18T12:05:34.906112+0000","10.20.193.90:6800/4114489928":"2026-02-18T12:05:34.906112+0000","10.20.193.90:0/1658252301":"2026-02-18T12:05:34.906112+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:06:32.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 10 mgrc shutdown 2026-02-17T12:06:32.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4133656182 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcd5803dce0 msgr2=0x7fcd580401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:32.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 1 --2- 10.20.193.90:0/4133656182 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcd5803dce0 0x7fcd580401a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcd740099c0 tx=0x7fcd74006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4133656182 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcd8410a690 msgr2=0x7fcd8419b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:32.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 1 --2- 10.20.193.90:0/4133656182 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcd8410a690 0x7fcd8419b670 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd70004290 tx=0x7fcd700042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4133656182 shutdown_connections 2026-02-17T12:06:32.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 1 --2- 10.20.193.90:0/4133656182 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fcd5803dce0 0x7fcd580401a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 1 --2- 10.20.193.90:0/4133656182 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcd8410a690 0x7fcd8419b670 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4133656182 >> 10.20.193.90:0/4133656182 conn(0x7fcd84100370 msgr2=0x7fcd84108870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:32.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4133656182 shutdown_connections 2026-02-17T12:06:32.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.647+0000 7fcd8a2bd640 1 -- 10.20.193.90:0/4133656182 wait complete. 2026-02-17T12:06:32.684 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-17T12:06:32.684 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T12:06:32.832 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:32.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 -- 10.20.193.90:0/2708895799 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f208410a680 msgr2=0x7f208410aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:32.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 --2- 10.20.193.90:0/2708895799 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f208410a680 0x7f208410aa60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f20780099b0 tx=0x7f207802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 -- 10.20.193.90:0/2708895799 shutdown_connections 2026-02-17T12:06:32.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 --2- 10.20.193.90:0/2708895799 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f208410a680 0x7f208410aa60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 -- 10.20.193.90:0/2708895799 >> 10.20.193.90:0/2708895799 conn(0x7f2084100710 msgr2=0x7f2084102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 -- 10.20.193.90:0/2708895799 shutdown_connections 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 -- 10.20.193.90:0/2708895799 wait complete. 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 Processor -- start 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 -- start start 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f208410a680 0x7f208419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.938+0000 7f2088b7f640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f208410e090 con 0x7f208410a680 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f2082575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f208410a680 0x7f208419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f2082575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f208410a680 0x7f208419b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:45982/0 (socket says 10.20.193.90:45982) 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f2082575640 1 -- 10.20.193.90:0/4172535945 learned_addr learned my addr 10.20.193.90:0/4172535945 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:32.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f2082575640 1 -- 10.20.193.90:0/4172535945 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208419bbd0 con 0x7f208410a680 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f2082575640 1 --2- 10.20.193.90:0/4172535945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f208410a680 0x7f208419b690 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2078004290 tx=0x7f20780042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f206b7fe640 1 -- 10.20.193.90:0/4172535945 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2078038510 con 0x7f208410a680 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f2088b7f640 1 -- 10.20.193.90:0/4172535945 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f208419be60 con 0x7f208410a680 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f206b7fe640 1 -- 10.20.193.90:0/4172535945 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f2078046070 con 0x7f208410a680 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f206b7fe640 1 -- 10.20.193.90:0/4172535945 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2078041610 con 0x7f208410a680 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f2088b7f640 1 -- 10.20.193.90:0/4172535945 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f208419ff60 con 0x7f208410a680 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.939+0000 7f2088b7f640 1 -- 10.20.193.90:0/4172535945 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2084105dc0 con 0x7f208410a680 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.940+0000 7f206b7fe640 1 -- 10.20.193.90:0/4172535945 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f20780386b0 con 0x7f208410a680 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.940+0000 7f206b7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.940+0000 7f206b7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.940+0000 7f206b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.940+0000 7f206b7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:32.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.940+0000 7f206b7fe640 1 --2- 10.20.193.90:0/4172535945 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f205c03dce0 0x7f205c0401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:32.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.940+0000 7f206b7fe640 1 -- 10.20.193.90:0/4172535945 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7f2078077780 con 0x7f208410a680 2026-02-17T12:06:32.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.940+0000 7f2081d74640 1 --2- 10.20.193.90:0/4172535945 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f205c03dce0 0x7f205c0401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:32.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.940+0000 7f2081d74640 1 --2- 10.20.193.90:0/4172535945 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f205c03dce0 0x7f205c0401a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f206c0099c0 tx=0x7f206c006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:32.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:32.942+0000 7f206b7fe640 1 -- 10.20.193.90:0/4172535945 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2078040360 con 0x7f208410a680 2026-02-17T12:06:33.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.031+0000 7f2088b7f640 1 -- 10.20.193.90:0/4172535945 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f208410aae0 con 0x7f208410a680 2026-02-17T12:06:33.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.031+0000 7f206b7fe640 1 -- 10.20.193.90:0/4172535945 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+7394 (secure 0 0 0) 0x7f2078049360 con 0x7f208410a680 2026-02-17T12:06:33.033 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:33.033 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":20,"fsid":"ea07e39e-0bf8-11f1-bf0e-d404e6e7d460","created":"2026-02-17T12:05:25.277567+0000","modified":"2026-02-17T12:06:32.461909+0000","last_up_change":"2026-02-17T12:06:30.457165+0000","last_in_change":"2026-02-17T12:06:15.874673+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T12:06:31.190396+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"909678ba-587a-477a-b1a4-beaa075742ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6803","nonce":3942480641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6805","nonce":3942480641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6809","nonce":3942480641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":3942480641},{"type":"v1","addr":"10.20.193.90:6807","nonce":3942480641}]},"public_addr":"10.20.193.90:6803/3942480641","cluster_addr":"10.20.193.90:6805/3942480641","heartbeat_back_addr":"10.20.193.90:6809/3942480641","heartbeat_front_addr":"10.20.193.90:6807/3942480641","state":["exists","up"]},{"osd":1,"uuid":"49398bfe-ec6a-46b3-af4b-ca2939b00b7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6811","nonce":1772524063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6813","nonce":1772524063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6817","nonce":1772524063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":1772524063},{"type":"v1","addr":"10.20.193.90:6815","nonce":1772524063}]},"public_addr":"10.20.193.90:6811/1772524063","cluster_addr":"10.20.193.90:6813/1772524063","heartbeat_back_addr":"10.20.193.90:6817/1772524063","heartbeat_front_addr":"10.20.193.90:6815/1772524063","state":["exists","up"]},{"osd":2,"uuid":"c8541b38-1a42-44f6-a18e-0c5e92857ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6819","nonce":4062360030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6821","nonce":4062360030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6825","nonce":4062360030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":4062360030},{"type":"v1","addr":"10.20.193.90:6823","nonce":4062360030}]},"public_addr":"10.20.193.90:6819/4062360030","cluster_addr":"10.20.193.90:6821/4062360030","heartbeat_back_addr":"10.20.193.90:6825/4062360030","heartbeat_front_addr":"10.20.193.90:6823/4062360030","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:06:08.730066+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:06:19.619418+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T12:06:28.957179+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.90:0/864447210":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/3994132165":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/3065885320":"2026-02-18T12:05:43.160791+0000","10.20.193.90:6801/978560331":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/2131755214":"2026-02-18T12:05:34.906112+0000","10.20.193.90:6800/978560331":"2026-02-18T12:05:43.160791+0000","10.20.193.90:0/1606486405":"2026-02-18T12:05:34.906112+0000","10.20.193.90:6801/4114489928":"2026-02-18T12:05:34.906112+0000","10.20.193.90:6800/4114489928":"2026-02-18T12:05:34.906112+0000","10.20.193.90:0/1658252301":"2026-02-18T12:05:34.906112+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T12:06:33.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.032+0000 7f2088b7f640 10 mgrc shutdown 2026-02-17T12:06:33.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.032+0000 7f2088b7f640 1 -- 10.20.193.90:0/4172535945 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f205c03dce0 msgr2=0x7f205c0401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.032+0000 7f2088b7f640 1 --2- 10.20.193.90:0/4172535945 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f205c03dce0 0x7f205c0401a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f206c0099c0 tx=0x7f206c006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.032+0000 7f2088b7f640 1 -- 10.20.193.90:0/4172535945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f208410a680 msgr2=0x7f208419b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.032+0000 7f2088b7f640 1 --2- 10.20.193.90:0/4172535945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f208410a680 0x7f208419b690 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2078004290 tx=0x7f20780042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.033+0000 7f2088b7f640 1 -- 10.20.193.90:0/4172535945 shutdown_connections 2026-02-17T12:06:33.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.033+0000 7f2088b7f640 1 --2- 10.20.193.90:0/4172535945 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f205c03dce0 0x7f205c0401a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.033+0000 7f2088b7f640 1 --2- 10.20.193.90:0/4172535945 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f208410a680 0x7f208419b690 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.033+0000 7f2088b7f640 1 -- 10.20.193.90:0/4172535945 >> 10.20.193.90:0/4172535945 conn(0x7f2084100710 msgr2=0x7f2084106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.033+0000 7f2088b7f640 1 -- 10.20.193.90:0/4172535945 shutdown_connections 2026-02-17T12:06:33.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.033+0000 7f2088b7f640 1 -- 10.20.193.90:0/4172535945 wait complete. 2026-02-17T12:06:33.070 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-17T12:06:33.071 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-17T12:06:33.071 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-17T12:06:33.119 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:32 trial090 sudo[67696]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-17T12:06:33.119 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:32 trial090 sudo[67696]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:06:33.120 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:32 trial090 sudo[67696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:06:33.120 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67696]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:06:33.120 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67700]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-17T12:06:33.120 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67700]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:06:33.120 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:06:33.120 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67700]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:06:33.120 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67704]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-17T12:06:33.121 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67704]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:06:33.121 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:06:33.121 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67704]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:06:33.121 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67717]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-17T12:06:33.121 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67717]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:06:33.121 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:06:33.121 INFO:journalctl@ceph.osd.1.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67717]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:06:33.121 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67729]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-17T12:06:33.121 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67729]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:06:33.122 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:06:33.122 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67729]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:06:33.122 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67799]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-17T12:06:33.122 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67799]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:06:33.122 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:06:33.122 INFO:journalctl@ceph.osd.2.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67799]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:06:33.229 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:33.230 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:33.230 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:33.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.343+0000 7fa1af09d640 1 -- 10.20.193.90:0/2786626555 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1a8108470 msgr2=0x7fa1a8108850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.343+0000 7fa1af09d640 1 --2- 10.20.193.90:0/2786626555 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1a8108470 0x7fa1a8108850 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa1980099b0 tx=0x7fa19802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1af09d640 1 -- 10.20.193.90:0/2786626555 shutdown_connections 2026-02-17T12:06:33.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1af09d640 1 --2- 10.20.193.90:0/2786626555 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1a8108470 0x7fa1a8108850 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1af09d640 1 -- 10.20.193.90:0/2786626555 >> 10.20.193.90:0/2786626555 conn(0x7fa1a8079280 msgr2=0x7fa1a8100550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1af09d640 1 -- 10.20.193.90:0/2786626555 shutdown_connections 2026-02-17T12:06:33.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1af09d640 1 -- 10.20.193.90:0/2786626555 wait complete. 2026-02-17T12:06:33.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1af09d640 1 Processor -- start 2026-02-17T12:06:33.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1af09d640 1 -- start start 2026-02-17T12:06:33.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1af09d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1a8108470 0x7fa1a8199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1af09d640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a810bdf0 con 0x7fa1a8108470 2026-02-17T12:06:33.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fca73c65640 1 -- 10.20.193.90:0/4260629092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fca6c10a680 msgr2=0x7fca6c10aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fca73c65640 1 --2- 10.20.193.90:0/4260629092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fca6c10a680 0x7fca6c10aa60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0099b0 tx=0x7fca5c02f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fca73c65640 1 -- 10.20.193.90:0/4260629092 shutdown_connections 2026-02-17T12:06:33.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fca73c65640 1 --2- 10.20.193.90:0/4260629092 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fca6c10a680 0x7fca6c10aa60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fca73c65640 1 -- 10.20.193.90:0/4260629092 >> 10.20.193.90:0/4260629092 conn(0x7fca6c100710 msgr2=0x7fca6c102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1ace12640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1a8108470 0x7fa1a8199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1ace12640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1a8108470 0x7fa1a8199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:46038/0 (socket says 10.20.193.90:46038) 2026-02-17T12:06:33.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1ace12640 1 -- 10.20.193.90:0/3883592156 learned_addr learned my addr 10.20.193.90:0/3883592156 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:33.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fca73c65640 1 -- 10.20.193.90:0/4260629092 shutdown_connections 2026-02-17T12:06:33.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fca73c65640 1 -- 10.20.193.90:0/4260629092 wait complete. 2026-02-17T12:06:33.349 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1ace12640 1 -- 10.20.193.90:0/3883592156 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a8199940 con 0x7fa1a8108470 2026-02-17T12:06:33.349 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.344+0000 7fa1ace12640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1a8108470 0x7fa1a8199400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa198005ec0 tx=0x7fa198004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.349 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 1 -- 10.20.193.90:0/3883592156 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa198047070 con 0x7fa1a8108470 2026-02-17T12:06:33.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a8199bd0 con 0x7fa1a8108470 2026-02-17T12:06:33.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 1 -- 10.20.193.90:0/3883592156 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fa19803e070 con 0x7fa1a8108470 2026-02-17T12:06:33.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 1 -- 10.20.193.90:0/3883592156 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa198042770 con 0x7fa1a8108470 2026-02-17T12:06:33.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca73c65640 1 Processor -- start 2026-02-17T12:06:33.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a819dcd0 con 0x7fa1a8108470 2026-02-17T12:06:33.351 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca73c65640 1 -- start start 2026-02-17T12:06:33.351 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca73c65640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fca6c10a680 0x7fca6c19b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.351 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca73c65640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c10e090 con 0x7fca6c10a680 2026-02-17T12:06:33.352 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7efd196fc640 1 -- 10.20.193.90:0/3531590034 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd1410a680 msgr2=0x7efd1410aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.352 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7efd196fc640 1 --2- 10.20.193.90:0/3531590034 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd1410a680 0x7efd1410aa60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efd080099b0 tx=0x7efd0802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.352 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7efd196fc640 1 -- 10.20.193.90:0/3531590034 shutdown_connections 2026-02-17T12:06:33.352 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7efd196fc640 1 --2- 10.20.193.90:0/3531590034 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd1410a680 0x7efd1410aa60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.352 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7efd196fc640 1 -- 10.20.193.90:0/3531590034 >> 10.20.193.90:0/3531590034 conn(0x7efd14100710 msgr2=0x7efd14102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.352 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7efd196fc640 1 -- 10.20.193.90:0/3531590034 shutdown_connections 2026-02-17T12:06:33.352 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7efd196fc640 1 -- 10.20.193.90:0/3531590034 wait complete. 2026-02-17T12:06:33.353 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca719da640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fca6c10a680 0x7fca6c19b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.353 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca719da640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fca6c10a680 0x7fca6c19b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:46054/0 (socket says 10.20.193.90:46054) 2026-02-17T12:06:33.353 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca719da640 1 -- 10.20.193.90:0/3976474067 learned_addr learned my addr 10.20.193.90:0/3976474067 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:33.353 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca719da640 1 -- 10.20.193.90:0/3976474067 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6c19bc10 con 0x7fca6c10a680 2026-02-17T12:06:33.354 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1a819a090 con 0x7fa1a8108470 2026-02-17T12:06:33.354 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca719da640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fca6c10a680 0x7fca6c19b6d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fca5c002410 tx=0x7fca5c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.354 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca5affd640 1 -- 10.20.193.90:0/3976474067 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c038510 con 0x7fca6c10a680 2026-02-17T12:06:33.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 1 -- 10.20.193.90:0/3883592156 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fa19804c440 con 0x7fa1a8108470 2026-02-17T12:06:33.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:33.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca5affd640 1 -- 10.20.193.90:0/3976474067 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fca5c046070 con 0x7fca6c10a680 2026-02-17T12:06:33.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6c19bea0 con 0x7fca6c10a680 2026-02-17T12:06:33.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca5affd640 1 -- 10.20.193.90:0/3976474067 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c041630 con 0x7fca6c10a680 2026-02-17T12:06:33.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7efd196fc640 1 Processor -- start 2026-02-17T12:06:33.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca6c19ffa0 con 0x7fca6c10a680 2026-02-17T12:06:33.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7efd196fc640 1 -- start start 2026-02-17T12:06:33.357 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:33.357 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.357 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.357 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa18403dc90 0x7fa184040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.358 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 1 -- 10.20.193.90:0/3883592156 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7fa1980775e0 con 0x7fa1a8108470 2026-02-17T12:06:33.358 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063] conn(0x7fa184042ad0 0x7fa184044f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.358 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 1 -- 10.20.193.90:0/3883592156 --> [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1840455e0 con 0x7fa184042ad0 2026-02-17T12:06:33.358 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.345+0000 7fa19dffb640 1 -- 10.20.193.90:0/3883592156 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa19807e050 con 0x7fa1a8108470 2026-02-17T12:06:33.358 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efd196fc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd1410a680 0x7efd1419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.358 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efd196fc640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7efd1410e090 con 0x7efd1410a680 2026-02-17T12:06:33.359 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fa19ffff640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa18403dc90 0x7fa184040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.359 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fa1ad613640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063] conn(0x7fa184042ad0 0x7fa184044f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.359 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efd12ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd1410a680 0x7efd1419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.359 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efd12ffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd1410a680 0x7efd1419b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:46064/0 (socket says 10.20.193.90:46064) 2026-02-17T12:06:33.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efd12ffd640 1 -- 10.20.193.90:0/407334294 learned_addr learned my addr 10.20.193.90:0/407334294 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:33.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca6c19c360 con 0x7fca6c10a680 2026-02-17T12:06:33.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efd12ffd640 1 -- 10.20.193.90:0/407334294 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1419bc10 con 0x7efd1410a680 2026-02-17T12:06:33.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fa19ffff640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa18403dc90 0x7fa184040150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa1900099c0 tx=0x7fa190006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efd12ffd640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd1410a680 0x7efd1419b6d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd08002410 tx=0x7efd08004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca5affd640 1 -- 10.20.193.90:0/3976474067 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7fca5c0417d0 con 0x7fca6c10a680 2026-02-17T12:06:33.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca5affd640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:33.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fa1ad613640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063] conn(0x7fa184042ad0 0x7fa184044f10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efcf3fff640 1 -- 10.20.193.90:0/407334294 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd08038510 con 0x7efd1410a680 2026-02-17T12:06:33.363 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efcf3fff640 1 -- 10.20.193.90:0/407334294 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7efd08046070 con 0x7efd1410a680 2026-02-17T12:06:33.363 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd1419bea0 con 0x7efd1410a680 2026-02-17T12:06:33.363 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efcf3fff640 1 -- 10.20.193.90:0/407334294 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd08041630 con 0x7efd1410a680 2026-02-17T12:06:33.363 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd1419ffa0 con 0x7efd1410a680 2026-02-17T12:06:33.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca5affd640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:33.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca5affd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca5affd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca5affd640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fca4803dce0 0x7fca480401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca5affd640 1 -- 10.20.193.90:0/3976474067 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7fca5c0778c0 con 0x7fca6c10a680 2026-02-17T12:06:33.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca711d9640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fca4803dce0 0x7fca480401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca5affd640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030] conn(0x7fca48042b20 0x7fca48044f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca5affd640 1 -- 10.20.193.90:0/3976474067 --> [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca5c04ce50 con 0x7fca48042b20 2026-02-17T12:06:33.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca5affd640 1 -- 10.20.193.90:0/3976474067 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fca5c07e050 con 0x7fca6c10a680 2026-02-17T12:06:33.365 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd1419c360 con 0x7efd1410a680 2026-02-17T12:06:33.365 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca721db640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030] conn(0x7fca48042b20 0x7fca48044f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.365 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efcf3fff640 1 -- 10.20.193.90:0/407334294 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7efd080417d0 con 0x7efd1410a680 2026-02-17T12:06:33.365 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7efcf3fff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:33.366 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fa19dffb640 1 -- 10.20.193.90:0/3883592156 <== osd.1 v2:10.20.193.90:6810/1772524063 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fa1840455e0 con 0x7fa184042ad0 2026-02-17T12:06:33.366 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.346+0000 7fca711d9640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fca4803dce0 0x7fca480401a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fca600099c0 tx=0x7fca60006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.366 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efcf3fff640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:33.366 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efcf3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7fca721db640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030] conn(0x7fca48042b20 0x7fca48044f60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efcf3fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efcf3fff640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7efce803dce0 0x7efce80401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efcf3fff640 1 -- 10.20.193.90:0/407334294 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3015+0+0 (secure 0 0 0) 0x7efd080777a0 con 0x7efd1410a680 2026-02-17T12:06:33.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efd127fc640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7efce803dce0 0x7efce80401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efcf3fff640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641] conn(0x7efce8042b20 0x7efce8044f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efcf3fff640 1 -- 10.20.193.90:0/407334294 --> [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd0804de70 con 0x7efce8042b20 2026-02-17T12:06:33.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efcf3fff640 1 -- 10.20.193.90:0/407334294 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efd0807e050 con 0x7efd1410a680 2026-02-17T12:06:33.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efd137fe640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641] conn(0x7efce8042b20 0x7efce8044f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efd127fc640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7efce803dce0 0x7efce80401a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0099c0 tx=0x7efcfc006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7fca5affd640 1 -- 10.20.193.90:0/3976474067 <== osd.2 v2:10.20.193.90:6818/4062360030 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fca5c04ce50 con 0x7fca48042b20 2026-02-17T12:06:33.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.347+0000 7efd137fe640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641] conn(0x7efce8042b20 0x7efce8044f60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.348+0000 7efcf3fff640 1 -- 10.20.193.90:0/407334294 <== osd.0 v2:10.20.193.90:6802/3942480641 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7efd0804de70 con 0x7efce8042b20 2026-02-17T12:06:33.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 --> [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa1a819e480 con 0x7fa184042ad0 2026-02-17T12:06:33.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa19dffb640 1 -- 10.20.193.90:0/3883592156 <== osd.1 v2:10.20.193.90:6810/1772524063 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa1a819e480 con 0x7fa184042ad0 2026-02-17T12:06:33.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063] conn(0x7fa184042ad0 msgr2=0x7fa184044f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063] conn(0x7fa184042ad0 0x7fa184044f10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 10 mgrc shutdown 2026-02-17T12:06:33.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa18403dc90 msgr2=0x7fa184040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa18403dc90 0x7fa184040150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa1900099c0 tx=0x7fa190006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1a8108470 msgr2=0x7fa1a8199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1a8108470 0x7fa1a8199400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa198005ec0 tx=0x7fa198004290 comp rx=0 tx=0).stop 2026-02-17T12:06:33.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 shutdown_connections 2026-02-17T12:06:33.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6810/1772524063,v1:10.20.193.90:6811/1772524063] conn(0x7fa184042ad0 0x7fa184044f10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fa18403dc90 0x7fa184040150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 --2- 10.20.193.90:0/3883592156 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1a8108470 0x7fa1a8199400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 >> 10.20.193.90:0/3883592156 conn(0x7fa1a8079280 msgr2=0x7fa1a81066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 shutdown_connections 2026-02-17T12:06:33.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.353+0000 7fa1af09d640 1 -- 10.20.193.90:0/3883592156 wait complete. 2026-02-17T12:06:33.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 --> [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca6c1a0750 con 0x7fca48042b20 2026-02-17T12:06:33.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca5affd640 1 -- 10.20.193.90:0/3976474067 <== osd.2 v2:10.20.193.90:6818/4062360030 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fca6c1a0750 con 0x7fca48042b20 2026-02-17T12:06:33.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 --> [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd141a0750 con 0x7efce8042b20 2026-02-17T12:06:33.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030] conn(0x7fca48042b20 msgr2=0x7fca48044f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030] conn(0x7fca48042b20 0x7fca48044f60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 10 mgrc shutdown 2026-02-17T12:06:33.375 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7efcf3fff640 1 -- 10.20.193.90:0/407334294 <== osd.0 v2:10.20.193.90:6802/3942480641 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efd141a0750 con 0x7efce8042b20 2026-02-17T12:06:33.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fca4803dce0 msgr2=0x7fca480401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fca4803dce0 0x7fca480401a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fca600099c0 tx=0x7fca60006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fca6c10a680 msgr2=0x7fca6c19b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fca6c10a680 0x7fca6c19b6d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fca5c002410 tx=0x7fca5c004290 comp rx=0 tx=0).stop 2026-02-17T12:06:33.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 shutdown_connections 2026-02-17T12:06:33.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6818/4062360030,v1:10.20.193.90:6819/4062360030] conn(0x7fca48042b20 0x7fca48044f60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fca4803dce0 0x7fca480401a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 --2- 10.20.193.90:0/3976474067 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fca6c10a680 0x7fca6c19b6d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 >> 10.20.193.90:0/3976474067 conn(0x7fca6c100710 msgr2=0x7fca6c106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.377 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 shutdown_connections 2026-02-17T12:06:33.377 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641] conn(0x7efce8042b20 msgr2=0x7efce8044f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.377 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7efd196fc640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641] conn(0x7efce8042b20 0x7efce8044f60 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.377 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7fca73c65640 1 -- 10.20.193.90:0/3976474067 wait complete. 2026-02-17T12:06:33.378 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.354+0000 7efd196fc640 10 mgrc shutdown 2026-02-17T12:06:33.378 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7efce803dce0 msgr2=0x7efce80401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.378 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7efce803dce0 0x7efce80401a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0099c0 tx=0x7efcfc006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.378 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd1410a680 msgr2=0x7efd1419b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.378 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd1410a680 0x7efd1419b6d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd08002410 tx=0x7efd08004290 comp rx=0 tx=0).stop 2026-02-17T12:06:33.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 shutdown_connections 2026-02-17T12:06:33.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7efce803dce0 0x7efce80401a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:6802/3942480641,v1:10.20.193.90:6803/3942480641] conn(0x7efce8042b20 0x7efce8044f60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 --2- 10.20.193.90:0/407334294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7efd1410a680 0x7efd1419b6d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 >> 10.20.193.90:0/407334294 conn(0x7efd14100710 msgr2=0x7efd14106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 shutdown_connections 2026-02-17T12:06:33.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.355+0000 7efd196fc640 1 -- 10.20.193.90:0/407334294 wait complete. 2026-02-17T12:06:33.379 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67812]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-17T12:06:33.379 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67812]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:06:33.380 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:06:33.380 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67812]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:06:33.380 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67816]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-17T12:06:33.380 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67816]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T12:06:33.380 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T12:06:33.380 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 sudo[67816]: pam_unix(sudo:session): session closed for user root 2026-02-17T12:06:33.396 INFO:teuthology.orchestra.run.trial090.stdout:77309411332 2026-02-17T12:06:33.396 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T12:06:33.399 INFO:teuthology.orchestra.run.trial090.stdout:38654705671 2026-02-17T12:06:33.399 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T12:06:33.417 INFO:teuthology.orchestra.run.trial090.stdout:60129542150 2026-02-17T12:06:33.417 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T12:06:33.568 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:33.638 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-17T12:06:33.638 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 ceph-mon[39228]: osdmap e20: 3 total, 3 up, 3 in 2026-02-17T12:06:33.638 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/4133656182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:06:33.638 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:33.638 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/4172535945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T12:06:33.638 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' 2026-02-17T12:06:33.638 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 ceph-mon[39228]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T12:06:33.638 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 ceph-mon[39228]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T12:06:33.638 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:33 trial090 ceph-mon[39228]: from='mgr.14150 10.20.193.90:0/3071059924' entity='mgr.a' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-17T12:06:33.659 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:33.659 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:33.703 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 -- 10.20.193.90:0/417262649 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66bc103610 msgr2=0x7f66bc1039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.703 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 --2- 10.20.193.90:0/417262649 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66bc103610 0x7f66bc1039f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f66a80099b0 tx=0x7f66a802f340 comp rx=0 tx=0).stop 2026-02-17T12:06:33.703 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 -- 10.20.193.90:0/417262649 shutdown_connections 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 --2- 10.20.193.90:0/417262649 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66bc103610 0x7f66bc1039f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 -- 10.20.193.90:0/417262649 >> 10.20.193.90:0/417262649 conn(0x7f66bc0fcfb0 msgr2=0x7f66bc0ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 -- 10.20.193.90:0/417262649 shutdown_connections 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 -- 10.20.193.90:0/417262649 wait complete. 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 Processor -- start 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 -- start start 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66bc103610 0x7f66bc1011f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66c28cf640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66bc10bea0 con 0x7f66bc103610 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66bbfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66bc103610 0x7f66bc1011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66bbfff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66bc103610 0x7f66bc1011f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:46078/0 (socket says 10.20.193.90:46078) 2026-02-17T12:06:33.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66bbfff640 1 -- 10.20.193.90:0/1726504110 learned_addr learned my addr 10.20.193.90:0/1726504110 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.700+0000 7f66bbfff640 1 -- 10.20.193.90:0/1726504110 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66bc103090 con 0x7f66bc103610 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.701+0000 7f66bbfff640 1 --2- 10.20.193.90:0/1726504110 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66bc103610 0x7f66bc1011f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66a8004290 tx=0x7f66a80042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.701+0000 7f66b97fa640 1 -- 10.20.193.90:0/1726504110 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66a80385a0 con 0x7f66bc103610 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.701+0000 7f66b97fa640 1 -- 10.20.193.90:0/1726504110 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f66a8046070 con 0x7f66bc103610 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.701+0000 7f66c28cf640 1 -- 10.20.193.90:0/1726504110 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66bc101730 con 0x7f66bc103610 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.701+0000 7f66b97fa640 1 -- 10.20.193.90:0/1726504110 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66a8041730 con 0x7f66bc103610 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.701+0000 7f66c28cf640 1 -- 10.20.193.90:0/1726504110 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66bc101b90 con 0x7f66bc103610 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.701+0000 7f66c28cf640 1 -- 10.20.193.90:0/1726504110 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66bc06b840 con 0x7f66bc103610 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.701+0000 7f66b97fa640 1 -- 10.20.193.90:0/1726504110 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f66a8038740 con 0x7f66bc103610 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.701+0000 7f66b97fa640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.702+0000 7f66b97fa640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:33.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.702+0000 7f66b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.702+0000 7f66b97fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.702+0000 7f66b97fa640 1 --2- 10.20.193.90:0/1726504110 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f669003dc90 0x7f6690040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.702+0000 7f66b97fa640 1 -- 10.20.193.90:0/1726504110 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f66a8077840 con 0x7f66bc103610 2026-02-17T12:06:33.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.702+0000 7f66bb7fe640 1 --2- 10.20.193.90:0/1726504110 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f669003dc90 0x7f6690040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.702+0000 7f66bb7fe640 1 --2- 10.20.193.90:0/1726504110 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f669003dc90 0x7f6690040150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0099c0 tx=0x7f66ac006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.705+0000 7f66b97fa640 1 -- 10.20.193.90:0/1726504110 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f66a8038a60 con 0x7f66bc103610 2026-02-17T12:06:33.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.763+0000 7f99fcceb640 1 -- 10.20.193.90:0/3215219240 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99f810a680 msgr2=0x7f99f810aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.763+0000 7f99fcceb640 1 --2- 10.20.193.90:0/3215219240 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99f810a680 0x7f99f810aa60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0099b0 tx=0x7f99ec02f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.763+0000 7f99fcceb640 1 -- 10.20.193.90:0/3215219240 shutdown_connections 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.763+0000 7f99fcceb640 1 --2- 10.20.193.90:0/3215219240 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99f810a680 0x7f99f810aa60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.763+0000 7f99fcceb640 1 -- 10.20.193.90:0/3215219240 >> 10.20.193.90:0/3215219240 conn(0x7f99f8100710 msgr2=0x7f99f8102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.763+0000 7f99fcceb640 1 -- 10.20.193.90:0/3215219240 shutdown_connections 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.763+0000 7f99fcceb640 1 -- 10.20.193.90:0/3215219240 wait complete. 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.763+0000 7f99fcceb640 1 Processor -- start 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99fcceb640 1 -- start start 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99fcceb640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99f810a680 0x7f99f819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99fcceb640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f99f810e090 con 0x7f99f810a680 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99f6575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99f810a680 0x7f99f819b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99f6575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99f810a680 0x7f99f819b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:46108/0 (socket says 10.20.193.90:46108) 2026-02-17T12:06:33.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99f6575640 1 -- 10.20.193.90:0/406723439 learned_addr learned my addr 10.20.193.90:0/406723439 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:33.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99e528c640 1 -- 10.20.193.90:0/3119206440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99e010a680 msgr2=0x7f99e010aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99e528c640 1 --2- 10.20.193.90:0/3119206440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99e010a680 0x7f99e010aa60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99d40099b0 tx=0x7f99d402f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99e528c640 1 -- 10.20.193.90:0/3119206440 shutdown_connections 2026-02-17T12:06:33.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99e528c640 1 --2- 10.20.193.90:0/3119206440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99e010a680 0x7f99e010aa60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99e528c640 1 -- 10.20.193.90:0/3119206440 >> 10.20.193.90:0/3119206440 conn(0x7f99e0100710 msgr2=0x7f99e0102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99e528c640 1 -- 10.20.193.90:0/3119206440 shutdown_connections 2026-02-17T12:06:33.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99e528c640 1 -- 10.20.193.90:0/3119206440 wait complete. 2026-02-17T12:06:33.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99f6575640 1 -- 10.20.193.90:0/406723439 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f819bc10 con 0x7f99f810a680 2026-02-17T12:06:33.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99f6575640 1 --2- 10.20.193.90:0/406723439 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99f810a680 0x7f99f819b6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f99ec004290 tx=0x7f99ec0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99df7fe640 1 -- 10.20.193.90:0/406723439 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec038510 con 0x7f99f810a680 2026-02-17T12:06:33.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99df7fe640 1 -- 10.20.193.90:0/406723439 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f99ec046070 con 0x7f99f810a680 2026-02-17T12:06:33.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99fcceb640 1 -- 10.20.193.90:0/406723439 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f819bea0 con 0x7f99f810a680 2026-02-17T12:06:33.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99df7fe640 1 -- 10.20.193.90:0/406723439 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99ec041610 con 0x7f99f810a680 2026-02-17T12:06:33.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99fcceb640 1 -- 10.20.193.90:0/406723439 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f819ffa0 con 0x7f99f810a680 2026-02-17T12:06:33.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99e528c640 1 Processor -- start 2026-02-17T12:06:33.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.764+0000 7f99e528c640 1 -- start start 2026-02-17T12:06:33.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99e528c640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99e010a680 0x7f99e019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99e528c640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f99e010e090 con 0x7f99e010a680 2026-02-17T12:06:33.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99deffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99e010a680 0x7f99e019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99deffd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99e010a680 0x7f99e019b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:46110/0 (socket says 10.20.193.90:46110) 2026-02-17T12:06:33.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99deffd640 1 -- 10.20.193.90:0/3816860201 learned_addr learned my addr 10.20.193.90:0/3816860201 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:33.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99fcceb640 1 -- 10.20.193.90:0/406723439 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f8105dc0 con 0x7f99f810a680 2026-02-17T12:06:33.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99deffd640 1 -- 10.20.193.90:0/3816860201 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e019bc10 con 0x7f99e010a680 2026-02-17T12:06:33.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99deffd640 1 --2- 10.20.193.90:0/3816860201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99e010a680 0x7f99e019b6d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f99d4002410 tx=0x7f99d4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99df7fe640 1 -- 10.20.193.90:0/406723439 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f99ec0386b0 con 0x7f99f810a680 2026-02-17T12:06:33.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99df7fe640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:33.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99bffff640 1 -- 10.20.193.90:0/3816860201 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d4038510 con 0x7f99e010a680 2026-02-17T12:06:33.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99e528c640 1 -- 10.20.193.90:0/3816860201 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e019bea0 con 0x7f99e010a680 2026-02-17T12:06:33.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99bffff640 1 -- 10.20.193.90:0/3816860201 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f99d4046070 con 0x7f99e010a680 2026-02-17T12:06:33.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99bffff640 1 -- 10.20.193.90:0/3816860201 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d4041630 con 0x7f99e010a680 2026-02-17T12:06:33.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99e528c640 1 -- 10.20.193.90:0/3816860201 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e019ffa0 con 0x7f99e010a680 2026-02-17T12:06:33.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99df7fe640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:33.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99df7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99df7fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99df7fe640 1 --2- 10.20.193.90:0/406723439 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99d003dc90 0x7f99d0040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99df7fe640 1 -- 10.20.193.90:0/406723439 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f99ec0778a0 con 0x7f99f810a680 2026-02-17T12:06:33.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99f5d74640 1 --2- 10.20.193.90:0/406723439 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99d003dc90 0x7f99d0040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.766+0000 7f99f5d74640 1 --2- 10.20.193.90:0/406723439 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99d003dc90 0x7f99d0040150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f99e00099c0 tx=0x7f99e0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.765+0000 7f99e528c640 1 -- 10.20.193.90:0/3816860201 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e0105dc0 con 0x7f99e010a680 2026-02-17T12:06:33.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.768+0000 7f99df7fe640 1 -- 10.20.193.90:0/406723439 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f99ec040360 con 0x7f99f810a680 2026-02-17T12:06:33.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.768+0000 7f99bffff640 1 -- 10.20.193.90:0/3816860201 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 50303+0+0 (secure 0 0 0) 0x7f99d40386b0 con 0x7f99e010a680 2026-02-17T12:06:33.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.768+0000 7f99bffff640 20 mgrc handle_mgr_map mgrmap(e 13) 2026-02-17T12:06:33.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.768+0000 7f99bffff640 4 mgrc handle_mgr_map Got map version 13 2026-02-17T12:06:33.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.768+0000 7f99bffff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.768+0000 7f99bffff640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:33.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.768+0000 7f99bffff640 1 --2- 10.20.193.90:0/3816860201 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99b403dc90 0x7f99b4040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:33.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.769+0000 7f99bffff640 1 -- 10.20.193.90:0/3816860201 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f99d4078090 con 0x7f99e010a680 2026-02-17T12:06:33.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.769+0000 7f99de7fc640 1 --2- 10.20.193.90:0/3816860201 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99b403dc90 0x7f99b4040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:33.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.769+0000 7f99de7fc640 1 --2- 10.20.193.90:0/3816860201 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99b403dc90 0x7f99b4040150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99c80099c0 tx=0x7f99c8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:33.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.770+0000 7f99bffff640 1 -- 10.20.193.90:0/3816860201 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f99d4041990 con 0x7f99e010a680 2026-02-17T12:06:33.791 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.789+0000 7f66c28cf640 1 -- 10.20.193.90:0/1726504110 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f66bc103a70 con 0x7f66bc103610 2026-02-17T12:06:33.791 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.790+0000 7f66b97fa640 1 -- 10.20.193.90:0/1726504110 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+2 (secure 0 0 0) 0x7f66a8007c50 con 0x7f66bc103610 2026-02-17T12:06:33.791 INFO:teuthology.orchestra.run.trial090.stdout:0 2026-02-17T12:06:33.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 10 mgrc shutdown 2026-02-17T12:06:33.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 1 -- 10.20.193.90:0/1726504110 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f669003dc90 msgr2=0x7f6690040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 1 --2- 10.20.193.90:0/1726504110 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f669003dc90 0x7f6690040150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0099c0 tx=0x7f66ac006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 1 -- 10.20.193.90:0/1726504110 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66bc103610 msgr2=0x7f66bc1011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 1 --2- 10.20.193.90:0/1726504110 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66bc103610 0x7f66bc1011f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66a8004290 tx=0x7f66a80042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 1 -- 10.20.193.90:0/1726504110 shutdown_connections 2026-02-17T12:06:33.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 1 --2- 10.20.193.90:0/1726504110 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f669003dc90 0x7f6690040150 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 1 --2- 10.20.193.90:0/1726504110 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66bc103610 0x7f66bc1011f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 1 -- 10.20.193.90:0/1726504110 >> 10.20.193.90:0/1726504110 conn(0x7f66bc0fcfb0 msgr2=0x7f66bc109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.794 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 1 -- 10.20.193.90:0/1726504110 shutdown_connections 2026-02-17T12:06:33.794 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.791+0000 7f66c28cf640 1 -- 10.20.193.90:0/1726504110 wait complete. 2026-02-17T12:06:33.828 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 0 for osd.2 2026-02-17T12:06:33.854 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.853+0000 7f99fcceb640 1 -- 10.20.193.90:0/406723439 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f99f810aae0 con 0x7f99f810a680 2026-02-17T12:06:33.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.853+0000 7f99df7fe640 1 -- 10.20.193.90:0/406723439 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99ec049360 con 0x7f99f810a680 2026-02-17T12:06:33.855 INFO:teuthology.orchestra.run.trial090.stdout:60129542148 2026-02-17T12:06:33.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 10 mgrc shutdown 2026-02-17T12:06:33.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 1 -- 10.20.193.90:0/406723439 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99d003dc90 msgr2=0x7f99d0040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 1 --2- 10.20.193.90:0/406723439 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99d003dc90 0x7f99d0040150 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f99e00099c0 tx=0x7f99e0006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 1 -- 10.20.193.90:0/406723439 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99f810a680 msgr2=0x7f99f819b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 1 --2- 10.20.193.90:0/406723439 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99f810a680 0x7f99f819b6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f99ec004290 tx=0x7f99ec0042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 1 -- 10.20.193.90:0/406723439 shutdown_connections 2026-02-17T12:06:33.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 1 --2- 10.20.193.90:0/406723439 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99d003dc90 0x7f99d0040150 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 1 --2- 10.20.193.90:0/406723439 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99f810a680 0x7f99f819b6d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 1 -- 10.20.193.90:0/406723439 >> 10.20.193.90:0/406723439 conn(0x7f99f8100710 msgr2=0x7f99f8106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 1 -- 10.20.193.90:0/406723439 shutdown_connections 2026-02-17T12:06:33.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.855+0000 7f99fcceb640 1 -- 10.20.193.90:0/406723439 wait complete. 2026-02-17T12:06:33.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.857+0000 7f99e528c640 1 -- 10.20.193.90:0/3816860201 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f99e010aae0 con 0x7f99e010a680 2026-02-17T12:06:33.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.857+0000 7f99bffff640 1 -- 10.20.193.90:0/3816860201 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99d4046db0 con 0x7f99e010a680 2026-02-17T12:06:33.860 INFO:teuthology.orchestra.run.trial090.stdout:38654705669 2026-02-17T12:06:33.861 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 10 mgrc shutdown 2026-02-17T12:06:33.861 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 1 -- 10.20.193.90:0/3816860201 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99b403dc90 msgr2=0x7f99b4040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.861 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 1 --2- 10.20.193.90:0/3816860201 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99b403dc90 0x7f99b4040150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f99c80099c0 tx=0x7f99c8006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.861 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 1 -- 10.20.193.90:0/3816860201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99e010a680 msgr2=0x7f99e019b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:33.861 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 1 --2- 10.20.193.90:0/3816860201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99e010a680 0x7f99e019b6d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f99d4002410 tx=0x7f99d4004290 comp rx=0 tx=0).stop 2026-02-17T12:06:33.861 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 1 -- 10.20.193.90:0/3816860201 shutdown_connections 2026-02-17T12:06:33.861 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 1 --2- 10.20.193.90:0/3816860201 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f99b403dc90 0x7f99b4040150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.861 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 1 --2- 10.20.193.90:0/3816860201 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f99e010a680 0x7f99e019b6d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:33.861 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 1 -- 10.20.193.90:0/3816860201 >> 10.20.193.90:0/3816860201 conn(0x7f99e0100710 msgr2=0x7f99e0106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:33.862 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 1 -- 10.20.193.90:0/3816860201 shutdown_connections 2026-02-17T12:06:33.862 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:33.859+0000 7f99e528c640 1 -- 10.20.193.90:0/3816860201 wait complete. 2026-02-17T12:06:33.894 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.1 2026-02-17T12:06:33.898 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705671 got 38654705669 for osd.0 2026-02-17T12:06:34.829 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T12:06:34.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:34 trial090 ceph-mon[39228]: pgmap v35: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:06:34.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:34 trial090 ceph-mon[39228]: osdmap e21: 3 total, 3 up, 3 in 2026-02-17T12:06:34.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:34 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/1726504110' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T12:06:34.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:34 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/406723439' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T12:06:34.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:34 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3816860201' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T12:06:34.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:34 trial090 ceph-mon[39228]: mgrmap e14: a(active, since 50s) 2026-02-17T12:06:34.895 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T12:06:34.900 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T12:06:34.983 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:35.069 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:35.092 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:35.095 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.093+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/1993648170 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbdf0103610 msgr2=0x7fbdf01039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:35.095 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.093+0000 7fbdf7bf1640 1 --2- 10.20.193.90:0/1993648170 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbdf0103610 0x7fbdf01039f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbde00099b0 tx=0x7fbde002f340 comp rx=0 tx=0).stop 2026-02-17T12:06:35.095 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.093+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/1993648170 shutdown_connections 2026-02-17T12:06:35.095 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.093+0000 7fbdf7bf1640 1 --2- 10.20.193.90:0/1993648170 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbdf0103610 0x7fbdf01039f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.095 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.093+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/1993648170 >> 10.20.193.90:0/1993648170 conn(0x7fbdf00fcfb0 msgr2=0x7fbdf00ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:35.095 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.093+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/1993648170 shutdown_connections 2026-02-17T12:06:35.095 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.094+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/1993648170 wait complete. 2026-02-17T12:06:35.097 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.094+0000 7fbdf7bf1640 1 Processor -- start 2026-02-17T12:06:35.097 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.094+0000 7fbdf7bf1640 1 -- start start 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.094+0000 7fbdf7bf1640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbdf0103610 0x7fbdf01a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.094+0000 7fbdf7bf1640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf010bea0 con 0x7fbdf0103610 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.094+0000 7fbdf5966640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbdf0103610 0x7fbdf01a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.094+0000 7fbdf5966640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbdf0103610 0x7fbdf01a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58330/0 (socket says 10.20.193.90:58330) 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.094+0000 7fbdf5966640 1 -- 10.20.193.90:0/653747693 learned_addr learned my addr 10.20.193.90:0/653747693 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.094+0000 7fbdf5966640 1 -- 10.20.193.90:0/653747693 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf01a1ab0 con 0x7fbdf0103610 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.094+0000 7fbdf5966640 1 --2- 10.20.193.90:0/653747693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbdf0103610 0x7fbdf01a1570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbde0004290 tx=0x7fbde00042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.095+0000 7fbddeffd640 1 -- 10.20.193.90:0/653747693 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbde00385a0 con 0x7fbdf0103610 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.095+0000 7fbddeffd640 1 -- 10.20.193.90:0/653747693 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7fbde0046070 con 0x7fbdf0103610 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.095+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/653747693 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf01a1d40 con 0x7fbdf0103610 2026-02-17T12:06:35.098 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.095+0000 7fbddeffd640 1 -- 10.20.193.90:0/653747693 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbde0041730 con 0x7fbdf0103610 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.095+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/653747693 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf019b640 con 0x7fbdf0103610 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.095+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/653747693 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf006b840 con 0x7fbdf0103610 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.095+0000 7fbddeffd640 1 -- 10.20.193.90:0/653747693 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7fbde0038740 con 0x7fbdf0103610 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.095+0000 7fbddeffd640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.096+0000 7fbddeffd640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.096+0000 7fbddeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.096+0000 7fbddeffd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.096+0000 7fbddeffd640 1 --2- 10.20.193.90:0/653747693 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbdcc03dd70 0x7fbdcc040230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.096+0000 7fbddeffd640 1 -- 10.20.193.90:0/653747693 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7fbde0077930 con 0x7fbdf0103610 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.096+0000 7fbdf5165640 1 --2- 10.20.193.90:0/653747693 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbdcc03dd70 0x7fbdcc040230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:35.099 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.096+0000 7fbdf5165640 1 --2- 10.20.193.90:0/653747693 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbdcc03dd70 0x7fbdcc040230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbde40099c0 tx=0x7fbde4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:35.100 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.098+0000 7fbddeffd640 1 -- 10.20.193.90:0/653747693 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbde0038a60 con 0x7fbdf0103610 2026-02-17T12:06:35.181 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 -- 10.20.193.90:0/3870663971 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f601c103610 msgr2=0x7f601c1039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:35.181 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 --2- 10.20.193.90:0/3870663971 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f601c103610 0x7f601c1039f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f600c0099b0 tx=0x7f600c02f340 comp rx=0 tx=0).stop 2026-02-17T12:06:35.181 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 -- 10.20.193.90:0/3870663971 shutdown_connections 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 --2- 10.20.193.90:0/3870663971 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f601c103610 0x7f601c1039f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 -- 10.20.193.90:0/3870663971 >> 10.20.193.90:0/3870663971 conn(0x7f601c0fcfb0 msgr2=0x7f601c0ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 -- 10.20.193.90:0/3870663971 shutdown_connections 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 -- 10.20.193.90:0/3870663971 wait complete. 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 Processor -- start 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 -- start start 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f601c103610 0x7f601c1011f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6024092640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f601c10bea0 con 0x7f601c103610 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6021e07640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f601c103610 0x7f601c1011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6021e07640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f601c103610 0x7f601c1011f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58348/0 (socket says 10.20.193.90:58348) 2026-02-17T12:06:35.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.179+0000 7f6021e07640 1 -- 10.20.193.90:0/4018627332 learned_addr learned my addr 10.20.193.90:0/4018627332 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:35.183 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.180+0000 7f6021e07640 1 -- 10.20.193.90:0/4018627332 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601c103090 con 0x7f601c103610 2026-02-17T12:06:35.183 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.180+0000 7f6021e07640 1 --2- 10.20.193.90:0/4018627332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f601c103610 0x7f601c1011f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f600c004290 tx=0x7f600c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:35.183 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.180+0000 7f600affd640 1 -- 10.20.193.90:0/4018627332 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f600c0385a0 con 0x7f601c103610 2026-02-17T12:06:35.183 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.180+0000 7f600affd640 1 -- 10.20.193.90:0/4018627332 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f600c046070 con 0x7f601c103610 2026-02-17T12:06:35.183 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.180+0000 7f6024092640 1 -- 10.20.193.90:0/4018627332 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601c101730 con 0x7f601c103610 2026-02-17T12:06:35.183 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.180+0000 7f600affd640 1 -- 10.20.193.90:0/4018627332 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f600c041730 con 0x7f601c103610 2026-02-17T12:06:35.183 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.180+0000 7f6024092640 1 -- 10.20.193.90:0/4018627332 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601c101b90 con 0x7f601c103610 2026-02-17T12:06:35.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.180+0000 7f6024092640 1 -- 10.20.193.90:0/4018627332 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f601c06b840 con 0x7f601c103610 2026-02-17T12:06:35.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.180+0000 7f600affd640 1 -- 10.20.193.90:0/4018627332 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7f600c038740 con 0x7f601c103610 2026-02-17T12:06:35.185 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.180+0000 7f600affd640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T12:06:35.185 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.181+0000 7f600affd640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T12:06:35.185 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.181+0000 7f600affd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:35.185 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.181+0000 7f600affd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:35.185 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.181+0000 7f600affd640 1 --2- 10.20.193.90:0/4018627332 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ff803dd70 0x7f5ff8040230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:35.185 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.181+0000 7f600affd640 1 -- 10.20.193.90:0/4018627332 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f600c0779c0 con 0x7f601c103610 2026-02-17T12:06:35.185 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.181+0000 7f6021606640 1 --2- 10.20.193.90:0/4018627332 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ff803dd70 0x7f5ff8040230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:35.185 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.181+0000 7f6021606640 1 --2- 10.20.193.90:0/4018627332 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ff803dd70 0x7f5ff8040230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f60100099c0 tx=0x7f6010006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:35.185 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7f600affd640 1 -- 10.20.193.90:0/4018627332 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f600c038a60 con 0x7f601c103610 2026-02-17T12:06:35.186 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7f1ec0dab640 1 -- 10.20.193.90:0/320095208 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ebc10a680 msgr2=0x7f1ebc10aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:35.186 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7f1ec0dab640 1 --2- 10.20.193.90:0/320095208 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ebc10a680 0x7f1ebc10aa60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000b0a0 tx=0x7f1eb002f530 comp rx=0 tx=0).stop 2026-02-17T12:06:35.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7f1ec0dab640 1 -- 10.20.193.90:0/320095208 shutdown_connections 2026-02-17T12:06:35.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7f1ec0dab640 1 --2- 10.20.193.90:0/320095208 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ebc10a680 0x7f1ebc10aa60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7f1ec0dab640 1 -- 10.20.193.90:0/320095208 >> 10.20.193.90:0/320095208 conn(0x7f1ebc100710 msgr2=0x7f1ebc102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:35.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7f1ec0dab640 1 -- 10.20.193.90:0/320095208 shutdown_connections 2026-02-17T12:06:35.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7f1ec0dab640 1 -- 10.20.193.90:0/320095208 wait complete. 2026-02-17T12:06:35.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7f1ec0dab640 1 Processor -- start 2026-02-17T12:06:35.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7f1ec0dab640 1 -- start start 2026-02-17T12:06:35.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.184+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/653747693 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbdf0103a70 con 0x7fbdf0103610 2026-02-17T12:06:35.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1ec0dab640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ebc10a680 0x7f1ebc19b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:35.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1ec0dab640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc10e090 con 0x7f1ebc10a680 2026-02-17T12:06:35.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1eba575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ebc10a680 0x7f1ebc19b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:35.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1eba575640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ebc10a680 0x7f1ebc19b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58364/0 (socket says 10.20.193.90:58364) 2026-02-17T12:06:35.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1eba575640 1 -- 10.20.193.90:0/1040861540 learned_addr learned my addr 10.20.193.90:0/1040861540 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:35.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7fbddeffd640 1 -- 10.20.193.90:0/653747693 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbde0007c50 con 0x7fbdf0103610 2026-02-17T12:06:35.189 INFO:teuthology.orchestra.run.trial090.stdout:77309411331 2026-02-17T12:06:35.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1eba575640 1 -- 10.20.193.90:0/1040861540 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc19bc10 con 0x7f1ebc10a680 2026-02-17T12:06:35.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1eba575640 1 --2- 10.20.193.90:0/1040861540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ebc10a680 0x7f1ebc19b6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0002790 tx=0x7f1eb0009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:35.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1ea37fe640 1 -- 10.20.193.90:0/1040861540 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1eb0047070 con 0x7f1ebc10a680 2026-02-17T12:06:35.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1ea37fe640 1 -- 10.20.193.90:0/1040861540 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f1eb0007dc0 con 0x7f1ebc10a680 2026-02-17T12:06:35.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1ec0dab640 1 -- 10.20.193.90:0/1040861540 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ebc19bea0 con 0x7f1ebc10a680 2026-02-17T12:06:35.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1ea37fe640 1 -- 10.20.193.90:0/1040861540 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1eb00428e0 con 0x7f1ebc10a680 2026-02-17T12:06:35.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.185+0000 7f1ec0dab640 1 -- 10.20.193.90:0/1040861540 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ebc19c300 con 0x7f1ebc10a680 2026-02-17T12:06:35.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.186+0000 7f1ec0dab640 1 -- 10.20.193.90:0/1040861540 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ebc105dc0 con 0x7f1ebc10a680 2026-02-17T12:06:35.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.186+0000 7f1ea37fe640 1 -- 10.20.193.90:0/1040861540 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7f1eb004c440 con 0x7f1ebc10a680 2026-02-17T12:06:35.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.186+0000 7f1ea37fe640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T12:06:35.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.186+0000 7f1ea37fe640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T12:06:35.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.186+0000 7f1ea37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:35.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.186+0000 7f1ea37fe640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:35.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.186+0000 7f1ea37fe640 1 --2- 10.20.193.90:0/1040861540 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f1e9403dd70 0x7f1e94040230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:35.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.186+0000 7f1ea37fe640 1 -- 10.20.193.90:0/1040861540 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f1eb00778c0 con 0x7f1ebc10a680 2026-02-17T12:06:35.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.186+0000 7f1eb9d74640 1 --2- 10.20.193.90:0/1040861540 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f1e9403dd70 0x7f1e94040230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:35.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.186+0000 7f1eb9d74640 1 --2- 10.20.193.90:0/1040861540 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f1e9403dd70 0x7f1e94040230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40099c0 tx=0x7f1ea4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:35.193 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 10 mgrc shutdown 2026-02-17T12:06:35.193 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/653747693 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbdcc03dd70 msgr2=0x7fbdcc040230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:35.193 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 1 --2- 10.20.193.90:0/653747693 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbdcc03dd70 0x7fbdcc040230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbde40099c0 tx=0x7fbde4006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.193 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/653747693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbdf0103610 msgr2=0x7fbdf01a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:35.193 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 1 --2- 10.20.193.90:0/653747693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbdf0103610 0x7fbdf01a1570 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbde0004290 tx=0x7fbde00042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/653747693 shutdown_connections 2026-02-17T12:06:35.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 1 --2- 10.20.193.90:0/653747693 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7fbdcc03dd70 0x7fbdcc040230 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 1 --2- 10.20.193.90:0/653747693 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbdf0103610 0x7fbdf01a1570 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/653747693 >> 10.20.193.90:0/653747693 conn(0x7fbdf00fcfb0 msgr2=0x7fbdf01088d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:35.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/653747693 shutdown_connections 2026-02-17T12:06:35.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.187+0000 7fbdf7bf1640 1 -- 10.20.193.90:0/653747693 wait complete. 2026-02-17T12:06:35.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.189+0000 7f1ea37fe640 1 -- 10.20.193.90:0/1040861540 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1eb003e230 con 0x7f1ebc10a680 2026-02-17T12:06:35.226 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411331 for osd.2 2026-02-17T12:06:35.272 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.270+0000 7f6024092640 1 -- 10.20.193.90:0/4018627332 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f601c103a70 con 0x7f601c103610 2026-02-17T12:06:35.272 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.271+0000 7f600affd640 1 -- 10.20.193.90:0/4018627332 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f600c007c50 con 0x7f601c103610 2026-02-17T12:06:35.272 INFO:teuthology.orchestra.run.trial090.stdout:60129542149 2026-02-17T12:06:35.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 10 mgrc shutdown 2026-02-17T12:06:35.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 1 -- 10.20.193.90:0/4018627332 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ff803dd70 msgr2=0x7f5ff8040230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:35.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 1 --2- 10.20.193.90:0/4018627332 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ff803dd70 0x7f5ff8040230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f60100099c0 tx=0x7f6010006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 1 -- 10.20.193.90:0/4018627332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f601c103610 msgr2=0x7f601c1011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:35.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 1 --2- 10.20.193.90:0/4018627332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f601c103610 0x7f601c1011f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f600c004290 tx=0x7f600c0042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 1 -- 10.20.193.90:0/4018627332 shutdown_connections 2026-02-17T12:06:35.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 1 --2- 10.20.193.90:0/4018627332 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5ff803dd70 0x7f5ff8040230 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 1 --2- 10.20.193.90:0/4018627332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f601c103610 0x7f601c1011f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 1 -- 10.20.193.90:0/4018627332 >> 10.20.193.90:0/4018627332 conn(0x7f601c0fcfb0 msgr2=0x7f601c109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:35.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 1 -- 10.20.193.90:0/4018627332 shutdown_connections 2026-02-17T12:06:35.274 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.272+0000 7f6024092640 1 -- 10.20.193.90:0/4018627332 wait complete. 2026-02-17T12:06:35.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.274+0000 7f1ec0dab640 1 -- 10.20.193.90:0/1040861540 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1ebc19ca30 con 0x7f1ebc10a680 2026-02-17T12:06:35.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.275+0000 7f1ea37fe640 1 -- 10.20.193.90:0/1040861540 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1eb004f120 con 0x7f1ebc10a680 2026-02-17T12:06:35.276 INFO:teuthology.orchestra.run.trial090.stdout:38654705670 2026-02-17T12:06:35.277 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 10 mgrc shutdown 2026-02-17T12:06:35.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 1 -- 10.20.193.90:0/1040861540 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f1e9403dd70 msgr2=0x7f1e94040230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:35.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 1 --2- 10.20.193.90:0/1040861540 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f1e9403dd70 0x7f1e94040230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40099c0 tx=0x7f1ea4006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 1 -- 10.20.193.90:0/1040861540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ebc10a680 msgr2=0x7f1ebc19b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:35.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 1 --2- 10.20.193.90:0/1040861540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ebc10a680 0x7f1ebc19b6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0002790 tx=0x7f1eb0009510 comp rx=0 tx=0).stop 2026-02-17T12:06:35.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 1 -- 10.20.193.90:0/1040861540 shutdown_connections 2026-02-17T12:06:35.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 1 --2- 10.20.193.90:0/1040861540 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f1e9403dd70 0x7f1e94040230 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 1 --2- 10.20.193.90:0/1040861540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ebc10a680 0x7f1ebc19b6d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:35.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 1 -- 10.20.193.90:0/1040861540 >> 10.20.193.90:0/1040861540 conn(0x7f1ebc100710 msgr2=0x7f1ebc106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:35.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 1 -- 10.20.193.90:0/1040861540 shutdown_connections 2026-02-17T12:06:35.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:35.276+0000 7f1ec0dab640 1 -- 10.20.193.90:0/1040861540 wait complete. 2026-02-17T12:06:35.311 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2026-02-17T12:06:35.312 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.0 2026-02-17T12:06:35.829 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:35 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/653747693' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T12:06:35.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:35 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/4018627332' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T12:06:35.830 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:35 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/1040861540' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T12:06:36.226 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T12:06:36.312 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T12:06:36.312 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T12:06:36.380 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:36.489 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:36.490 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:36.502 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.499+0000 7f5fa7212640 1 -- 10.20.193.90:0/3353580789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fa0103600 msgr2=0x7f5fa01039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:36.502 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.499+0000 7f5fa7212640 1 --2- 10.20.193.90:0/3353580789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fa0103600 0x7f5fa01039e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5f900099b0 tx=0x7f5f9002f340 comp rx=0 tx=0).stop 2026-02-17T12:06:36.502 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.499+0000 7f5fa7212640 1 -- 10.20.193.90:0/3353580789 shutdown_connections 2026-02-17T12:06:36.502 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.499+0000 7f5fa7212640 1 --2- 10.20.193.90:0/3353580789 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fa0103600 0x7f5fa01039e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.502 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.499+0000 7f5fa7212640 1 -- 10.20.193.90:0/3353580789 >> 10.20.193.90:0/3353580789 conn(0x7f5fa0078110 msgr2=0x7f5fa00ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:36.502 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.499+0000 7f5fa7212640 1 -- 10.20.193.90:0/3353580789 shutdown_connections 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.499+0000 7f5fa7212640 1 -- 10.20.193.90:0/3353580789 wait complete. 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.499+0000 7f5fa7212640 1 Processor -- start 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.499+0000 7f5fa7212640 1 -- start start 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5fa7212640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fa0103600 0x7f5fa01011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5fa7212640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa010be90 con 0x7f5fa0103600 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5fa4f87640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fa0103600 0x7f5fa01011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5fa4f87640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fa0103600 0x7f5fa01011e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58382/0 (socket says 10.20.193.90:58382) 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5fa4f87640 1 -- 10.20.193.90:0/3247327878 learned_addr learned my addr 10.20.193.90:0/3247327878 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5fa4f87640 1 -- 10.20.193.90:0/3247327878 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa0103080 con 0x7f5fa0103600 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5fa4f87640 1 --2- 10.20.193.90:0/3247327878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fa0103600 0x7f5fa01011e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5f90002410 tx=0x7f5f90004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:36.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5f95ffb640 1 -- 10.20.193.90:0/3247327878 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f90038470 con 0x7f5fa0103600 2026-02-17T12:06:36.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5fa7212640 1 -- 10.20.193.90:0/3247327878 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa0101720 con 0x7f5fa0103600 2026-02-17T12:06:36.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5fa7212640 1 -- 10.20.193.90:0/3247327878 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa0101b80 con 0x7f5fa0103600 2026-02-17T12:06:36.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5f95ffb640 1 -- 10.20.193.90:0/3247327878 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f5f90046070 con 0x7f5fa0103600 2026-02-17T12:06:36.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.500+0000 7f5f95ffb640 1 -- 10.20.193.90:0/3247327878 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f90041600 con 0x7f5fa0103600 2026-02-17T12:06:36.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.501+0000 7f5fa7212640 1 -- 10.20.193.90:0/3247327878 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa006b020 con 0x7f5fa0103600 2026-02-17T12:06:36.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.501+0000 7f5f95ffb640 1 -- 10.20.193.90:0/3247327878 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7f5f90038610 con 0x7f5fa0103600 2026-02-17T12:06:36.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.501+0000 7f5f95ffb640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T12:06:36.504 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:36 trial090 ceph-mon[39228]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:06:36.505 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.501+0000 7f5f95ffb640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T12:06:36.505 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.501+0000 7f5f95ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:36.506 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.501+0000 7f5f95ffb640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:36.506 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.501+0000 7f5f95ffb640 1 --2- 10.20.193.90:0/3247327878 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5f7c03dd70 0x7f5f7c040230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:36.506 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.501+0000 7f5f95ffb640 1 -- 10.20.193.90:0/3247327878 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f5f90077770 con 0x7f5fa0103600 2026-02-17T12:06:36.506 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.501+0000 7f5f97fff640 1 --2- 10.20.193.90:0/3247327878 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5f7c03dd70 0x7f5f7c040230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:36.506 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.501+0000 7f5f97fff640 1 --2- 10.20.193.90:0/3247327878 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5f7c03dd70 0x7f5f7c040230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f880099c0 tx=0x7f5f88006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:36.506 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.504+0000 7f5f95ffb640 1 -- 10.20.193.90:0/3247327878 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5f90038930 con 0x7f5fa0103600 2026-02-17T12:06:36.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.593+0000 7f5fa7212640 1 -- 10.20.193.90:0/3247327878 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5fa0103a60 con 0x7f5fa0103600 2026-02-17T12:06:36.595 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.594+0000 7f5f95ffb640 1 -- 10.20.193.90:0/3247327878 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f90035db0 con 0x7f5fa0103600 2026-02-17T12:06:36.595 INFO:teuthology.orchestra.run.trial090.stdout:77309411332 2026-02-17T12:06:36.597 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 10 mgrc shutdown 2026-02-17T12:06:36.597 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 1 -- 10.20.193.90:0/3247327878 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5f7c03dd70 msgr2=0x7f5f7c040230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:36.597 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 1 --2- 10.20.193.90:0/3247327878 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5f7c03dd70 0x7f5f7c040230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5f880099c0 tx=0x7f5f88006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.598 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 1 -- 10.20.193.90:0/3247327878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fa0103600 msgr2=0x7f5fa01011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:36.598 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 1 --2- 10.20.193.90:0/3247327878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fa0103600 0x7f5fa01011e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5f90002410 tx=0x7f5f90004290 comp rx=0 tx=0).stop 2026-02-17T12:06:36.598 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 1 -- 10.20.193.90:0/3247327878 shutdown_connections 2026-02-17T12:06:36.598 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 1 --2- 10.20.193.90:0/3247327878 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f5f7c03dd70 0x7f5f7c040230 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.598 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 1 --2- 10.20.193.90:0/3247327878 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5fa0103600 0x7f5fa01011e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.598 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 1 -- 10.20.193.90:0/3247327878 >> 10.20.193.90:0/3247327878 conn(0x7f5fa0078110 msgr2=0x7f5fa0109ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:36.598 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 1 -- 10.20.193.90:0/3247327878 shutdown_connections 2026-02-17T12:06:36.598 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.596+0000 7f5fa7212640 1 -- 10.20.193.90:0/3247327878 wait complete. 2026-02-17T12:06:36.599 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.597+0000 7f8bffa87640 1 -- 10.20.193.90:0/459120476 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8bf810ed40 msgr2=0x7f8bf810f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.597+0000 7f8bffa87640 1 --2- 10.20.193.90:0/459120476 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8bf810ed40 0x7f8bf810f120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8be80099b0 tx=0x7f8be802f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.597+0000 7f8bffa87640 1 -- 10.20.193.90:0/459120476 shutdown_connections 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.597+0000 7f8bffa87640 1 --2- 10.20.193.90:0/459120476 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8bf810ed40 0x7f8bf810f120 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.597+0000 7f8bffa87640 1 -- 10.20.193.90:0/459120476 >> 10.20.193.90:0/459120476 conn(0x7f8bf8075ed0 msgr2=0x7f8bf80762e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bffa87640 1 -- 10.20.193.90:0/459120476 shutdown_connections 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bffa87640 1 -- 10.20.193.90:0/459120476 wait complete. 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bffa87640 1 Processor -- start 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bffa87640 1 -- start start 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bffa87640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8bf810ed40 0x7f8bf81a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bffa87640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf8112680 con 0x7f8bf810ed40 2026-02-17T12:06:36.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bfd7fc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8bf810ed40 0x7f8bf81a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:36.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bfd7fc640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8bf810ed40 0x7f8bf81a5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58418/0 (socket says 10.20.193.90:58418) 2026-02-17T12:06:36.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bfd7fc640 1 -- 10.20.193.90:0/893976848 learned_addr learned my addr 10.20.193.90:0/893976848 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:36.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bfd7fc640 1 -- 10.20.193.90:0/893976848 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf81a5da0 con 0x7f8bf810ed40 2026-02-17T12:06:36.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bfd7fc640 1 --2- 10.20.193.90:0/893976848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8bf810ed40 0x7f8bf81a5860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8be8004290 tx=0x7f8be80042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:36.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f7227b8d640 1 -- 10.20.193.90:0/430417649 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f722010a680 msgr2=0x7f722010aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:36.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f7227b8d640 1 --2- 10.20.193.90:0/430417649 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f722010a680 0x7f722010aa60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f72100099b0 tx=0x7f721002f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.602 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f7227b8d640 1 -- 10.20.193.90:0/430417649 shutdown_connections 2026-02-17T12:06:36.602 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f7227b8d640 1 --2- 10.20.193.90:0/430417649 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f722010a680 0x7f722010aa60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.602 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f7227b8d640 1 -- 10.20.193.90:0/430417649 >> 10.20.193.90:0/430417649 conn(0x7f7220100710 msgr2=0x7f7220102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:36.602 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f7227b8d640 1 -- 10.20.193.90:0/430417649 shutdown_connections 2026-02-17T12:06:36.602 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f7227b8d640 1 -- 10.20.193.90:0/430417649 wait complete. 2026-02-17T12:06:36.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8be67fc640 1 -- 10.20.193.90:0/893976848 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be8038510 con 0x7f8bf810ed40 2026-02-17T12:06:36.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8bffa87640 1 -- 10.20.193.90:0/893976848 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf81a6030 con 0x7f8bf810ed40 2026-02-17T12:06:36.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8be67fc640 1 -- 10.20.193.90:0/893976848 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f8be8046070 con 0x7f8bf810ed40 2026-02-17T12:06:36.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.598+0000 7f8be67fc640 1 -- 10.20.193.90:0/893976848 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be8041610 con 0x7f8bf810ed40 2026-02-17T12:06:36.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f8bffa87640 1 -- 10.20.193.90:0/893976848 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf819fa20 con 0x7f8bf810ed40 2026-02-17T12:06:36.604 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f7227b8d640 1 Processor -- start 2026-02-17T12:06:36.604 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f7227b8d640 1 -- start start 2026-02-17T12:06:36.604 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f7227b8d640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f722010a680 0x7f722019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:36.604 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f7227b8d640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f722010e090 con 0x7f722010a680 2026-02-17T12:06:36.604 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f7225902640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f722010a680 0x7f722019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:36.604 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f7225902640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f722010a680 0x7f722019b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58430/0 (socket says 10.20.193.90:58430) 2026-02-17T12:06:36.604 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f7225902640 1 -- 10.20.193.90:0/1803592238 learned_addr learned my addr 10.20.193.90:0/1803592238 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:36.605 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f8be67fc640 1 -- 10.20.193.90:0/893976848 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7f8be8041910 con 0x7f8bf810ed40 2026-02-17T12:06:36.605 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f8be67fc640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T12:06:36.605 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f8bffa87640 1 -- 10.20.193.90:0/893976848 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf810a480 con 0x7f8bf810ed40 2026-02-17T12:06:36.605 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f7225902640 1 -- 10.20.193.90:0/1803592238 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722019bc10 con 0x7f722010a680 2026-02-17T12:06:36.606 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f8be67fc640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T12:06:36.606 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f8be67fc640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:36.606 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f8be67fc640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:36.606 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f8be67fc640 1 --2- 10.20.193.90:0/893976848 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8bd403dd20 0x7f8bd40401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:36.606 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f7225902640 1 --2- 10.20.193.90:0/1803592238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f722010a680 0x7f722019b6d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7210002410 tx=0x7f7210004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:36.607 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f8be67fc640 1 -- 10.20.193.90:0/893976848 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f8be8077910 con 0x7f8bf810ed40 2026-02-17T12:06:36.607 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.599+0000 7f8bfcffb640 1 --2- 10.20.193.90:0/893976848 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8bd403dd20 0x7f8bd40401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:36.607 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.600+0000 7f8bfcffb640 1 --2- 10.20.193.90:0/893976848 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8bd403dd20 0x7f8bd40401e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0099c0 tx=0x7f8bec006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:36.608 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f720effd640 1 -- 10.20.193.90:0/1803592238 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7210038510 con 0x7f722010a680 2026-02-17T12:06:36.608 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f720effd640 1 -- 10.20.193.90:0/1803592238 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f7210046070 con 0x7f722010a680 2026-02-17T12:06:36.608 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f720effd640 1 -- 10.20.193.90:0/1803592238 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7210041630 con 0x7f722010a680 2026-02-17T12:06:36.608 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f7227b8d640 1 -- 10.20.193.90:0/1803592238 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722019bea0 con 0x7f722010a680 2026-02-17T12:06:36.608 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f7227b8d640 1 -- 10.20.193.90:0/1803592238 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722019ffa0 con 0x7f722010a680 2026-02-17T12:06:36.609 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f8be67fc640 1 -- 10.20.193.90:0/893976848 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8be8034280 con 0x7f8bf810ed40 2026-02-17T12:06:36.610 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f720effd640 1 -- 10.20.193.90:0/1803592238 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7f72100417d0 con 0x7f722010a680 2026-02-17T12:06:36.610 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f720effd640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T12:06:36.610 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f7227b8d640 1 -- 10.20.193.90:0/1803592238 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7220105dc0 con 0x7f722010a680 2026-02-17T12:06:36.610 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f720effd640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T12:06:36.610 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f720effd640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:36.610 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f720effd640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:36.610 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f720effd640 1 --2- 10.20.193.90:0/1803592238 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f71fc03dd70 0x7f71fc040230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:36.610 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f720effd640 1 -- 10.20.193.90:0/1803592238 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f7210077990 con 0x7f722010a680 2026-02-17T12:06:36.610 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.602+0000 7f7225101640 1 --2- 10.20.193.90:0/1803592238 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f71fc03dd70 0x7f71fc040230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:36.610 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.603+0000 7f7225101640 1 --2- 10.20.193.90:0/1803592238 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f71fc03dd70 0x7f71fc040230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f72140099c0 tx=0x7f7214006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:36.611 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.604+0000 7f720effd640 1 -- 10.20.193.90:0/1803592238 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7210035320 con 0x7f722010a680 2026-02-17T12:06:36.633 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411332 got 77309411332 for osd.2 2026-02-17T12:06:36.634 DEBUG:teuthology.parallel:result is None 2026-02-17T12:06:36.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.688+0000 7f8bffa87640 1 -- 10.20.193.90:0/893976848 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8bf810f150 con 0x7f8bf810ed40 2026-02-17T12:06:36.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.688+0000 7f8be67fc640 1 -- 10.20.193.90:0/893976848 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8bf810f150 con 0x7f8bf810ed40 2026-02-17T12:06:36.690 INFO:teuthology.orchestra.run.trial090.stdout:60129542150 2026-02-17T12:06:36.691 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.689+0000 7f8bffa87640 10 mgrc shutdown 2026-02-17T12:06:36.691 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.689+0000 7f8bffa87640 1 -- 10.20.193.90:0/893976848 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8bd403dd20 msgr2=0x7f8bd40401e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:36.691 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.689+0000 7f8bffa87640 1 --2- 10.20.193.90:0/893976848 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8bd403dd20 0x7f8bd40401e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0099c0 tx=0x7f8bec006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.691 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.689+0000 7f8bffa87640 1 -- 10.20.193.90:0/893976848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8bf810ed40 msgr2=0x7f8bf81a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:36.691 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.689+0000 7f8bffa87640 1 --2- 10.20.193.90:0/893976848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8bf810ed40 0x7f8bf81a5860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8be8004290 tx=0x7f8be80042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.690+0000 7f8bffa87640 1 -- 10.20.193.90:0/893976848 shutdown_connections 2026-02-17T12:06:36.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.690+0000 7f8bffa87640 1 --2- 10.20.193.90:0/893976848 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f8bd403dd20 0x7f8bd40401e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.690+0000 7f8bffa87640 1 --2- 10.20.193.90:0/893976848 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8bf810ed40 0x7f8bf81a5860 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.690+0000 7f8bffa87640 1 -- 10.20.193.90:0/893976848 >> 10.20.193.90:0/893976848 conn(0x7f8bf8075ed0 msgr2=0x7f8bf810dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:36.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.690+0000 7f8bffa87640 1 -- 10.20.193.90:0/893976848 shutdown_connections 2026-02-17T12:06:36.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.690+0000 7f8bffa87640 1 -- 10.20.193.90:0/893976848 wait complete. 2026-02-17T12:06:36.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.690+0000 7f7227b8d640 1 -- 10.20.193.90:0/1803592238 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f722010aae0 con 0x7f722010a680 2026-02-17T12:06:36.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.690+0000 7f720effd640 1 -- 10.20.193.90:0/1803592238 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7210040360 con 0x7f722010a680 2026-02-17T12:06:36.693 INFO:teuthology.orchestra.run.trial090.stdout:38654705671 2026-02-17T12:06:36.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 10 mgrc shutdown 2026-02-17T12:06:36.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 1 -- 10.20.193.90:0/1803592238 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f71fc03dd70 msgr2=0x7f71fc040230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:36.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 1 --2- 10.20.193.90:0/1803592238 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f71fc03dd70 0x7f71fc040230 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f72140099c0 tx=0x7f7214006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 1 -- 10.20.193.90:0/1803592238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f722010a680 msgr2=0x7f722019b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:36.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 1 --2- 10.20.193.90:0/1803592238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f722010a680 0x7f722019b6d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7210002410 tx=0x7f7210004290 comp rx=0 tx=0).stop 2026-02-17T12:06:36.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 1 -- 10.20.193.90:0/1803592238 shutdown_connections 2026-02-17T12:06:36.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 1 --2- 10.20.193.90:0/1803592238 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f71fc03dd70 0x7f71fc040230 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 1 --2- 10.20.193.90:0/1803592238 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f722010a680 0x7f722019b6d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 1 -- 10.20.193.90:0/1803592238 >> 10.20.193.90:0/1803592238 conn(0x7f7220100710 msgr2=0x7f7220106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:36.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 1 -- 10.20.193.90:0/1803592238 shutdown_connections 2026-02-17T12:06:36.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.692+0000 7f7227b8d640 1 -- 10.20.193.90:0/1803592238 wait complete. 2026-02-17T12:06:36.730 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2026-02-17T12:06:36.731 DEBUG:teuthology.parallel:result is None 2026-02-17T12:06:36.732 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2026-02-17T12:06:36.732 DEBUG:teuthology.parallel:result is None 2026-02-17T12:06:36.732 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-17T12:06:36.733 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T12:06:36.883 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:36.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.990+0000 7f51bd0d2640 1 -- 10.20.193.90:0/375434107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f51b810a690 msgr2=0x7f51b810aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:36.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.990+0000 7f51bd0d2640 1 --2- 10.20.193.90:0/375434107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f51b810a690 0x7f51b810aa70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0099b0 tx=0x7f51ac02f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.990+0000 7f51bd0d2640 1 -- 10.20.193.90:0/375434107 shutdown_connections 2026-02-17T12:06:36.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.990+0000 7f51bd0d2640 1 --2- 10.20.193.90:0/375434107 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f51b810a690 0x7f51b810aa70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:36.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.990+0000 7f51bd0d2640 1 -- 10.20.193.90:0/375434107 >> 10.20.193.90:0/375434107 conn(0x7f51b8100370 msgr2=0x7f51b8102790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:36.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.990+0000 7f51bd0d2640 1 -- 10.20.193.90:0/375434107 shutdown_connections 2026-02-17T12:06:36.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.990+0000 7f51bd0d2640 1 -- 10.20.193.90:0/375434107 wait complete. 2026-02-17T12:06:36.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.990+0000 7f51bd0d2640 1 Processor -- start 2026-02-17T12:06:36.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f51bd0d2640 1 -- start start 2026-02-17T12:06:36.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f51bd0d2640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f51b810a690 0x7f51b819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f51bd0d2640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51b810e0a0 con 0x7f51b810a690 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f51b6d76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f51b810a690 0x7f51b819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f51b6d76640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f51b810a690 0x7f51b819b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58458/0 (socket says 10.20.193.90:58458) 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f51b6d76640 1 -- 10.20.193.90:0/1346760568 learned_addr learned my addr 10.20.193.90:0/1346760568 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f51b6d76640 1 -- 10.20.193.90:0/1346760568 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b819bbb0 con 0x7f51b810a690 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f51b6d76640 1 --2- 10.20.193.90:0/1346760568 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f51b810a690 0x7f51b819b670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f51ac004290 tx=0x7f51ac0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f5197fff640 1 -- 10.20.193.90:0/1346760568 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51ac038510 con 0x7f51b810a690 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f5197fff640 1 -- 10.20.193.90:0/1346760568 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f51ac046070 con 0x7f51b810a690 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f51bd0d2640 1 -- 10.20.193.90:0/1346760568 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b819be40 con 0x7f51b810a690 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f5197fff640 1 -- 10.20.193.90:0/1346760568 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51ac041610 con 0x7f51b810a690 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.991+0000 7f51bd0d2640 1 -- 10.20.193.90:0/1346760568 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b819ff40 con 0x7f51b810a690 2026-02-17T12:06:36.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.992+0000 7f51bd0d2640 1 -- 10.20.193.90:0/1346760568 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b8105dd0 con 0x7f51b810a690 2026-02-17T12:06:36.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.992+0000 7f5197fff640 1 -- 10.20.193.90:0/1346760568 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7f51ac0386b0 con 0x7f51b810a690 2026-02-17T12:06:36.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.992+0000 7f5197fff640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T12:06:36.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.992+0000 7f5197fff640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T12:06:36.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.992+0000 7f5197fff640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:36.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.992+0000 7f5197fff640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:36.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.992+0000 7f5197fff640 1 --2- 10.20.193.90:0/1346760568 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f518c03dd70 0x7f518c040230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:36.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.992+0000 7f5197fff640 1 -- 10.20.193.90:0/1346760568 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f51ac0778a0 con 0x7f51b810a690 2026-02-17T12:06:36.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.992+0000 7f51b6575640 1 --2- 10.20.193.90:0/1346760568 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f518c03dd70 0x7f518c040230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:36.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.992+0000 7f51b6575640 1 --2- 10.20.193.90:0/1346760568 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f518c03dd70 0x7f518c040230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51a00099c0 tx=0x7f51a0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:36.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:36.994+0000 7f5197fff640 1 -- 10.20.193.90:0/1346760568 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f51ac040360 con 0x7f51b810a690 2026-02-17T12:06:37.080 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.079+0000 7f51bd0d2640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-17T12:06:37.080 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.079+0000 7f51bd0d2640 1 -- 10.20.193.90:0/1346760568 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51b810aaf0 con 0x7f518c03dd70 2026-02-17T12:06:37.081 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.079+0000 7f5197fff640 1 -- 10.20.193.90:0/1346760568 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+9992 (secure 0 0 0) 0x7f51b810aaf0 con 0x7f518c03dd70 2026-02-17T12:06:37.081 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.079+0000 7f5197fff640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:06:37.081 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:37.082 INFO:teuthology.orchestra.run.trial090.stderr:dumped all 2026-02-17T12:06:37.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 10 mgrc shutdown 2026-02-17T12:06:37.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 1 -- 10.20.193.90:0/1346760568 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f518c03dd70 msgr2=0x7f518c040230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:37.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 1 --2- 10.20.193.90:0/1346760568 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f518c03dd70 0x7f518c040230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51a00099c0 tx=0x7f51a0006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 1 -- 10.20.193.90:0/1346760568 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f51b810a690 msgr2=0x7f51b819b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:37.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 1 --2- 10.20.193.90:0/1346760568 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f51b810a690 0x7f51b819b670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f51ac004290 tx=0x7f51ac0042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 1 -- 10.20.193.90:0/1346760568 shutdown_connections 2026-02-17T12:06:37.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 1 --2- 10.20.193.90:0/1346760568 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f518c03dd70 0x7f518c040230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 1 --2- 10.20.193.90:0/1346760568 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f51b810a690 0x7f51b819b670 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 1 -- 10.20.193.90:0/1346760568 >> 10.20.193.90:0/1346760568 conn(0x7f51b8100370 msgr2=0x7f51b8108870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:37.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 1 -- 10.20.193.90:0/1346760568 shutdown_connections 2026-02-17T12:06:37.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.080+0000 7f51bd0d2640 1 -- 10.20.193.90:0/1346760568 wait complete. 2026-02-17T12:06:37.115 INFO:teuthology.orchestra.run.trial090.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2026-02-17T12:06:35.169509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":81432,"kb_used_data":520,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":2201928168,"statfs":{"total":2254857830400,"available":2254774444032,"internally_reserved":0,"allocated":532480,"data_stored":472280,"data_compressed":1905,"data_compressed_allocated":20480,"data_compressed_original":327680,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.704048"},"pg_stats":[{"pgid":"1.0","version":"20'72","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:06:33.147409+0000","last_change":"2026-02-17T12:06:32.962636+0000","last_active":"2026-02-17T12:06:33.147409+0000","last_peered":"2026-02-17T12:06:33.147409+0000","last_clean":"2026-02-17T12:06:33.147409+0000","last_became_active":"2026-02-17T12:06:32.962103+0000","last_became_peered":"2026-02-17T12:06:32.962103+0000","last_unstale":"2026-02-17T12:06:33.147409+0000","last_undegraded":"2026-02-17T12:06:33.147409+0000","last_fullsized":"2026-02-17T12:06:33.147409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:06:31.460222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:06:31.460222+0000","last_clean_scrub_stamp":"2026-02-17T12:06:31.460222+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:46:52.471734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":1771104,"data_compressed":29415,"data_compressed_allocated":110592,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411332,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27164,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733976036,"statfs":{"total":751619276800,"available":751591460864,"internally_reserved":0,"allocated":196608,"data_stored":377419,"data_compressed":1905,"data_compressed_allocated":20480,"data_compressed_original":327680,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27140,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733976060,"statfs":{"total":751619276800,"available":751591485440,"internally_reserved":0,"allocated":172032,"data_stored":49227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27128,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733976072,"statfs":{"total":751619276800,"available":751591497728,"internally_reserved":0,"allocated":163840,"data_stored":45634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9805,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9805,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9805,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:06:37.117 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T12:06:37.265 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:37.366 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.363+0000 7f3ade37b640 1 -- 10.20.193.90:0/3968989651 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3ad810a680 msgr2=0x7f3ad810aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:37.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.363+0000 7f3ade37b640 1 --2- 10.20.193.90:0/3968989651 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3ad810a680 0x7f3ad810aa60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40099b0 tx=0x7f3ac402f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.363+0000 7f3ade37b640 1 -- 10.20.193.90:0/3968989651 shutdown_connections 2026-02-17T12:06:37.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.363+0000 7f3ade37b640 1 --2- 10.20.193.90:0/3968989651 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3ad810a680 0x7f3ad810aa60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.363+0000 7f3ade37b640 1 -- 10.20.193.90:0/3968989651 >> 10.20.193.90:0/3968989651 conn(0x7f3ad8100710 msgr2=0x7f3ad8102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:37.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.363+0000 7f3ade37b640 1 -- 10.20.193.90:0/3968989651 shutdown_connections 2026-02-17T12:06:37.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.363+0000 7f3ade37b640 1 -- 10.20.193.90:0/3968989651 wait complete. 2026-02-17T12:06:37.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.363+0000 7f3ade37b640 1 Processor -- start 2026-02-17T12:06:37.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ade37b640 1 -- start start 2026-02-17T12:06:37.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ade37b640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3ad810a680 0x7f3ad819b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ade37b640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad810e090 con 0x7f3ad810a680 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ad7fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3ad810a680 0x7f3ad819b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ad7fff640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3ad810a680 0x7f3ad819b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58486/0 (socket says 10.20.193.90:58486) 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ad7fff640 1 -- 10.20.193.90:0/1500076710 learned_addr learned my addr 10.20.193.90:0/1500076710 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ad7fff640 1 -- 10.20.193.90:0/1500076710 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad819bbd0 con 0x7f3ad810a680 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ad7fff640 1 --2- 10.20.193.90:0/1500076710 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3ad810a680 0x7f3ad819b690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4004290 tx=0x7f3ac40042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ad57fa640 1 -- 10.20.193.90:0/1500076710 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ac4038510 con 0x7f3ad810a680 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ad57fa640 1 -- 10.20.193.90:0/1500076710 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f3ac4046070 con 0x7f3ad810a680 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ad57fa640 1 -- 10.20.193.90:0/1500076710 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ac4041610 con 0x7f3ad810a680 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ade37b640 1 -- 10.20.193.90:0/1500076710 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad819be60 con 0x7f3ad810a680 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.364+0000 7f3ade37b640 1 -- 10.20.193.90:0/1500076710 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad819ff60 con 0x7f3ad810a680 2026-02-17T12:06:37.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.365+0000 7f3ad57fa640 1 -- 10.20.193.90:0/1500076710 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7f3ac40386b0 con 0x7f3ad810a680 2026-02-17T12:06:37.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.365+0000 7f3ad57fa640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T12:06:37.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.365+0000 7f3ade37b640 1 -- 10.20.193.90:0/1500076710 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad8105dc0 con 0x7f3ad810a680 2026-02-17T12:06:37.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.365+0000 7f3ad57fa640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T12:06:37.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.365+0000 7f3ad57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:37.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.365+0000 7f3ad57fa640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:37.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.365+0000 7f3ad57fa640 1 --2- 10.20.193.90:0/1500076710 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3aac03dd70 0x7f3aac040230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:37.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.365+0000 7f3ad57fa640 1 -- 10.20.193.90:0/1500076710 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f3ac40778a0 con 0x7f3ad810a680 2026-02-17T12:06:37.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.365+0000 7f3ad77fe640 1 --2- 10.20.193.90:0/1500076710 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3aac03dd70 0x7f3aac040230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:37.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.365+0000 7f3ad77fe640 1 --2- 10.20.193.90:0/1500076710 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3aac03dd70 0x7f3aac040230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80099c0 tx=0x7f3ac8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:37.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.367+0000 7f3ad57fa640 1 -- 10.20.193.90:0/1500076710 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3ac4040360 con 0x7f3ad810a680 2026-02-17T12:06:37.452 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.451+0000 7f3ade37b640 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2026-02-17T12:06:37.453 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.451+0000 7f3ade37b640 1 -- 10.20.193.90:0/1500076710 --> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ad810aae0 con 0x7f3aac03dd70 2026-02-17T12:06:37.453 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.452+0000 7f3ad57fa640 1 -- 10.20.193.90:0/1500076710 <== mgr.14150 v2:10.20.193.90:6800/3256128927 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+10008 (secure 0 0 0) 0x7f3ad810aae0 con 0x7f3aac03dd70 2026-02-17T12:06:37.453 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.452+0000 7f3ad57fa640 20 mgrc handle_command_reply tid 0 r 0 2026-02-17T12:06:37.454 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:37.455 INFO:teuthology.orchestra.run.trial090.stderr:dumped all 2026-02-17T12:06:37.455 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 10 mgrc shutdown 2026-02-17T12:06:37.455 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 1 -- 10.20.193.90:0/1500076710 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3aac03dd70 msgr2=0x7f3aac040230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:37.455 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 1 --2- 10.20.193.90:0/1500076710 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3aac03dd70 0x7f3aac040230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80099c0 tx=0x7f3ac8006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.455 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 1 -- 10.20.193.90:0/1500076710 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3ad810a680 msgr2=0x7f3ad819b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:37.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 1 --2- 10.20.193.90:0/1500076710 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3ad810a680 0x7f3ad819b690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4004290 tx=0x7f3ac40042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 1 -- 10.20.193.90:0/1500076710 shutdown_connections 2026-02-17T12:06:37.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 1 --2- 10.20.193.90:0/1500076710 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f3aac03dd70 0x7f3aac040230 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 1 --2- 10.20.193.90:0/1500076710 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3ad810a680 0x7f3ad819b690 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 1 -- 10.20.193.90:0/1500076710 >> 10.20.193.90:0/1500076710 conn(0x7f3ad8100710 msgr2=0x7f3ad8106660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:37.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 1 -- 10.20.193.90:0/1500076710 shutdown_connections 2026-02-17T12:06:37.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.453+0000 7f3ade37b640 1 -- 10.20.193.90:0/1500076710 wait complete. 2026-02-17T12:06:37.490 INFO:teuthology.orchestra.run.trial090.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2026-02-17T12:06:37.169735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":2202009600,"kb_used":81572,"kb_used_data":632,"kb_used_omap":4,"kb_used_meta":80827,"kb_avail":2201928028,"statfs":{"total":2254857830400,"available":2254774300672,"internally_reserved":0,"allocated":647168,"data_stored":1335587,"data_compressed":19610,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82767186},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.704273"},"pg_stats":[{"pgid":"1.0","version":"20'72","reported_seq":100,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-17T12:06:33.147409+0000","last_change":"2026-02-17T12:06:32.962636+0000","last_active":"2026-02-17T12:06:33.147409+0000","last_peered":"2026-02-17T12:06:33.147409+0000","last_clean":"2026-02-17T12:06:33.147409+0000","last_became_active":"2026-02-17T12:06:32.962103+0000","last_became_peered":"2026-02-17T12:06:32.962103+0000","last_unstale":"2026-02-17T12:06:33.147409+0000","last_undegraded":"2026-02-17T12:06:33.147409+0000","last_fullsized":"2026-02-17T12:06:33.147409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T12:06:31.460222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T12:06:31.460222+0000","last_clean_scrub_stamp":"2026-02-17T12:06:31.460222+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T12:46:52.471734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":1771104,"data_compressed":29415,"data_compressed_allocated":110592,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411333,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27216,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975984,"statfs":{"total":751619276800,"available":751591407616,"internally_reserved":0,"allocated":237568,"data_stored":643180,"data_compressed":9805,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27140,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733976060,"statfs":{"total":751619276800,"available":751591485440,"internally_reserved":0,"allocated":172032,"data_stored":49227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27216,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975984,"statfs":{"total":751619276800,"available":751591407616,"internally_reserved":0,"allocated":237568,"data_stored":643180,"data_compressed":9805,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9805,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9805,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":9805,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T12:06:37.491 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-17T12:06:37.491 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T12:06:37.491 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-17T12:06:37.491 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:3c96dfb3f50b3d02598a82af7104764bfdcd3919 shell --fsid ea07e39e-0bf8-11f1-bf0e-d404e6e7d460 -- ceph health --format=json 2026-02-17T12:06:37.640 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/mon.a/config 2026-02-17T12:06:37.662 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:37 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3247327878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T12:06:37.662 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:37 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/893976848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T12:06:37.663 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:37 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/1803592238' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T12:06:37.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.748+0000 7f6ea5878640 1 -- 10.20.193.90:0/1235176538 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ea010a690 msgr2=0x7f6ea010aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:37.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.748+0000 7f6ea5878640 1 --2- 10.20.193.90:0/1235176538 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ea010a690 0x7f6ea010aa70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6e940099b0 tx=0x7f6e9402f2b0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.748+0000 7f6ea5878640 1 -- 10.20.193.90:0/1235176538 shutdown_connections 2026-02-17T12:06:37.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.748+0000 7f6ea5878640 1 --2- 10.20.193.90:0/1235176538 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ea010a690 0x7f6ea010aa70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.748+0000 7f6ea5878640 1 -- 10.20.193.90:0/1235176538 >> 10.20.193.90:0/1235176538 conn(0x7f6ea0100370 msgr2=0x7f6ea0102790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:37.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.748+0000 7f6ea5878640 1 -- 10.20.193.90:0/1235176538 shutdown_connections 2026-02-17T12:06:37.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.748+0000 7f6ea5878640 1 -- 10.20.193.90:0/1235176538 wait complete. 2026-02-17T12:06:37.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.748+0000 7f6ea5878640 1 Processor -- start 2026-02-17T12:06:37.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.748+0000 7f6ea5878640 1 -- start start 2026-02-17T12:06:37.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6ea5878640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ea010a690 0x7f6ea019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6ea5878640 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea010e0a0 con 0x7f6ea010a690 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6e9effd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ea010a690 0x7f6ea019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6e9effd640 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ea010a690 0x7f6ea019b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58512/0 (socket says 10.20.193.90:58512) 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6e9effd640 1 -- 10.20.193.90:0/3070050730 learned_addr learned my addr 10.20.193.90:0/3070050730 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6e9effd640 1 -- 10.20.193.90:0/3070050730 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea019bbb0 con 0x7f6ea010a690 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6e9effd640 1 --2- 10.20.193.90:0/3070050730 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ea010a690 0x7f6ea019b670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6e94004290 tx=0x7f6e940042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6ea4876640 1 -- 10.20.193.90:0/3070050730 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e94038510 con 0x7f6ea010a690 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6ea4876640 1 -- 10.20.193.90:0/3070050730 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(24 keys) ==== 1006+0+0 (secure 0 0 0) 0x7f6e94046070 con 0x7f6ea010a690 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6ea5878640 1 -- 10.20.193.90:0/3070050730 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea019be40 con 0x7f6ea010a690 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6ea4876640 1 -- 10.20.193.90:0/3070050730 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e94041610 con 0x7f6ea010a690 2026-02-17T12:06:37.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6ea5878640 1 -- 10.20.193.90:0/3070050730 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea019ff40 con 0x7f6ea010a690 2026-02-17T12:06:37.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.749+0000 7f6ea5878640 1 -- 10.20.193.90:0/3070050730 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea0105dd0 con 0x7f6ea010a690 2026-02-17T12:06:37.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.750+0000 7f6ea4876640 1 -- 10.20.193.90:0/3070050730 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 50359+0+0 (secure 0 0 0) 0x7f6e940386b0 con 0x7f6ea010a690 2026-02-17T12:06:37.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.750+0000 7f6ea4876640 20 mgrc handle_mgr_map mgrmap(e 14) 2026-02-17T12:06:37.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.750+0000 7f6ea4876640 4 mgrc handle_mgr_map Got map version 14 2026-02-17T12:06:37.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.750+0000 7f6ea4876640 4 mgrc handle_mgr_map Active mgr is now [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:37.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.750+0000 7f6ea4876640 4 mgrc reconnect Starting new session with [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] 2026-02-17T12:06:37.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.750+0000 7f6ea4876640 1 --2- 10.20.193.90:0/3070050730 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f6e7403dd20 0x7f6e740401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T12:06:37.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.750+0000 7f6ea4876640 1 -- 10.20.193.90:0/3070050730 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3015+0+0 (secure 0 0 0) 0x7f6e94077900 con 0x7f6ea010a690 2026-02-17T12:06:37.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.750+0000 7f6e9e7fc640 1 --2- 10.20.193.90:0/3070050730 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f6e7403dd20 0x7f6e740401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T12:06:37.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.750+0000 7f6e9e7fc640 1 --2- 10.20.193.90:0/3070050730 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f6e7403dd20 0x7f6e740401e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e880099c0 tx=0x7f6e88006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T12:06:37.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.752+0000 7f6ea4876640 1 -- 10.20.193.90:0/3070050730 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6e94040360 con 0x7f6ea010a690 2026-02-17T12:06:37.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.851+0000 7f6ea5878640 1 -- 10.20.193.90:0/3070050730 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6ea010aaf0 con 0x7f6ea010a690 2026-02-17T12:06:37.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.851+0000 7f6ea4876640 1 -- 10.20.193.90:0/3070050730 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6e94049360 con 0x7f6ea010a690 2026-02-17T12:06:37.853 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:37.853 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T12:06:37.854 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 10 mgrc shutdown 2026-02-17T12:06:37.854 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 1 -- 10.20.193.90:0/3070050730 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f6e7403dd20 msgr2=0x7f6e740401e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:37.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 1 --2- 10.20.193.90:0/3070050730 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f6e7403dd20 0x7f6e740401e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e880099c0 tx=0x7f6e88006eb0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 1 -- 10.20.193.90:0/3070050730 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ea010a690 msgr2=0x7f6ea019b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T12:06:37.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 1 --2- 10.20.193.90:0/3070050730 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ea010a690 0x7f6ea019b670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6e94004290 tx=0x7f6e940042c0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 1 -- 10.20.193.90:0/3070050730 shutdown_connections 2026-02-17T12:06:37.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 1 --2- 10.20.193.90:0/3070050730 >> [v2:10.20.193.90:6800/3256128927,v1:10.20.193.90:6801/3256128927] conn(0x7f6e7403dd20 0x7f6e740401e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 1 --2- 10.20.193.90:0/3070050730 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ea010a690 0x7f6ea019b670 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T12:06:37.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 1 -- 10.20.193.90:0/3070050730 >> 10.20.193.90:0/3070050730 conn(0x7f6ea0100370 msgr2=0x7f6ea0108870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T12:06:37.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 1 -- 10.20.193.90:0/3070050730 shutdown_connections 2026-02-17T12:06:37.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-17T12:06:37.852+0000 7f6ea5878640 1 -- 10.20.193.90:0/3070050730 wait complete. 2026-02-17T12:06:37.888 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-17T12:06:37.888 INFO:tasks.cephadm:Setup complete, yielding 2026-02-17T12:06:37.888 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T12:06:37.903 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T12:06:37.904 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(OSD_DOWN\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T12:06:37.904 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51396', 'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'description': 'rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '51396', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0'], ['host.b', 'client.1']], 'seed': 4581, 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath20-testing-2026-02-13-0906-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'targets': {'trial090.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBByHcE3LUb494KNjyks1YX1XVOc1RrvJqFm/dBJ9A5NqbeoHRISJx7QDOoM4p70HMv80t3/qcAiZTLikNzjb1S4=', 'trial198.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIVIr68a9YcwVEJSDZg+al4xvB5uszLuwhswzWvuhPMbm/l2bGpj1WcnxXSKrln4o8dc6SR42/Hl/554ml+5sIM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'pexec': {'all': ['sudo dnf remove nvme-cli -y', 'sudo dnf install nvmetcli nvme-cli -y']}}, {'install': None}, {'cephadm': None}, {'ceph': {'log-ignorelist': ['\\(OSD_DOWN\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_DEGRADED\\)'], 'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '3c96dfb3f50b3d02598a82af7104764bfdcd3919', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.1': ['cephadm/create_iscsi_disks.sh']}}}, {'workunit': {'clients': {'client.0': ['cephadm/test_dashboard_e2e.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_04:10:36', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T12:06:37.905 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T12:06:37.907 DEBUG:teuthology.orchestra.run.trial198:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T12:06:37.926 DEBUG:teuthology.orchestra.run.trial090:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T12:06:37.964 DEBUG:teuthology.orchestra.run.trial198:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T12:06:37.991 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:06:37.991 DEBUG:teuthology.orchestra.run.trial090:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T12:06:38.043 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T12:06:38.044 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_1 2026-02-17T12:06:38.101 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T12:06:38.101 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:06:38.101 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 3643 Links: 1 2026-02-17T12:06:38.101 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:06:38.102 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:06:38.102 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-17 12:06:23.692531747 +0000 2026-02-17T12:06:38.102 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-17 12:06:23.062542094 +0000 2026-02-17T12:06:38.102 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-17 12:06:23.062542094 +0000 2026-02-17T12:06:38.102 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-17 12:06:23.062542094 +0000 2026-02-17T12:06:38.102 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T12:06:38.164 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-17T12:06:38.165 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-17T12:06:38.165 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000166639 s, 3.1 MB/s 2026-02-17T12:06:38.166 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T12:06:38.223 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_2 2026-02-17T12:06:38.281 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T12:06:38.281 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:06:38.281 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 3943 Links: 1 2026-02-17T12:06:38.281 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:06:38.281 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:06:38.281 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-17 12:06:27.948461846 +0000 2026-02-17T12:06:38.282 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-17 12:06:27.948461846 +0000 2026-02-17T12:06:38.282 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-17 12:06:27.948461846 +0000 2026-02-17T12:06:38.282 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-17 12:06:27.948461846 +0000 2026-02-17T12:06:38.282 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T12:06:38.343 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-17T12:06:38.343 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-17T12:06:38.343 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000115804 s, 4.4 MB/s 2026-02-17T12:06:38.344 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T12:06:38.401 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_3 2026-02-17T12:06:38.458 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T12:06:38.459 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:06:38.459 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 3370 Links: 1 2026-02-17T12:06:38.459 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:06:38.459 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:06:38.459 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-17 12:06:23.692531747 +0000 2026-02-17T12:06:38.459 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-17 12:06:18.640608813 +0000 2026-02-17T12:06:38.459 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-17 12:06:18.640608813 +0000 2026-02-17T12:06:38.459 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-17 12:06:18.640608813 +0000 2026-02-17T12:06:38.460 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T12:06:38.521 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-17T12:06:38.521 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-17T12:06:38.521 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 3.7439e-05 s, 13.7 MB/s 2026-02-17T12:06:38.522 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T12:06:38.580 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_4 2026-02-17T12:06:38.637 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T12:06:38.637 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T12:06:38.637 INFO:teuthology.orchestra.run.trial090.stdout:Device: 6h/6d Inode: 2350 Links: 1 2026-02-17T12:06:38.637 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T12:06:38.637 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T12:06:38.637 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-17 12:06:23.692531747 +0000 2026-02-17T12:06:38.637 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-17 12:06:07.696763901 +0000 2026-02-17T12:06:38.637 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-17 12:06:07.696763901 +0000 2026-02-17T12:06:38.638 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-17 12:06:07.696763901 +0000 2026-02-17T12:06:38.638 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T12:06:38.699 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:38 trial090 ceph-mon[39228]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T12:06:38.700 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:38 trial090 ceph-mon[39228]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:06:38.700 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:38 trial090 ceph-mon[39228]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T12:06:38.700 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:38 trial090 ceph-mon[39228]: from='client.? 10.20.193.90:0/3070050730' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-17T12:06:38.701 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-17T12:06:38.702 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-17T12:06:38.702 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 2.7661e-05 s, 18.5 MB/s 2026-02-17T12:06:38.703 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T12:06:38.760 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:06:38.760 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T12:06:38.760 INFO:tasks.ceph:Generating config... 2026-02-17T12:06:38.762 INFO:tasks.ceph:[client] debug client = 20 2026-02-17T12:06:38.762 INFO:tasks.ceph:[client] debug mgrc = 20 2026-02-17T12:06:38.762 INFO:tasks.ceph:[client] debug ms = 1 2026-02-17T12:06:38.763 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-17T12:06:38.763 INFO:tasks.ceph:[mds] debug mgrc = 20 2026-02-17T12:06:38.763 INFO:tasks.ceph:[mgr] debug client = 20 2026-02-17T12:06:38.763 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T12:06:38.763 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T12:06:38.763 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T12:06:38.763 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T12:06:38.763 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T12:06:38.763 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T12:06:38.763 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2026-02-17T12:06:38.763 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] debug mgrc = 20 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T12:06:38.764 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T12:06:38.765 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T12:06:38.765 DEBUG:teuthology.orchestra.run.trial090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T12:06:38.835 INFO:teuthology.orchestra.run.trial090.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T12:06:38.838 DEBUG:teuthology.orchestra.run.trial090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T12:06:38.913 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T12:06:38.976 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.90')] 2026-02-17T12:06:38.977 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.90', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'mon.a': {}, 'mds': {'debug mgrc': 20}} 2026-02-17T12:06:38.978 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:06:38.979 DEBUG:teuthology.orchestra.run.trial090:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T12:06:39.033 DEBUG:teuthology.orchestra.run.trial090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.90 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:06:39.105 INFO:teuthology.orchestra.run.trial090.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:06:39.106 INFO:teuthology.orchestra.run.trial090.stdout:monmaptool: generated fsid 849b6112-b711-4ca0-bbb0-f14adea3e7ff 2026-02-17T12:06:39.106 INFO:teuthology.orchestra.run.trial090.stdout:setting min_mon_release = quincy 2026-02-17T12:06:39.106 INFO:teuthology.orchestra.run.trial090.stdout:epoch 0 2026-02-17T12:06:39.106 INFO:teuthology.orchestra.run.trial090.stdout:fsid 849b6112-b711-4ca0-bbb0-f14adea3e7ff 2026-02-17T12:06:39.106 INFO:teuthology.orchestra.run.trial090.stdout:last_changed 2026-02-17T12:06:39.105815+0000 2026-02-17T12:06:39.106 INFO:teuthology.orchestra.run.trial090.stdout:created 2026-02-17T12:06:39.105815+0000 2026-02-17T12:06:39.106 INFO:teuthology.orchestra.run.trial090.stdout:min_mon_release 17 (quincy) 2026-02-17T12:06:39.106 INFO:teuthology.orchestra.run.trial090.stdout:election_strategy: 3 2026-02-17T12:06:39.107 INFO:teuthology.orchestra.run.trial090.stdout:0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-17T12:06:39.107 INFO:teuthology.orchestra.run.trial090.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-17T12:06:39.108 DEBUG:teuthology.orchestra.run.trial090:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T12:06:39.164 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 849b6112-b711-4ca0-bbb0-f14adea3e7ff... 2026-02-17T12:06:39.165 DEBUG:teuthology.orchestra.run.trial090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T12:06:39.206 DEBUG:teuthology.orchestra.run.trial198:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T12:06:39.245 INFO:teuthology.orchestra.run.trial090.stdout:[global] 2026-02-17T12:06:39.245 INFO:teuthology.orchestra.run.trial090.stdout: chdir = "" 2026-02-17T12:06:39.245 INFO:teuthology.orchestra.run.trial090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T12:06:39.245 INFO:teuthology.orchestra.run.trial090.stdout: auth supported = cephx 2026-02-17T12:06:39.245 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.245 INFO:teuthology.orchestra.run.trial090.stdout: filestore xattr use omap = true 2026-02-17T12:06:39.245 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: mon clock drift allowed = 1.000 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: osd crush chooseleaf type = 0 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: auth debug = true 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: ms die on old message = true 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: ms die on bug = true 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: mon pg warn max object skew = 0 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.246 INFO:teuthology.orchestra.run.trial090.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: osd pool default size = 2 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: mon osd allow primary affinity = true 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: mon osd allow pg remap = true 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: mon warn on legacy crush tunables = false 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: mon warn on crush straw calc version zero = false 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: mon warn on no sortbitwise = false 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: mon warn on osd down out interval zero = false 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: mon warn on too few osds = false 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T12:06:39.247 INFO:teuthology.orchestra.run.trial090.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: mon_allow_pool_size_one = true 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: osd default data pool replay window = 5 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: mon allow pool delete = true 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: mon cluster log file level = debug 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: debug asserts on shutdown = true 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: mon health detail to clog = false 2026-02-17T12:06:39.248 INFO:teuthology.orchestra.run.trial090.stdout: mon host = 10.20.193.90 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: mon election default strategy = 3 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: fsid = 849b6112-b711-4ca0-bbb0-f14adea3e7ff 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout:[osd] 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: osd journal size = 100 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: osd scrub load threshold = 5.0 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: osd scrub max interval = 600 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: osd mclock profile = high_recovery_ops 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: osd recover clone overlap = true 2026-02-17T12:06:39.249 INFO:teuthology.orchestra.run.trial090.stdout: osd recovery max chunk = 1048576 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: osd debug shutdown = true 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: osd debug op order = true 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: osd debug verify stray on activate = true 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: osd debug trim objects = true 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: osd open classes on start = true 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: osd debug pg log writeout = true 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: osd deep scrub update digest min age = 30 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.250 INFO:teuthology.orchestra.run.trial090.stdout: osd map max advance = 10 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: journal zero on create = true 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: filestore ondisk finisher threads = 3 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: filestore apply finisher threads = 3 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: bdev debug aio = true 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: osd debug misdirected ops = true 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: bluestore block size = 96636764160 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: bluestore compression algorithm = lz4 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: bluestore compression mode = aggressive 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: bluestore fsck on mount = True 2026-02-17T12:06:39.251 INFO:teuthology.orchestra.run.trial090.stdout: debug bluefs = 1/20 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: debug bluestore = 1/20 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: debug mgrc = 20 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: debug ms = 1 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: debug osd = 20 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: debug rocksdb = 4/10 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: mon osd full ratio = 0.9 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: mon osd nearfull ratio = 0.8 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: osd failsafe full ratio = 0.95 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: osd objectstore = bluestore 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout:[mgr] 2026-02-17T12:06:39.252 INFO:teuthology.orchestra.run.trial090.stdout: debug ms = 1 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: debug mgr = 20 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: debug mon = 20 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: debug auth = 20 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: mon reweight min pgs per osd = 4 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: mon reweight min bytes per osd = 10 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: mgr/telemetry/nag = false 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: debug client = 20 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout:[mon] 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: debug ms = 1 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: debug mon = 20 2026-02-17T12:06:39.253 INFO:teuthology.orchestra.run.trial090.stdout: debug paxos = 20 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: debug auth = 20 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: mon data avail warn = 5 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: mon mgr mkfs grace = 240 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: mon reweight min pgs per osd = 4 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: mon osd reporter subtree level = osd 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: mon osd prime pg temp = true 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: mon reweight min bytes per osd = 10 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.254 INFO:teuthology.orchestra.run.trial090.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: # 1m isn't quite enough 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: mon_down_mkfs_grace = 2m 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: mon_warn_on_filestore_osds = false 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout:[client] 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: rgw cache enabled = true 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: rgw enable ops log = true 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: rgw enable usage log = true 2026-02-17T12:06:39.255 INFO:teuthology.orchestra.run.trial090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T12:06:39.256 INFO:teuthology.orchestra.run.trial090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T12:06:39.256 INFO:teuthology.orchestra.run.trial090.stdout: debug client = 20 2026-02-17T12:06:39.256 INFO:teuthology.orchestra.run.trial090.stdout: debug mgrc = 20 2026-02-17T12:06:39.256 INFO:teuthology.orchestra.run.trial090.stdout: debug ms = 1 2026-02-17T12:06:39.256 INFO:teuthology.orchestra.run.trial090.stdout:[mon.a] 2026-02-17T12:06:39.256 INFO:teuthology.orchestra.run.trial090.stdout:[mds] 2026-02-17T12:06:39.256 INFO:teuthology.orchestra.run.trial090.stdout: debug mgrc = 20 2026-02-17T12:06:39.257 INFO:teuthology.orchestra.run.trial198.stdout:[global] 2026-02-17T12:06:39.257 INFO:teuthology.orchestra.run.trial198.stdout: chdir = "" 2026-02-17T12:06:39.257 INFO:teuthology.orchestra.run.trial198.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T12:06:39.257 INFO:teuthology.orchestra.run.trial198.stdout: auth supported = cephx 2026-02-17T12:06:39.257 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.257 INFO:teuthology.orchestra.run.trial198.stdout: filestore xattr use omap = true 2026-02-17T12:06:39.257 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.257 INFO:teuthology.orchestra.run.trial198.stdout: mon clock drift allowed = 1.000 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: osd crush chooseleaf type = 0 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: auth debug = true 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: ms die on old message = true 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: ms die on bug = true 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: mon pg warn max object skew = 0 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T12:06:39.258 INFO:teuthology.orchestra.run.trial198.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: osd pool default size = 2 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: mon osd allow primary affinity = true 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: mon osd allow pg remap = true 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: mon warn on legacy crush tunables = false 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: mon warn on crush straw calc version zero = false 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: mon warn on no sortbitwise = false 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: mon warn on osd down out interval zero = false 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: mon warn on too few osds = false 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T12:06:39.259 INFO:teuthology.orchestra.run.trial198.stdout: mon_allow_pool_size_one = true 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: osd default data pool replay window = 5 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: mon allow pool delete = true 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: mon cluster log file level = debug 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: debug asserts on shutdown = true 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: mon health detail to clog = false 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: mon host = 10.20.193.90 2026-02-17T12:06:39.260 INFO:teuthology.orchestra.run.trial198.stdout: mon election default strategy = 3 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: fsid = 849b6112-b711-4ca0-bbb0-f14adea3e7ff 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout:[osd] 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: osd journal size = 100 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: osd scrub load threshold = 5.0 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: osd scrub max interval = 600 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: osd mclock profile = high_recovery_ops 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: osd recover clone overlap = true 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: osd recovery max chunk = 1048576 2026-02-17T12:06:39.261 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: osd debug shutdown = true 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: osd debug op order = true 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: osd debug verify stray on activate = true 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: osd debug trim objects = true 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: osd open classes on start = true 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: osd debug pg log writeout = true 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: osd deep scrub update digest min age = 30 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: osd map max advance = 10 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.262 INFO:teuthology.orchestra.run.trial198.stdout: journal zero on create = true 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: filestore ondisk finisher threads = 3 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: filestore apply finisher threads = 3 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: bdev debug aio = true 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: osd debug misdirected ops = true 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: bluestore block size = 96636764160 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: bluestore compression algorithm = lz4 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: bluestore compression mode = aggressive 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: bluestore fsck on mount = True 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: debug bluefs = 1/20 2026-02-17T12:06:39.263 INFO:teuthology.orchestra.run.trial198.stdout: debug bluestore = 1/20 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: debug mgrc = 20 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: debug ms = 1 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: debug osd = 20 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: debug rocksdb = 4/10 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: mon osd full ratio = 0.9 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: mon osd nearfull ratio = 0.8 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: osd failsafe full ratio = 0.95 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: osd objectstore = bluestore 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout:[mgr] 2026-02-17T12:06:39.264 INFO:teuthology.orchestra.run.trial198.stdout: debug ms = 1 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: debug mgr = 20 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: debug mon = 20 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: debug auth = 20 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: mon reweight min pgs per osd = 4 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: mon reweight min bytes per osd = 10 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: mgr/telemetry/nag = false 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: debug client = 20 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout:[mon] 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: debug ms = 1 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: debug mon = 20 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: debug paxos = 20 2026-02-17T12:06:39.265 INFO:teuthology.orchestra.run.trial198.stdout: debug auth = 20 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: mon data avail warn = 5 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: mon mgr mkfs grace = 240 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: mon reweight min pgs per osd = 4 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: mon osd reporter subtree level = osd 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: mon osd prime pg temp = true 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: mon reweight min bytes per osd = 10 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T12:06:39.266 INFO:teuthology.orchestra.run.trial198.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: # 1m isn't quite enough 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: mon_down_mkfs_grace = 2m 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: mon_warn_on_filestore_osds = false 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout:[client] 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: rgw cache enabled = true 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: rgw enable ops log = true 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: rgw enable usage log = true 2026-02-17T12:06:39.267 INFO:teuthology.orchestra.run.trial198.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T12:06:39.268 INFO:teuthology.orchestra.run.trial198.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T12:06:39.268 INFO:teuthology.orchestra.run.trial198.stdout: debug client = 20 2026-02-17T12:06:39.268 INFO:teuthology.orchestra.run.trial198.stdout: debug mgrc = 20 2026-02-17T12:06:39.268 INFO:teuthology.orchestra.run.trial198.stdout: debug ms = 1 2026-02-17T12:06:39.268 INFO:teuthology.orchestra.run.trial198.stdout:[mon.a] 2026-02-17T12:06:39.268 INFO:teuthology.orchestra.run.trial198.stdout:[mds] 2026-02-17T12:06:39.268 INFO:teuthology.orchestra.run.trial198.stdout: debug mgrc = 20 2026-02-17T12:06:39.270 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T12:06:39.270 DEBUG:teuthology.orchestra.run.trial090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T12:06:39.350 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T12:06:39.350 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:06:39.350 DEBUG:teuthology.orchestra.run.trial090:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T12:06:39.407 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:06:39.407 DEBUG:teuthology.orchestra.run.trial090:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T12:06:39.463 INFO:tasks.ceph:Sending monmap to node ubuntu@trial090.front.sepia.ceph.com 2026-02-17T12:06:39.463 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:06:39.463 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T12:06:39.463 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T12:06:39.537 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-17T12:06:39.537 DEBUG:teuthology.orchestra.run.trial090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:06:39.594 INFO:tasks.ceph:Sending monmap to node ubuntu@trial198.front.sepia.ceph.com 2026-02-17T12:06:39.594 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:06:39.594 DEBUG:teuthology.orchestra.run.trial198:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T12:06:39.594 DEBUG:teuthology.orchestra.run.trial198:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T12:06:39.629 DEBUG:teuthology.orchestra.run.trial198:> set -ex 2026-02-17T12:06:39.629 DEBUG:teuthology.orchestra.run.trial198:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:06:39.686 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T12:06:39.687 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T12:06:39.687 DEBUG:teuthology.orchestra.run.trial090:> sudo mkdir -p /var/lib/ceph/mgr/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.a /var/lib/ceph/mgr/ceph-a/keyring 2026-02-17T12:06:39.732 INFO:teuthology.orchestra.run.trial090.stdout:creating /var/lib/ceph/mgr/ceph-a/keyring 2026-02-17T12:06:39.735 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T12:06:39.735 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T12:06:39.735 DEBUG:teuthology.orchestra.run.trial090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T12:06:39.771 INFO:teuthology.orchestra.run.trial090.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T12:06:39.782 DEBUG:teuthology.orchestra.run.trial198:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-17T12:06:39.819 INFO:teuthology.orchestra.run.trial198.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-17T12:06:39.830 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T12:06:39.830 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2026-02-17T12:06:39.831 DEBUG:teuthology.orchestra.run.trial090:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T12:06:39.855 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:06:39.855 INFO:tasks.ceph:role: osd.0 2026-02-17T12:06:39.855 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial090.front.sepia.ceph.com 2026-02-17T12:06:39.855 DEBUG:teuthology.orchestra.run.trial090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T12:06:39.920 INFO:teuthology.orchestra.run.trial090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T12:06:39.920 INFO:teuthology.orchestra.run.trial090.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T12:06:39.920 INFO:teuthology.orchestra.run.trial090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T12:06:39.921 INFO:teuthology.orchestra.run.trial090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T12:06:39.921 INFO:teuthology.orchestra.run.trial090.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T12:06:39.921 INFO:teuthology.orchestra.run.trial090.stdout: = sunit=0 swidth=0 blks 2026-02-17T12:06:39.921 INFO:teuthology.orchestra.run.trial090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T12:06:39.921 INFO:teuthology.orchestra.run.trial090.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T12:06:39.921 INFO:teuthology.orchestra.run.trial090.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T12:06:39.921 INFO:teuthology.orchestra.run.trial090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T12:06:40.493 INFO:teuthology.orchestra.run.trial090.stdout:Discarding blocks...Done. 2026-02-17T12:06:40.496 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial090.front.sepia.ceph.com -o noatime 2026-02-17T12:06:40.496 DEBUG:teuthology.orchestra.run.trial090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T12:06:40.578 DEBUG:teuthology.orchestra.run.trial090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T12:06:40.647 DEBUG:teuthology.orchestra.run.trial090:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T12:06:40.711 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-17T12:06:40.712 INFO:tasks.ceph:role: osd.1 2026-02-17T12:06:40.712 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial090.front.sepia.ceph.com 2026-02-17T12:06:40.712 DEBUG:teuthology.orchestra.run.trial090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T12:06:40.772 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:40 trial090 ceph-mon[39228]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:06:40.775 INFO:teuthology.orchestra.run.trial090.stderr:mkfs.xfs: cannot open /dev/vg_nvme/lv_2: Device or resource busy 2026-02-17T12:06:40.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:06:40.777 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048', '-f'] on /dev/vg_nvme/lv_2 on ubuntu@trial090.front.sepia.ceph.com 2026-02-17T12:06:40.777 DEBUG:teuthology.orchestra.run.trial090:> yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2 2026-02-17T12:06:40.841 INFO:teuthology.orchestra.run.trial090.stderr:mkfs.xfs: cannot open /dev/vg_nvme/lv_2: Device or resource busy 2026-02-17T12:06:40.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:06:40.843 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 924, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial090 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 30, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 931, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial090 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2' 2026-02-17T12:06:40.850 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 924, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial090 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 1919, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 30, in nested vars.append(enter()) ^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/ceph.py", line 931, in cluster remote.run(args=['yes', run.Raw('|')] + ['sudo'] + mkfs + [dev]) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial090 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2' 2026-02-17T12:06:40.856 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T12:06:40.871 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-17T12:06:40.887 INFO:tasks.cephadm:Teardown begin 2026-02-17T12:06:40.888 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T12:06:40.913 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T12:06:40.939 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-17T12:06:40.939 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-17T12:06:40.941 DEBUG:teuthology.misc:Transferring archived files from trial090:/var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51396/remote/trial090/crash 2026-02-17T12:06:40.942 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/crash -- . 2026-02-17T12:06:40.979 DEBUG:teuthology.misc:Transferring archived files from trial198:/var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51396/remote/trial198/crash 2026-02-17T12:06:40.980 DEBUG:teuthology.orchestra.run.trial198:> sudo tar c -f - -C /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/crash -- . 2026-02-17T12:06:41.008 INFO:teuthology.orchestra.run.trial198.stderr:tar: /var/lib/ceph/ea07e39e-0bf8-11f1-bf0e-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-17T12:06:41.008 INFO:teuthology.orchestra.run.trial198.stderr:tar: Error is not recoverable: exiting now 2026-02-17T12:06:41.009 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-17T12:06:41.009 INFO:tasks.cephadm:Removing cluster... 2026-02-17T12:06:41.010 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 849b6112-b711-4ca0-bbb0-f14adea3e7ff --force 2026-02-17T12:06:41.134 INFO:teuthology.orchestra.run.trial090.stdout:Deleting cluster with fsid: 849b6112-b711-4ca0-bbb0-f14adea3e7ff 2026-02-17T12:06:41.213 DEBUG:teuthology.orchestra.run.trial198:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 849b6112-b711-4ca0-bbb0-f14adea3e7ff --force 2026-02-17T12:06:41.326 INFO:teuthology.orchestra.run.trial198.stdout:Deleting cluster with fsid: 849b6112-b711-4ca0-bbb0-f14adea3e7ff 2026-02-17T12:06:41.400 INFO:tasks.cephadm:Removing cephadm ... 2026-02-17T12:06:41.400 DEBUG:teuthology.orchestra.run.trial090:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-17T12:06:41.418 DEBUG:teuthology.orchestra.run.trial198:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-17T12:06:41.436 INFO:tasks.cephadm:Teardown complete 2026-02-17T12:06:41.436 ERROR:teuthology.run_tasks:Manager failed: cephadm Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-17T12:06:41.441 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T12:06:41.456 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-17T12:06:41.462 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T12:06:41.462 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:06:41.464 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T12:06:41.656 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T12:06:41.667 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T12:06:41.667 DEBUG:teuthology.orchestra.run.trial090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:06:41.669 DEBUG:teuthology.orchestra.run.trial198:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T12:06:41.684 INFO:teuthology.orchestra.run.trial090.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:06:41.686 INFO:teuthology.orchestra.run.trial198.stderr:bash: line 1: ntpq: command not found 2026-02-17T12:06:41.709 INFO:teuthology.orchestra.run.trial198.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:06:41.709 INFO:teuthology.orchestra.run.trial198.stdout:=============================================================================== 2026-02-17T12:06:41.709 INFO:teuthology.orchestra.run.trial198.stdout:^- 172-104-28-175.ip.linode> 2 6 77 20 -8565us[-8565us] +/- 57ms 2026-02-17T12:06:41.709 INFO:teuthology.orchestra.run.trial198.stdout:^+ 66.59.198.178 2 6 77 19 -2366us[-2366us] +/- 14ms 2026-02-17T12:06:41.709 INFO:teuthology.orchestra.run.trial198.stdout:^- 172-234-37-140.ip.linode> 2 6 77 20 +8876us[+8876us] +/- 91ms 2026-02-17T12:06:41.709 INFO:teuthology.orchestra.run.trial198.stdout:^* time.ecansol.net 1 6 77 21 +854us[ +255us] +/- 15ms 2026-02-17T12:06:41.714 INFO:teuthology.orchestra.run.trial090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T12:06:41.714 INFO:teuthology.orchestra.run.trial090.stdout:=============================================================================== 2026-02-17T12:06:41.714 INFO:teuthology.orchestra.run.trial090.stdout:^+ 172-234-25-10.ip.linodeu> 2 6 77 20 -5651us[-5651us] +/- 77ms 2026-02-17T12:06:41.714 INFO:teuthology.orchestra.run.trial090.stdout:^+ ntp.maxhost.io 2 6 77 20 +2866us[+2866us] +/- 57ms 2026-02-17T12:06:41.714 INFO:teuthology.orchestra.run.trial090.stdout:^+ 38.134.40.65 2 6 77 21 +1293us[+2077us] +/- 25ms 2026-02-17T12:06:41.714 INFO:teuthology.orchestra.run.trial090.stdout:^* hydra.frangipani.org 3 6 77 20 -154us[ +630us] +/- 39ms 2026-02-17T12:06:41.714 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T12:06:41.726 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T12:06:41.726 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T12:06:41.739 DEBUG:teuthology.orchestra.run.trial090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T12:06:41.811 DEBUG:teuthology.orchestra.run.trial198:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T12:06:41.865 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:06:41.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:06:41.894 DEBUG:teuthology.orchestra.run.trial198:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T12:06:41.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:06:41.920 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T12:06:41.936 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T12:06:41.952 INFO:teuthology.task.internal:Duration was 320.942999 seconds 2026-02-17T12:06:41.952 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T12:06:41.968 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T12:06:41.968 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:06:41.971 DEBUG:teuthology.orchestra.run.trial198:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T12:06:42.006 INFO:teuthology.orchestra.run.trial090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:06:42.007 INFO:teuthology.orchestra.run.trial198.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T12:06:42.164 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T12:06:42.164 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial090.front.sepia.ceph.com 2026-02-17T12:06:42.164 DEBUG:teuthology.orchestra.run.trial090:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:06:42.184 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial198.front.sepia.ceph.com 2026-02-17T12:06:42.184 DEBUG:teuthology.orchestra.run.trial198:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T12:06:42.223 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T12:06:42.224 DEBUG:teuthology.orchestra.run.trial090:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:06:42.226 DEBUG:teuthology.orchestra.run.trial198:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:06:42.352 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T12:06:42.353 DEBUG:teuthology.orchestra.run.trial090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:06:42.355 DEBUG:teuthology.orchestra.run.trial198:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T12:06:42.376 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:06:42.377 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:06:42.378 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gzgzip 2026-02-17T12:06:42.378 INFO:teuthology.orchestra.run.trial090.stderr: -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:06:42.378 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:06:42.379 INFO:teuthology.orchestra.run.trial198.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T12:06:42.380 INFO:teuthology.orchestra.run.trial198.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T12:06:42.380 INFO:teuthology.orchestra.run.trial198.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T12:06:42.380 INFO:teuthology.orchestra.run.trial198.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T12:06:42.380 INFO:teuthology.orchestra.run.trial198.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T12:06:42.390 INFO:teuthology.orchestra.run.trial198.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:06:42.398 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T12:06:42.400 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T12:06:42.417 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T12:06:42.417 DEBUG:teuthology.orchestra.run.trial090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:06:42.466 DEBUG:teuthology.orchestra.run.trial198:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T12:06:42.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T12:06:42.509 DEBUG:teuthology.orchestra.run.trial090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:06:42.511 DEBUG:teuthology.orchestra.run.trial198:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:06:42.533 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern = core 2026-02-17T12:06:42.556 INFO:teuthology.orchestra.run.trial198.stdout:kernel.core_pattern = core 2026-02-17T12:06:42.568 DEBUG:teuthology.orchestra.run.trial090:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:06:42.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:06:42.603 DEBUG:teuthology.orchestra.run.trial198:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T12:06:42.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:06:42.624 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T12:06:42.641 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T12:06:42.642 DEBUG:teuthology.misc:Transferring archived files from trial090:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51396/remote/trial090 2026-02-17T12:06:42.642 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:06:42.663 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 17 12:06:42 trial090 ceph-mon[39228]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T12:06:42.682 DEBUG:teuthology.misc:Transferring archived files from trial198:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:10:36-rados-wip-bharath20-testing-2026-02-13-0906-squid-distro-default-trial/51396/remote/trial198 2026-02-17T12:06:42.682 DEBUG:teuthology.orchestra.run.trial198:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T12:06:42.720 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T12:06:42.721 DEBUG:teuthology.orchestra.run.trial090:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:06:42.723 DEBUG:teuthology.orchestra.run.trial198:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T12:06:42.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T12:06:42.788 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T12:06:42.789 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T12:06:42.806 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T12:06:42.806 DEBUG:teuthology.orchestra.run.trial090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:06:42.809 DEBUG:teuthology.orchestra.run.trial198:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T12:06:42.824 INFO:teuthology.orchestra.run.trial090.stdout: 791886 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 12:06 /home/ubuntu/cephtest 2026-02-17T12:06:42.824 INFO:teuthology.orchestra.run.trial090.stdout: 786984 4 -rw-r--r-- 1 ubuntu ubuntu 201 Feb 17 12:06 /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:06:42.824 INFO:teuthology.orchestra.run.trial090.stdout: 786981 4 -rw-r--r-- 1 root root 123 Feb 17 12:05 /home/ubuntu/cephtest/ceph.pub 2026-02-17T12:06:42.824 INFO:teuthology.orchestra.run.trial090.stdout: 786975 4 -rw-r--r-- 1 ubuntu ubuntu 3066 Feb 17 12:05 /home/ubuntu/cephtest/seed.ceph.conf 2026-02-17T12:06:42.824 INFO:teuthology.orchestra.run.trial090.stdout: 1048667 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:06 /home/ubuntu/cephtest/ceph.data 2026-02-17T12:06:42.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T12:06:42.826 INFO:teuthology.orchestra.run.trial090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-17T12:06:42.826 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 412, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 853, in ceph_bootstrap _shell( File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 114, in _shell '--image', ctx.ceph[cluster_name].image, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'image' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 2216, in task with contextutil.nested( File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 46, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 464, in ceph_log if first_in_ceph_log('\[ERR\]|\[WRN\]|\[SEC\]', ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_3c96dfb3f50b3d02598a82af7104764bfdcd3919/qa/tasks/cephadm.py", line 444, in first_in_ceph_log r = ctx.ceph[cluster_name].bootstrap_remote.run( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial090 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T12:06:42.833 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T12:06:42.850 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T12:06:42.868 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: AttributeError: 'Namespace' object has no attribute 'bootstrap_remote' 2026-02-17T12:06:42.873 INFO:teuthology.run:Summary data: description: rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e} duration: 320.942999124527 failure_reason: 'Command failed on trial090 with status 1: ''yes | sudo mkfs.xfs -f -i size=2048 -f /dev/vg_nvme/lv_2''' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T12:06:42.873 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T12:06:42.877 INFO:teuthology.orchestra.run.trial198.stdout: 791886 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 12:06 /home/ubuntu/cephtest 2026-02-17T12:06:42.877 INFO:teuthology.orchestra.run.trial198.stdout: 786978 4 -rw-r--r-- 1 ubuntu ubuntu 201 Feb 17 12:06 /home/ubuntu/cephtest/ceph.monmap 2026-02-17T12:06:42.877 INFO:teuthology.orchestra.run.trial198.stdout: 1056390 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 12:06 /home/ubuntu/cephtest/ceph.data 2026-02-17T12:06:42.878 INFO:teuthology.orchestra.run.trial198.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-17T12:06:42.985 INFO:teuthology.run:FAIL